CopilotForgeDraft

Templates › Human oversight plan

Human oversight plan

Template id: human-oversight-plan

Responsible skill: responsible-ai:human-oversight. The plan responds to impacts recorded in the ai-impact-assessment-record; checkpoints are built with copilot-cowork:human-checkpoint-design or automation:human-in-the-loop.

Every fact the organisation must supply is marked [To confirm: ...]. Example rows are fictional. Oversight measures are reported at role level and are never used to assess or rank individual reviewers. Gaps are classified blocking or advisory with a fix and an owner.

1. Solution

FieldEntry
Solution name[To confirm]
Business owner (role)[To confirm]
Risk tier[To confirm]
Impact assessment reference[To confirm]
Plan version and date[To confirm]

2. Oversight by output or action

Output or actionHarm if wrongLast point a person can prevent itOversight mode (review every output, approve before action, sampled review, monitoring)Reviewing role
Fictional example: draft refusal letter to a customerCustomer wrongly refusedBefore sendingReview every outputFictional example: senior case handler
[To confirm][To confirm][To confirm][To confirm][To confirm]

3. Capacity check

Reviewing roleExpected items per dayCareful review time per itemTime available per dayFits?If not, design change
[To confirm][To confirm][To confirm][To confirm]Yes / No[To confirm]

4. What the reviewer sees

ElementProvided?How
The output or proposed actionYes / No[To confirm]
Sources the output relied onYes / No[To confirm]
Case or record contextYes / No[To confirm]
Signals of uncertainty or unusual casesYes / No[To confirm]
Reject and edit as easy as approve; no pre-selected approvalYes / No[To confirm]

5. Authority and competence

QuestionEntry
Where the authority to reject or overturn is written down[To confirm: procedure or role description]
Competence the reviewer needs[To confirm]
Training and calibration provided[To confirm]
How automation bias is countered (for example calibration sessions)[To confirm]

6. Feedback loop

QuestionEntry
How rejections and edits are recorded (aggregate)[To confirm]
Who reviews them and how often[To confirm]
How findings change the solution[To confirm]
Investigation threshold for a very low override rate[To confirm]

7. Pre-release test

TestEntry
Outputs with known errors presented to reviewers[To confirm: number and type]
Realistic conditions (volume, time)[To confirm]
Result at role level[To confirm]
Changes made[To confirm]

8. Gaps

IDGapBlocking or advisoryFixOwnerDueStatus
[To confirm][To confirm]Blocking / Advisory[To confirm][To confirm][To confirm][To confirm]

9. Review triggers

[To confirm: changes in volume, scope, autonomy, model or reviewer role that trigger a review of this plan, and the next scheduled review date]

Credit: Template from CopilotForge by Simon Foote (https://github.com/SimonFoote-greensparx/CopilotForge), licensed under CC BY 4.0. Keep this credit when you share or adapt the template; in your own completed document you may keep it as a footer or remove it.

Download the template (Markdown)