Oversight Question Set
What the governing body should ask about the organization's AI inventory, risks, incidents, suppliers, and change
A leadership page from the library's executive layer: it explains the position in plain language, and the corpus documents it cites remain the governing texts.
Read the source on GitHub (opens in a new tab)
Authority disclaimer. This page is an executive narrative. It does not establish requirements; the linked corpus governs. It is provided to support understanding, discussion, and decision-making by the governing body and accountable executive leadership (board, ELT, or senior management, as applicable). It creates no obligation, control, or assurance by itself. Its publication approval is an editorial act only and confers no authority over any corpus document. Where it differs from a corpus document, the corpus document prevails.
Context for these questions
Oversight works through questions paired with evidence expectations. A question with no stated evidence expectation invites a narrative answer; each question below therefore carries a note on what a strong answer contains, so the reader can tell evidence from reassurance. The board oversight guide establishes that the governing body is accountable for the organization's use of AI and that this accountability cannot be delegated to the AI system or to management (its section 2), and it provides the corpus's director question set as the governing body's primary oversight instrument (its section 5). This page routes to that set and deliberately does not reproduce it. Use the guide for the standing governance questions on duties, literacy, appetite, and reporting; use this page when examining management's operating evidence in five areas: inventory, material risk, incidents, suppliers, and change.
For each area, the corpus defines the register, record, or report a strong answer draws on, and each note below points to where. The pairing of a question with an evidence expectation is a composite reading across the sources this page lists; the limitations say so.
The questions are entity-neutral. They presume nothing about whether the asking body is a board, a board committee, or senior management holding the equivalent authority. The corpus's guidance on fitting its governance roles to smaller structures is the minimum viable governance structure guideline.
Questions
Theme: inventory. Do we know what is running?
- Which AI systems do we operate or rely on, and when was the inventory last verified as complete? A strong answer produces the register, not a summary of it. The AI system register template defines the fields a live register carries, including lifecycle status, the owner roles, the risk classification, the impact level, and a next review date per system (its register fields section). Beneath it at model level, the model registry sets the deployment-entry gate and the periodic completeness-review expectation it sets in its operating expectations.
- How would we find the AI in use that never came through approval? A strong answer describes a control operating, not a policy stating that unapproved use is forbidden. The AI governance and risk framework defines the shadow AI control boundary and what it must cover (its shadow AI control boundary section), and the register template's review questions begin with whether the system is recorded before use.
- For each system in the highest risk classifications, who owns the system, the data, and the controls today? A strong answer names the current accountable roles in the register's owner fields and shows the separate role-to-incumbent mapping is kept current as people move. The board oversight guide names responsibility for an AI outcome attributed to the system or the vendor rather than an accountable person as a governance red flag (its section 6).
- Which models and external dependencies sit underneath these systems? A strong answer reads from the model registry, whose schema and lineage tracking record what each model was built from and what depends on it.
A weak answer in this theme: a count with no date of last verification, or an inventory that contains only the systems the presenting team already knew about.
Theme: material risk. Are we inside the appetite this body approved?
- What are our material AI risks, and are they within appetite? A strong answer reads the AI risk register against the approved risk appetite statement, whose Parts 2 and 3 carry the appetite categories and the tolerance boundaries. The register's schema records each risk's rating, owner, treatment, and review date.
- For the systems at the highest impact levels, what did their impact assessments conclude? A strong answer produces the assessment records from the ten-step impact assessment procedure, the impact level set at its Assign impact level member (Step 7) and the decision recorded at its Approve or reject member (Step 9); use Step 9 for the record's required contents.
- What residual AI risk have we formally accepted, who approved each acceptance, and when does it expire? A strong answer produces acceptance records carrying the fields the risk acceptance procedure requires, including owner, compensating controls, and expiry, approved at the authority the exception and risk acceptance policy sets for the risk level (its section 4.2). An acceptance with no expiry, or an expiry that keeps rolling forward without reassessment, is itself a finding.
- How does AI risk reach this body on a cadence, rather than only after something breaks? A strong answer is the AI and emerging-technology section of the periodic risk report (the board risk report template, its Section 9), delivered on the cadence the template sets.
A weak answer in this theme: risk reported only when an incident occurs. The board oversight guide lists exactly that pattern among its governance red flags (its section 6).
Theme: incidents. Would we recognize one, and could we reconstruct it?
- What counts as an AI incident here? A strong answer produces the defined AI incident classes with their detection triggers and the severity criteria, as the AI incident response plan sets them out. An organization that has not defined the classes cannot report against them.
- What AI incidents and near misses occurred in the period, and what did they change? A strong answer combines the incidents section of the periodic risk report (the board risk report template, its Section 6) with the post-incident review the AI incident response plan defines; use that plan's post-incident review member for its review points, so each incident becomes a test of the other controls on this page.
- For a serious incident, could we reconstruct what the system did? A strong answer shows the evidence the AI incident response plan requires preserved for the incident severities it names (its evidence requirements section).
- Are AI incidents escalated through the same incident discipline as everything else? A strong answer shows AI incidents classified and escalated through incident management, covering the AI-specific incident types the AI security and risk standard lists (its section 4.10).
A weak answer in this theme: "we had no AI incidents" from an organization with no defined AI incident classes. Absence of detection is not absence of events.
Theme: suppliers. Who puts AI into our operations, and on what terms?
- Which suppliers put AI into our operations, and what did due diligence conclude for each? A strong answer produces the completed pre-engagement checklist and the supplier classification for each, per the third-party AI due diligence procedure (its sections 4 and 5).
- Do our contracts carry the mandatory AI contractual requirements that procedure's section 6 defines? A strong answer shows those section 6 contractual AI requirements evidenced supplier by supplier, not asserted in general.
- Where are we concentrated, and what happens if a critical AI provider fails, changes terms, or becomes unavailable? A strong answer reads from the concentration risk register across the dimensions it tracks, together with the supplier and concentration section of the periodic risk report (the board risk report template, its Section 8).
- When we exit an AI supplier, can we show our data and models were returned or deleted? A strong answer produces the completed offboarding record in the form the supplier offboarding evidence template defines, with the exit and deletion steps of the third-party AI due diligence procedure (its section 8) behind it.
A weak answer in this theme: a completed questionnaire presented as assurance. The supplier and cloud governance framework sets out a fuller evidence set for an adopting organization to maintain, including the due diligence record, the contract control schedule, assurance evidence, and reassessment records (its evidence requirements section).
Theme: change. Who checks the system after it changes?
- What counts as a material change to an AI system, and what reassessment follows one? A strong answer shows the last change classified against the material change thresholds the AI governance and risk framework defines once for the whole corpus (its material change thresholds section), and the reassessment record produced when a threshold is crossed.
- When a provider changes a model underneath us, how do we find out, and what happens next? A strong answer shows version change notification operating under contract (the third-party AI due diligence procedure, its section 6.6) and a reassessment following the procedure's triggers (its section 7.4), classified against the framework's thresholds.
- Are retrained or updated models re-tested to the same bar as new ones? A strong answer produces retraining validation records. The AI model lifecycle procedure applies the same testing and validation requirements to retraining as to pre-deployment (its section 5).
- Do AI changes pass through the organization's change discipline? A strong answer produces change records with approvals, rollback plans, and post-implementation review, per the change management procedure (its sections 2, 6, and 7).
A weak answer in this theme: "the vendor manages model updates." The board oversight guide places accountability for the organization's AI use with the governing body and states that it cannot be delegated to the AI system or to management (its section 2); the contractual notification and reassessment controls above exist because providers change models.
Evidence to request
Each item below is an evidence class the governing body can call for from management, and each is evidence for a named control or outcome.
- The current AI system register extract and model registry extract, as evidence of the inventory and ownership controls, in the structures the AI system register template and the model registry define.
- The AI risk register read against the approved appetite statement, as evidence that material AI risk is tracked against the appetite the governing body approved, per the AI risk register and the risk appetite statement.
- Impact assessment records with their approval decisions for the systems at the highest impact levels, as evidence that the assessment gate operated, per the impact assessment procedure (its Steps 7 and 9).
- Risk acceptance and exception records with owners, compensating controls, and expiries, as evidence for the risk acceptance control, per the risk acceptance procedure and the exception and risk acceptance policy.
- The periodic risk report's AI, incident, and supplier sections, with their delivery record, as evidence for the reporting expectation the board oversight guide sets (its section 7), in the structure of the board risk report template.
- The defined AI incident classes and the most recent post-incident review output, as evidence that the incident path is defined and has been exercised, per the AI incident response plan.
- Per-supplier due diligence records and the contract control schedule, as evidence for supplier governance, per the third-party AI due diligence procedure and the supplier and cloud governance framework.
- The concentration risk register extract, as evidence that concentration exposure is identified and treated, per the concentration risk register.
- Completed offboarding evidence for the most recent AI supplier exit, as evidence that exits are controlled, per the supplier offboarding evidence template.
- The last material change classification and its reassessment record, with the change records behind it, as evidence that change control engages for AI, per the AI governance and risk framework, the AI model lifecycle procedure, and the change management procedure.
Limitations
- This page creates no compliance and imposes no requirement. The linked corpus documents govern; where this page differs from a corpus document, the corpus document prevails.
- These questions are advisory. They organize a line of questioning; the decision about what to ask, and what to accept as an answer, remains entirely with the reader's organization.
- This page carries composite claims. The pairing of each question with an evidence expectation, and the weak-answer characterizations, are synthesized across the listed corpus sources, and the adopting organization validates that reading against its own governance model, committee structure, and delegation of authority.
- This set is not exhaustive. The board oversight guide covers director duties, literacy, appetite setting, and reporting expectations; this page extends that instrument into operating evidence and does not repeat it.
- Every threshold, cadence, severity level, tier name, register field, and approval authority lives in the corpus documents this page links. This page routes to them and does not reproduce them; that routing is a contribution to the corpus's status as the single source for every value.
- Expected evidence describes what the corpus defines, not what any given organization has implemented. A gap between the two is itself an oversight finding, to be handled through the risk and exception routes the corpus provides rather than by softening the question.
- This page makes no claim about how likely any failure is, and none of its statements should be read as a probability or a frequency.
Source
The source
This page is rendered from the version-controlled Markdown file in the corpus repository, with the site's navigation and framing added around it. The Markdown, where its metadata, review record and full history live, is the source. If the two ever differ, the source governs.
Domains