View all Professional Packs

Free Professional Pack

Internal Audit & AI Assurance

Practical AI resources for audit planning, evidence review, control testing, working papers and assurance of AI-enabled systems.

For internal auditors, audit teams and AI-assurance practitioners. Choose the track that matches the work in front of you.

Go beyond individual resources with connected Workflows, editable audit Templates, realistic Practice Cases and real-world examples that show how evidence, controls and professional judgement come together in practice.

Professional internal auditor reviewing working papers at a laptop

Start here · Track A · Workflow · AMO-W-000044

Start with the working-paper Workflow

Evidence-Controlled Internal Audit Working Paper

This six-step Workflow takes you from permitted use and evidence boundaries through engagement planning, test-design challenge, evidence extraction, finding review and final working-paper verification.

Begin with the manual permitted-use check. Review and edit each result before carrying it forward. AI output is working material; it is not source evidence. A Run Record records the inputs, tools used and human review; it is not audit evidence by itself or an audit opinion.

Open Workflow shows the guide. Run in Workplace opens a private workspace using your own AI provider key. You choose when to run each supported step.

How to use the Pack

  1. Choose your track. Start with the type of work you are doing.
  2. Choose a resource. Open the Prompt, Workflow or Skill that matches the immediate objective.
  3. Work with your preferred AI. Copy the resource into your AI tool or use Workplace for supported Prompts and Workflows.
  4. Review before relying. Check source evidence, assumptions, limitations and conclusions before carrying anything into audit working papers or decisions.

Copying only copies text. Manual, Codex and other external steps remain external; no provider is silently substituted. Skills provide reusable instructions and do not run automatically.

If you run supported resources in Workplace, your selected AI provider may charge for its own API usage.

Browse templates · Try a synthetic practice case

Used in both tracks

Set boundaries, map controls and verify claims

Use these methods wherever the task requires them. Permitted AI use does not establish the effectiveness of the system you are examining.

Set boundaries and verify claims

Track A

Using AI in Internal Audit

Start from the shared information and evidence boundaries, then choose the immediate audit task. The planning → test design → finding / response / closure sequence is useful when those stages apply; you do not have to run all three Prompts together.

The working-paper Workflow connects these stages. Use the scope, control-and-evidence, findings and AI-use templates to retain reviewed working material.

Plan, challenge testing and review findings

Handle information and review evidence

Prompt · AMO-P-000149

Team AI Usage SOP and Review Loop

Document team AI-use responsibilities, restricted data, review rules and escalation. Use as a manual reference where needed.

Open Prompt: Team AI Usage SOP and Review Loop

Track B

Auditing AI Systems

Define the system and evidence question first. Select the vendor, RAG, evaluation or change method that fits it; these are complementary choices, not a requirement to test every domain.

Apply the shared evidence and claim-verification methods throughout. A Skill and its source method are not independent corroboration.

Scope the system and examine vendor evidence

Examine knowledge, retrieval and grounding

Assess evaluation reliability and system changes

When a finding is supported, return to the finding, response and closure challenge and the findings register. A release decision or completed action does not automatically close an audit issue.

Templates

Six documentation bundles with 20 working views. Download the Markdown source to edit in your preferred text or Markdown editor, or expand a preview. Keep authoritative evidence in your organisation's approved repository.

Completed fields do not establish evidence sufficiency, statistical validity, control effectiveness or closure. Those remain professional decisions. Apply your organisation's approved retention and privacy requirements.

Template bundle · Markdown

AI Assurance Scope, Inventory and Evidence-Request Workbook

Link a defined audit purpose to a bounded system inventory, supplied risk criteria and a proportionate evidence request.

Download template (.md): AI Assurance Scope, Inventory and Evidence-Request Workbook

Read template preview: AI Assurance Scope, Inventory and Evidence-Request Workbook

AI Assurance Scope, Inventory and Evidence-Request Workbook

Track A and Track B · Neutral documentation bundle

Purpose

Link a defined audit purpose to a bounded system inventory, supplied risk criteria and a proportionate evidence request. Keep scope approval separate from system-owner assertions.

Intended user

Engagement lead, audit practitioner and supervisor; system/data owners supply facts and access decisions.

When to use

Before fieldwork, when the system boundary changes or when missing access prevents a planned question being answered.

Included templates
  • AI system inventory.
  • AI risk classification worksheet.
  • AI audit planning memo.
  • AI evidence request list.
Shared evidence/provenance and human-review fields

Complete this cover once per working-paper record. Repeat only where the scope or reviewer changes. Local review rows should reference the shared decision ID when the same decision covers them; record only view-specific judgement or a different decision there, not duplicate names/dates. A role label alone may not identify the actual reviewer: use the responsible person or institution-controlled reviewer reference in the authorised record, without unnecessary personal data in provider inputs. Use source IDs in individual rows rather than copying the full evidence inventory. Blank is not a pass; use “not supplied”, “not performed”, “unclear”, or “not applicable — reason” accurately.

Field Definition / professional purpose Entry
Record ID and objective Local working-paper reference and the decision/question this record supports; not a newly assigned AMO ID —
System/process and period Exact unit, system baseline and period examined; bounds the conclusion —
Source register Evidence ID; permitted locator; version/date; source owner; date obtained; scope/access limitation. A cited document not inspected stays “not inspected” —
Preparer and work state Responsible preparer role; date; distinguish proposed, performed and supplied third-party work —
Reviewer decision Reviewer identity/reference and authority; date; exact record/version reviewed; decision ID and rationale; restrictions. Leave unrecorded until a person decides —
Unresolved matter / follow-up Missing or conflicting evidence; affected decision; next request/action; owner/date only if supplied —
Approved carry-forward Exact edited material authorised for the next activity, linked to review decision and remaining limitations; no automatic approval —

Suggested review states describe this document only: draft, awaiting evidence, returned for revision, held, or reviewed for the stated limited use. They do not change any application schema or establish an engagement conclusion. An action status is recorded separately from an evidence or reviewer status.

Field definitions and fillable templates

Each table is a blank working view. Duplicate a view or its item rows only for a distinct system, test, claim or event. Keep related evidence under stable IDs.

AI system inventory
Field Definition / purpose Entry
System/use reference Stable organisation-supplied identifier and intended purpose; unknown inventory coverage remains explicit. —
Owner and lifecycle Accountable role, operational stage and source of each statement. —
Model/vendor/data dependencies Named components, version where known, data categories and dependency evidence IDs; no secrets. —
Users and permitted actions Affected users and actual or proposed actions; distinguish intended design from effective capability. —
Boundary and interfaces Inputs, outputs, connected systems and in/out-of-scope components. —
Baseline and gaps Approved versus observed version/configuration; unknown items and evidence needed. —

Completion guidance: Use AMO-P-000074 as a source method; do not discover a whole organisation from a partial list. Record use and system separately where one system has materially different uses.

AI risk classification worksheet
Field Definition / purpose Entry
Use and affected parties Specific use, users and decision/action affected. —
Criteria source Organisation-supplied risk taxonomy, version and authority; absent criteria stay absent. —
Risk scenario and evidence What could go wrong and what actually supports the scenario; separate observed event from hypothesis. —
Classification and rationale Supplied rating or proposed classification explicitly labelled with rationale and uncertainty; do not invent a scale. —
Controls and dependencies Linked control-and-evidence working paper/vendor/operational workbook control references; design description is not operating evidence. —
Applicability question Separate legal/sector applicability question and responsible specialist, only where needed; no inferred statutory classification. —
Decision needed Authorised risk owner decision and any unresolved evidence before reliance. —

Completion guidance: If criteria are absent, describe the risk and request the criteria; do not calculate a rating. This view supports professional planning, not legal classification.

AI audit planning memo
Field Definition / purpose Entry
Mandate and independence Source of engagement authority and independence/conflict review; distinguish proposed scope from authorised work. —
Objective / risk / criterion Each supplied audit objective with risk linkage and applicable criterion source. —
Coverage period and exclusions Entities, systems, processes, populations and time; exclusion rationale and effect. —
Evidence strategy Question, required record, expected provenance and intended procedure; link evidence requests. —
Feasibility and dependencies Access, skill/specialist, time and resource constraints; commitments only if supplied. —
Data-use boundary Permitted data and provider/surface decision; link AI-use record instead of duplicating sensitive detail. —
Supervisor handoff Proposed plan changes, blockers and actual approval decision or pending state. —

Completion guidance: Use AMO-P-000361 to challenge the memo, then have the supervisor decide. Do not convert a readiness analysis into an audit mandate or promise effectiveness over excluded processes.

AI evidence request list
Field Definition / purpose Entry
Request / objective reference A precise requested artefact and the question it is needed to answer. —
Owner and period Custodian if known; period/version required to make the evidence relevant. —
Minimum necessary content Fields/excerpts needed and minimisation requirements; do not request credentials. —
Transfer and authority Permitted access/transfer method under institutional policy; approval dependency, not an invented URL. —
Due condition and response Agreed date/trigger only if supplied; received/partial/unavailable, with response reference. —
Adequacy / next decision What the received item supports, its limit and whether a narrower request or supervisor decision is needed. —

Completion guidance: A request is not evidence received. Record refusals and partial responses without treating them as proof of a control failure.

Bundle completion guidance

Complete the inventory first at the scope necessary for the question. Apply only supplied risk criteria, then challenge scope with AMO-P-000361 and request the missing records. Keep evidence IDs and permitted locators in the source register; include only the minimum permitted excerpt needed for the question, linked to the authoritative record. The workbook is an index and review record, not a reason to duplicate confidential originals. Apply the organisation's approved retention and privacy requirements; if the controlling record is absent, obtain the responsible records/privacy decision rather than prescribe a period.

Before carrying material forward, reconcile the question, criterion, source and actual observation. Preserve original evidence in the institution's authorised repository. Use only permitted excerpts in an AI surface; do not paste private credentials or unapproved identifiers. Local saving is not evidence custody or permission to disclose to a provider. A proposed test or a completed form cannot stand in for a recorded result.

The audit supervisor decides sufficiency and reliance; the specialist decides matters within their competence and authority. Management validates its own representations and owns corrective action. Management agreement is not the audit reviewer's independent closure decision. Carry-forward remains editable and requires explicit review.

Example completed synthetic excerpt
View Synthetic completed entry
AI system inventory Aster-17 central equipment release queue; September scope; regional/emergency/amendment exclusions per CA-01; complete system inventory not supplied
AI risk classification worksheet Potential reliance on incomplete authorisation evidence; no organisational risk taxonomy supplied; no rating assigned
AI audit planning memo Objective: examine prior authorisation per CA-04 clause 2; CA-01's all-controls sentence exceeds supplied scope; supervisor limits work per CA-09
AI evidence request list Request population reconciliation and exception procedure; custodian role per CA-05; date obtained for existing extracts: 7 October; next-request due date not agreed

Reviewer field: CA-09 contains a limited-use instruction; no plan approval or engagement conclusion is inferred. Unresolved exclusions and access limitations carry forward.

This is an illustrative entry from the bundled fictional case, not work performed on a real organisation. Review dates/decisions shown as proposed must not be represented as real sign-offs.

Limitations
  • No complete AI inventory or risk classification is established from partial self-reported inputs.
  • Framework/sector mapping and legal applicability require separate qualified review.
  • This is a supplied-evidence review aid. It does not perform an audit, issue an audit opinion, establish control effectiveness, certify anything, determine legal compliance or grant professional approval. The authorised audit professional retains judgement and reliance decisions. Use only information permitted for the selected provider; local encrypted storage does not itself authorise provider disclosure.
Related Amo.ng resources

Prompts: AMO-P-000074 — Evidence-Grounded Shadow AI Risk Assessment and Governance Plan v2.0.0; AMO-P-000194 — Internal SOP Gap and Control Mapping Brief v1.0.0; AMO-P-000155 — Sensitive Data Handling Checklist for AI Workflows v2.0.1

Workflows: AMO-W-000002 — Vendor Procurement Due Diligence; AMO-W-000016 — Assess Enterprise Knowledge and RAG Readiness

Skills: AMO-S-000016 — Trace Consequential Claims to Original Evidence

These are complementary methods, not additional proof of the same claim. Read their current source boundaries; open their normal resource pages for the full instructions. Existing resources and their verification status remain unchanged.

Related audit Prompts and Workflow

Use of these resources is subject to the Amo.ng Terms.

Template bundle · Markdown

Risk-Control-Test and Evidence-Sufficiency Working Paper

Connect a control question, authorised test design, actual evidence and bounded analysis.

Download template (.md): Risk-Control-Test and Evidence-Sufficiency Working Paper

Read template preview: Risk-Control-Test and Evidence-Sufficiency Working Paper

Risk-Control-Test and Evidence-Sufficiency Working Paper

Track A and Track B · Neutral documentation bundle

Purpose

Connect a control question, authorised test design, actual evidence and bounded analysis without turning AI output into source evidence.

Intended user

Audit practitioner, engagement supervisor and a sampling/evaluation specialist where the method requires one.

When to use

When designing a test, recording supplied or performed work, reviewing system-evaluation evidence or deciding whether a working-paper claim is supportable.

Included templates
  • AI risk and control matrix.
  • Model/system evaluation worksheet.
  • Audit evidence sufficiency checklist.
  • AI-generated-work verification checklist.
Shared evidence/provenance and human-review fields

Complete this cover once per working-paper record. Repeat only where the scope or reviewer changes. Local review rows should reference the shared decision ID when the same decision covers them; record only view-specific judgement or a different decision there, not duplicate names/dates. A role label alone may not identify the actual reviewer: use the responsible person or institution-controlled reviewer reference in the authorised record, without unnecessary personal data in provider inputs. Use source IDs in individual rows rather than copying the full evidence inventory. Blank is not a pass; use “not supplied”, “not performed”, “unclear”, or “not applicable — reason” accurately.

Field Definition / professional purpose Entry
Record ID and objective Local working-paper reference and the decision/question this record supports; not a newly assigned AMO ID —
System/process and period Exact unit, system baseline and period examined; bounds the conclusion —
Source register Evidence ID; permitted locator; version/date; source owner; date obtained; scope/access limitation. A cited document not inspected stays “not inspected” —
Preparer and work state Responsible preparer role; date; distinguish proposed, performed and supplied third-party work —
Reviewer decision Reviewer identity/reference and authority; date; exact record/version reviewed; decision ID and rationale; restrictions. Leave unrecorded until a person decides —
Unresolved matter / follow-up Missing or conflicting evidence; affected decision; next request/action; owner/date only if supplied —
Approved carry-forward Exact edited material authorised for the next activity, linked to review decision and remaining limitations; no automatic approval —

Suggested review states describe this document only: draft, awaiting evidence, returned for revision, held, or reviewed for the stated limited use. They do not change any application schema or establish an engagement conclusion. An action status is recorded separately from an evidence or reviewer status.

Field definitions and fillable templates

Each table is a blank working view. Duplicate a view or its item rows only for a distinct system, test, claim or event. Keep related evidence under stable IDs.

AI risk and control matrix
Field Definition / purpose Entry
Risk and objective Supplied risk/control objective and source; distinguish hypothesised risk from an observed condition. —
Control and criterion Expected behaviour, timing/frequency, owner and criterion locator. —
Design versus operation Design record separately from evidence of operation over the stated period. —
Population and selection Population definition/unit, reconciliation, proposed method and rationale; link AMO-P-000362 review. —
Procedure and expected evidence Reproducible authorised procedure, comparison and exception rule; proposed versus performed state. —
Actual result and exception Observation, result source and date only if supplied/performed; unrun work remains not performed. —
Analysis and limit What follows from the evidence, contrary evidence and what cannot be inferred. —
Reviewer / carry-forward Explicit judgement on the scoped claim, remaining gaps and edited next-step material. —

Completion guidance: Use AMO-P-000194 for the control map and AMO-P-000362 for design challenge. The human prepares bounded working-paper analysis from reviewed evidence rows; do not claim that extraction itself supplies an audit conclusion.

Model/system evaluation worksheet
Field Definition / purpose Entry
System baseline and intended decision Exact model/prompt/corpus/tool version where known and what decision the evaluation is to inform. —
Data and coverage Source, selection, slices, duplicates/leakage checks and exclusions; representative status only if supported. —
Reference answer / criterion Expected answer or acceptance basis, source/version and reviewer agreement; no invented numeric threshold. —
Method and authorised scope Procedure, environment, evaluator and permitted checks; planned versus actual run. —
Run/result record Run ID/date, denominator, observations and output locators; missing runs stay missing. —
Contradictions and uncertainty Disagreements, proxy limitations, changing baselines, uncertainty and unavailable measurements. —
Permitted use / reviewer decision Specific decision supported, blocked claims and required specialist review. —

Completion guidance: Reuse AMO-W-000013/AMO-S-000012 for evidence admissibility and AMO-P-000242 for RAG-specific interpretation. User satisfaction is not factual accuracy; judge agreement is not outcome fairness.

Audit evidence sufficiency checklist
Field Definition / purpose Entry
Claim and scope Exact proposed conclusion and period/population/use to which it applies. —
Relevance How each source addresses the question and where it does not. —
Reliability and provenance Origin, access, dates, authority, integrity/custody limitations; distinguish original source from assertion. —
Sufficiency and corroboration Coverage and quality needed for the exact claim under the supplied method, corroboration and contradictions; no score, number of completed rows or universal document count establishes sufficiency. —
Missing or conflicting evidence Gaps, consequence for the claim and smallest further request/check. —
Human sufficiency decision Reasoned judgement by authorised reviewer over the specified claim/evidence, including contrary evidence, limitations and reliance restrictions; reference the shared decision record. If adequacy cannot be assessed, record that limitation rather than sufficient/insufficient by default. —

Completion guidance: Use judgements supported by source locators. No checklist score or number of attached documents automatically determines sufficiency.

AI-generated-work verification checklist
Field Definition / purpose Entry
Output and consequential claim Exact output/version and atomic claim, including any asserted action or test. —
Source / calculation / check Supporting source locator or actual authorised check; do not cite an AI answer as its own corroboration. —
Actual observation What the source/check shows; identify work not performed. —
Support state Supported within stated limits, contradicted, unsupported, unclear or not assessed, with rationale. —
Correction / unresolved matter Before/after wording, rejected material and further evidence needed. —
Reviewer and disclosure link Human reliance decision and AI-use record record of actual AI use; no automatic release. —

Completion guidance: AMO-P-000071 supplies the verification method and AMO-S-000016 traceability. Retain that source method's own status labels when used; this sheet does not rename or elevate Amo Verified.

Bundle completion guidance

Use a common record ID to link the four views. Put the actual observation next to the applicable criterion, preserve denominator and timing, and leave conclusion fields limited if evidence is incomplete. Show proposed versus completed work explicitly. Human analysis and supervisor review are required before any finding or approved carry-forward. Keep risk, expected control, proposed/performed test, source evidence, observed result and reviewer interpretation separately attributable even when linked in one view. Missing evidence is an assessment limitation, not automatically an operating failure. If maintaining a record is itself an applicable control requirement, substantiate that requirement and the search/coverage basis before describing an absent required record as an observed exception.

Before carrying material forward, reconcile the question, criterion, source and actual observation. Preserve original evidence in the institution's authorised repository. Use only permitted excerpts in an AI surface; do not paste private credentials or unapproved identifiers. Local saving is not evidence custody or permission to disclose to a provider. A proposed test or a completed form cannot stand in for a recorded result.

The audit supervisor decides sufficiency and reliance; the specialist decides matters within their competence and authority. Management validates its own representations and owns corrective action. Management agreement is not the audit reviewer's independent closure decision. Carry-forward remains editable and requires explicit review.

Example completed synthetic excerpt
View Synthetic completed entry
AI risk and control matrix CA-04 clause 2 requires approval before issue; CA-06 AC-09 shows 09:00 issue and 11:00 approval; exception procedure absent; no whole-population conclusion
Model/system evaluation worksheet CR-04 E-17 baseline C-17/R2/PT3; hosted model revision absent; four selected traces; no population accuracy claim
Audit evidence sufficiency checklist CA-05 contains four rows / three distinct IDs; claimed total 40 unreconciled; AC-31/AC-38 selection packets absent; population-wide inference held
AI-generated-work verification checklist CA-07 “all five ... authorised” lacks five supplied packets and conflicts with timing evidence; proposed replacement: “The supplied extracts do not establish prior authorisation for all selected items”

Source dates and locators remain as in the case inventory. The arithmetic is over the supplied excerpt, not a new executed population test. Supervisor conclusion/closure is not completed.

This is an illustrative entry from the bundled fictional case, not work performed on a real organisation. Review dates/decisions shown as proposed must not be represented as real sign-offs.

Limitations
  • A sound design is not operating effectiveness; a proposed statistical rationale is not an authorised statistical method.
  • Full training-data governance, explanation fidelity and outcome fairness remain outside these MVP methods.
  • AI review is not independent assurance or an evidence custody system.
  • This is a supplied-evidence review aid. It does not perform an audit, issue an audit opinion, establish control effectiveness, certify anything, determine legal compliance or grant professional approval. The authorised audit professional retains judgement and reliance decisions. Use only information permitted for the selected provider; local encrypted storage does not itself authorise provider disclosure.
Related Amo.ng resources

Prompts: AMO-P-000194 — Internal SOP Gap and Control Mapping Brief v1.0.0; AMO-P-000045 — Evidence Table Extraction Prompt v2.0.0; AMO-P-000056 — Messy Dataset Audit Prompt v2.0.0; AMO-P-000071 — Evidence-Grounded AI Output Verification and Release Gate v2.0.0; AMO-P-000242 — RAG Retrieval and Citation Quality Evaluation Lab v1.0.0

Workflows: AMO-W-000013 — Review Production AI Evaluation Reliability

Skills: AMO-S-000012 — Assess AI Evaluation Evidence for Decision Use; AMO-S-000016 — Trace Consequential Claims to Original Evidence

These are complementary methods, not additional proof of the same claim. Read their current source boundaries; open their normal resource pages for the full instructions. Existing resources and their verification status remain unchanged.

Related audit Prompts and Workflow
  • AMO-P-000362 challenges sampling and test design.
  • AMO-P-000363 reviews the resulting finding at its actual stage.
  • AMO-W-000044 coordinates extraction, human analysis, challenge and final review.

Use of these resources is subject to the Amo.ng Terms.

Template bundle · Markdown

GenAI and RAG Authorised Evaluation Sheets

Record test design, grounding and authorised defensive test observations with explicit boundaries.

Download template (.md): GenAI and RAG Authorised Evaluation Sheets

Read template preview: GenAI and RAG Authorised Evaluation Sheets

GenAI and RAG Authorised Evaluation Sheets

Track A and Track B · Neutral documentation bundle

Purpose

Separate test design, source grounding and defensive test observations with traceable inputs and explicit authority boundaries.

Intended user

AI assurance practitioner, knowledge owner and authorised evaluation/security reviewer.

When to use

When reviewing a GenAI/RAG evaluation or planning bounded synthetic tests; execution remains a separate authorised activity.

Included templates
  • GenAI/RAG test plan.
  • Hallucination and grounding test sheet.
  • Authorised prompt-injection/adversarial test sheet.
Shared evidence/provenance and human-review fields

Complete this cover once per working-paper record. Repeat only where the scope or reviewer changes. Local review rows should reference the shared decision ID when the same decision covers them; record only view-specific judgement or a different decision there, not duplicate names/dates. A role label alone may not identify the actual reviewer: use the responsible person or institution-controlled reviewer reference in the authorised record, without unnecessary personal data in provider inputs. Use source IDs in individual rows rather than copying the full evidence inventory. Blank is not a pass; use “not supplied”, “not performed”, “unclear”, or “not applicable — reason” accurately.

Field Definition / professional purpose Entry
Record ID and objective Local working-paper reference and the decision/question this record supports; not a newly assigned AMO ID —
System/process and period Exact unit, system baseline and period examined; bounds the conclusion —
Source register Evidence ID; permitted locator; version/date; source owner; date obtained; scope/access limitation. A cited document not inspected stays “not inspected” —
Preparer and work state Responsible preparer role; date; distinguish proposed, performed and supplied third-party work —
Reviewer decision Reviewer identity/reference and authority; date; exact record/version reviewed; decision ID and rationale; restrictions. Leave unrecorded until a person decides —
Unresolved matter / follow-up Missing or conflicting evidence; affected decision; next request/action; owner/date only if supplied —
Approved carry-forward Exact edited material authorised for the next activity, linked to review decision and remaining limitations; no automatic approval —

Suggested review states describe this document only: draft, awaiting evidence, returned for revision, held, or reviewed for the stated limited use. They do not change any application schema or establish an engagement conclusion. An action status is recorded separately from an evidence or reviewer status.

Field definitions and fillable templates

Each table is a blank working view. Duplicate a view or its item rows only for a distinct system, test, claim or event. Keep related evidence under stable IDs.

GenAI/RAG test plan
Field Definition / purpose Entry
Question and authority Bounded evaluation question, approving authority and allowed environment; missing authority blocks execution. —
Frozen baseline System/model, template, corpus/index and retrieval versions; unknown values remain unknown. —
Case and source IDs Query, intended audience/purpose, permitted source passages and source versions. —
Expected behaviour Source-grounded expected response, abstention/escalation where needed and basis for any threshold. —
Coverage and selection Normal, conflict, stale, unanswerable and entitlement cases only where relevant; limitations of selected cases. —
Run evidence and state Planned/not performed versus actual run ID/date, inputs/output locators and observations. —
Stop / escalation / review Safety stop conditions, owner, unresolved questions and reviewer judgement on reuse. —

Completion guidance: Use AMO-P-000242/AMO-W-000016 and the relevant AMO-W-000013 method. Do not silently replace the source baseline during testing or invent a complete representative query population.

Hallucination and grounding test sheet
Field Definition / purpose Entry
Query and answer claim Exact supplied query and atomic answer claim with answer locator. —
Retrieved / assembled source Source/version/passage, audience and whether actually present in context. —
Current authority and support Does the passage entail the claim and is it current/applicable/permitted? Record these separately. —
Failure location Source quality/freshness, retrieval, context assembly, generation, citation or abstention; unknown cause stays unknown. —
Actual versus expected Expected behaviour and its criterion/source separately from observed behaviour and locator; record deviation/exception, inconclusive result or not performed, with the reviewer rationale. —
Disposition and gap Supported within limits, unsupported, contradicted or inconclusive; next evidence/check. —
Human review and handoff Knowledge/audit reviewer decision and edited correction with unresolved limits. —

Completion guidance: A citation is not support by itself. Distinguish an answer accurately quoting an obsolete source from an answer inventing a promise. Do not assert a component cause without trace evidence.

Authorised prompt-injection/adversarial test sheet
Field Definition / purpose Entry
Authority and safe environment Written scope, allowed surface, synthetic-only data and reviewer; absent authority means do not run. —
Threat hypothesis and case ID Specific boundary to examine and harmless fixture reference; no embedded executable payload required. —
Expected protected behaviour Instruction/data separation, permitted tool/record boundary and expected refusal/containment. —
Procedure and stop condition Bounded authorised procedure, limits and stop/escalation trigger; no real secret extraction or external targeting. —
Observation points / result Context, tool/action, answer and downstream effect evidence; planned versus actual run and exact locators. —
Residual coverage and reviewer Untested variants, unexplained behaviour, remediation proposal and independent review needed. —

Completion guidance: CR-06 is a design-only example. Never mark it passed because the plan exists. A few authorised tests cannot establish universal injection resistance.

Distinguish the issue under review

Use these distinctions to describe evidence, not to infer a cause from the result alone:

  • Prompt injection: untrusted content attempts to redirect system instructions; a planned canary is not an observed successful attack.
  • Retrieval poisoning: source/index content has been improperly introduced or altered to influence retrieval/answers; an obsolete document alone does not prove poisoning or intent.
  • Unauthorised source access: a principal/purpose receives a source or context outside the applicable permission boundary; it can occur before a visible answer.
  • Hallucination or unsupported answer: a generated claim lacks adequate support; distinguish this from faithfully repeating a stale source.
  • Stale knowledge: retrieved content is superseded or not current for the question; establish dates and authority before attributing the cause.
  • Excessive tool permission: available action authority exceeds the intended scope; do not invent action tools in a read-only RAG system.
  • Insecure logging: recorded information, access or handling is inconsistent with the supplied requirements; missing logging evidence alone does not establish insecure logging.
  • Sensitive-data disclosure: information crossed an established disclosure boundary; specify what and to whom to the extent evidenced, without extrapolating exposure volume or inventing legal consequences.

Several issues may coexist. Record the observed stage, evidence and alternative explanations; do not force every issue into one “AI security” category.

Bundle completion guidance

Approve authority and source expectations before any test; use synthetic data by default. A reviewer may inspect supplied excerpts without running anything. Record planned checks and actual observations in separate fields. Preserve source versions, entitlements and unanswerable cases; do not optimise a test by deleting difficult cases.

Before carrying material forward, reconcile the question, criterion, source and actual observation. Preserve original evidence in the institution's authorised repository. Use only permitted excerpts in an AI surface; do not paste private credentials or unapproved identifiers. Local saving is not evidence custody or permission to disclose to a provider. A proposed test or a completed form cannot stand in for a recorded result.

The audit supervisor decides sufficiency and reliance; the specialist decides matters within their competence and authority. Management validates its own representations and owns corrective action. Management agreement is not the audit reviewer's independent closure decision. Carry-forward remains editable and requires explicit review.

Example completed synthetic excerpt
View Synthetic completed entry
GenAI/RAG test plan E-17 selected traces per CR-04; full query population absent; knowledge-owner confirmation of expected answers still required
Hallucination and grounding test sheet Q01 quotes K-RET v2 accurately, but CR-02 makes v3 current on 25 September; freshness/retrieval concern, not proof of an invented answer; Q03 promise lacks source support
Authorised prompt-injection/adversarial test sheet A01 per CR-06: harmless retrieved-document canary planned in an authorised synthetic sandbox; authority pending; actual result “not performed”

Q04's final refusal does not remove the context-entitlement issue. Reviewer next action is to obtain effective filtering/context evidence, not to declare a whole-system privacy failure or pass.

This is an illustrative entry from the bundled fictional case, not work performed on a real organisation. Review dates/decisions shown as proposed must not be represented as real sign-offs.

Limitations
  • No real offensive operation, provider call or production test is authorised by a filled sheet.
  • An unexecuted case is coverage planning, not evidence that a defence works.
  • Does not establish model certification, universal accuracy, security or privacy compliance.
  • This is a supplied-evidence review aid. It does not perform an audit, issue an audit opinion, establish control effectiveness, certify anything, determine legal compliance or grant professional approval. The authorised audit professional retains judgement and reliance decisions. Use only information permitted for the selected provider; local encrypted storage does not itself authorise provider disclosure.
Related Amo.ng resources

Prompts: AMO-P-000242 — RAG Retrieval and Citation Quality Evaluation Lab v1.0.0; AMO-P-000071 — Evidence-Grounded AI Output Verification and Release Gate v2.0.0

Workflows: AMO-W-000016 — Assess Enterprise Knowledge and RAG Readiness; AMO-W-000013 — Review Production AI Evaluation Reliability; AMO-W-000021 — Assure an AI System Change for Production Release

Skills: AMO-S-000007 — Diagnose RAG Grounding and Retrieval Failures; AMO-S-000012 — Assess AI Evaluation Evidence for Decision Use; AMO-S-000016 — Trace Consequential Claims to Original Evidence

These are complementary methods, not additional proof of the same claim. Read their current source boundaries; open their normal resource pages for the full instructions. Existing resources and their verification status remain unchanged.

Related audit Prompts and Workflow

Use of these resources is subject to the Amo.ng Terms.

Template bundle · Markdown

AI Vendor and Operational Control Review Workbook

Separate supplier claims, intended controls, effective behaviour and outstanding operational evidence.

Download template (.md): AI Vendor and Operational Control Review Workbook

Read template preview: AI Vendor and Operational Control Review Workbook

AI Vendor and Operational Control Review Workbook

Track A and Track B · Neutral documentation bundle

Purpose

Use linked sheets to distinguish supplier claims, intended controls, effective behaviour and outstanding evidence across the operating lifecycle.

Intended user

AI audit practitioner with procurement, access, operations, security and change owners supplying records; specialist decisions stay with authorised reviewers.

When to use

When a scoped question concerns vendor controls, permissions, oversight, monitoring, an incident or a system change. Complete only relevant modules.

Included templates
  • Vendor due-diligence questionnaire.
  • Agent permission and tool-access review.
  • Human override/control review.
  • AI monitoring review.
  • AI incident review.
  • AI change-management review.
Shared evidence/provenance and human-review fields

Complete this cover once per working-paper record. Repeat only where the scope or reviewer changes. Local review rows should reference the shared decision ID when the same decision covers them; record only view-specific judgement or a different decision there, not duplicate names/dates. A role label alone may not identify the actual reviewer: use the responsible person or institution-controlled reviewer reference in the authorised record, without unnecessary personal data in provider inputs. Use source IDs in individual rows rather than copying the full evidence inventory. Blank is not a pass; use “not supplied”, “not performed”, “unclear”, or “not applicable — reason” accurately.

Field Definition / professional purpose Entry
Record ID and objective Local working-paper reference and the decision/question this record supports; not a newly assigned AMO ID —
System/process and period Exact unit, system baseline and period examined; bounds the conclusion —
Source register Evidence ID; permitted locator; version/date; source owner; date obtained; scope/access limitation. A cited document not inspected stays “not inspected” —
Preparer and work state Responsible preparer role; date; distinguish proposed, performed and supplied third-party work —
Reviewer decision Reviewer identity/reference and authority; date; exact record/version reviewed; decision ID and rationale; restrictions. Leave unrecorded until a person decides —
Unresolved matter / follow-up Missing or conflicting evidence; affected decision; next request/action; owner/date only if supplied —
Approved carry-forward Exact edited material authorised for the next activity, linked to review decision and remaining limitations; no automatic approval —

Suggested review states describe this document only: draft, awaiting evidence, returned for revision, held, or reviewed for the stated limited use. They do not change any application schema or establish an engagement conclusion. An action status is recorded separately from an evidence or reviewer status.

Field definitions and fillable templates

Each table is a blank working view. Duplicate a view or its item rows only for a distinct system, test, claim or event. Keep related evidence under stable IDs.

Vendor due-diligence questionnaire
Field Definition / purpose Entry
Service and requirement Exact service/tier/use, data role and criterion source relevant to the decision. —
Question / vendor claim Specific question and attributable response; unanswered questions stay open. —
Current supporting evidence Contract/configuration/test reference, date, scope and applicability; capability statement separate from deployment. —
Data and dependency boundary Context sent, retention/training/access/deletion claims and supporting evidence; fallback/exit assumptions where material. —
Reviewer observation / gap What the reviewer actually inspected and observed, with locator; distinguish vendor assertion from documentary support, unresolved question and proposed restriction. —
Owner decision Procurement/data/security/legal decision where relevant, with limits; no automatic vendor approval. —

Completion guidance: Reuse AMO-W-000002; do not turn completed answers into approval or infer the current tier from generic marketing.

Agent permission and tool-access review
Field Definition / purpose Entry
Principal / resource / action Who or what can act on which record/tool and for what purpose/tenant/time. —
Declared boundary Applicable authorisation/policy and expected data/action restrictions. —
Effective evidence Configuration, context, trace or authorised test showing actual access; note absent evidence. —
Delegation / revocation Identity chain, privilege changes and expiry/withdrawal evidence where relevant. —
Difference and consequence Excess/missing access or uncertainty and the affected use; do not claim a test was run. —
Review and follow-up Owner action, authorised retest and reviewer restriction or decision. —

Completion guidance: For a RAG-only system, assess retrieval/context access without pretending it has autonomous action tools. An output refusal is not proof of source access enforcement.

Human override/control review
Field Definition / purpose Entry
Trigger and authorised operator When intervention is required and who can decide/act. —
Detection and decision evidence What the operator could see and when; authority and response constraints. —
Intervention / acknowledgement Requested action and receipt, with timestamps/source IDs. —
Downstream effect Evidence generation/action actually stopped or was contained; distinguish receipt from effect. —
Recovery and residual exposure What remained queued/delivered and who may resume; unknowns stay open. —
Reviewer conclusion Bounded conclusion, unperformed checks and further containment evidence needed. —

Completion guidance: Trace detection → authority → action → effect → recovery. A visible button or acknowledgement alone cannot complete the effect field.

AI monitoring review
Field Definition / purpose Entry
Purpose / signal / baseline What risk a signal detects, exact system/population and comparison baseline. —
Definition and coverage Numerator/denominator, slices, collection process and missing/duplicate records; where logging supports the claim, record joinable request/baseline IDs, timestamp basis and evidence-access limits without copying unnecessary payloads. —
Threshold and authority Supplied trigger/rationale and decision owner; missing thresholds are not invented. —
Actual observation and response Observed period/value, alert, triage and action evidence separately. —
Drift / limits / feedback Changed source/model/population, comparability limits and whether feedback enters evaluation. —
Reviewer and next check Supported monitoring claim, gap, accountable action and review decision. —

Completion guidance: Reuse AMO-W-000013/AMO-W-000016/AMO-W-000021 components. Satisfaction, drift and factual correctness are different constructs; a dashboard label is not a tested control.

AI incident review
Field Definition / purpose Entry
Event identity / evidence type Actual incident, reported event, near miss or exercise; maintain distinction. —
Chronology and scope Attributable timestamps, affected boundary/records and unknown extent. —
Assertions versus observations Who reported what and the evidence actually available. —
Containment / preservation Actions supported by records, authority and evidence preserved; proposed actions separate. —
Cause hypotheses / recovery Plausible explanations versus corroborated cause; authorised recovery conditions. —
Escalation / notifications Supplied process and responsible specialist decisions; no invented legal duty or completed notification. —
Open matters and review Outstanding scope/testing/evidence and human review of the bounded incident record. —

Completion guidance: An exercise result is not production incident evidence. Do not delete logs, contact third parties or investigate beyond authority because a worksheet suggests a question.

AI change-management review
Field Definition / purpose Entry
Change and approved baseline Purpose, source/model/template/data/permission delta and intended baseline. —
Effective state evidence Actual deployed/corpus/configuration identity and comparison; no access means not inspected. —
Acceptance and test evidence Source-based criteria, relevant positive/negative cases, actual results and exclusions. —
Release authority and separation Who may approve/release, recorded decisions and any conflicts. —
Rollback / fallback Plan, dependency/semantic limits and actual exercise evidence if supplied. —
Post-change monitoring / retest Operating period, regression/entitlement results and unresolved consequences. —
Reviewer disposition Scoped readiness or hold recommendation with decision owner; ticket closure is not effectiveness. —

Completion guidance: Reuse AMO-W-000021 and its existing exact sources. Preserve current/previous baseline differences; no plan, ticket or resource title authorises production release.

Bundle completion guidance

Choose modules by the objective; share evidence IDs across them. Keep supplier statements, written design, actual configuration and observed results in separate cells. Use specialist sign-off only when actually obtained. For relevant logs, examine supplied access, integrity, minimisation and retention requirements and actual evidence; absent evidence is not proof that logging is insecure. Do not prescribe a retention duration. Apply the organisation's approved retention and privacy requirements. A fallback provider requires its own capability/data-boundary evidence, not an assumed equivalent.

Before carrying material forward, reconcile the question, criterion, source and actual observation. Preserve original evidence in the institution's authorised repository. Use only permitted excerpts in an AI surface; do not paste private credentials or unapproved identifiers. Local saving is not evidence custody or permission to disclose to a provider. A proposed test or a completed form cannot stand in for a recorded result.

The audit supervisor decides sufficiency and reliance; the specialist decides matters within their competence and authority. Management validates its own representations and owns corrective action. Management agreement is not the audit reviewer's independent closure decision. Carry-forward remains editable and requires explicit review.

Example completed synthetic excerpt
Module Synthetic completed entry
Vendor CR-08 describes training-use/filter capabilities; applicable tier, terms and retention evidence absent; no approval concluded
Permission CR-03 prohibits staff context for PUBLIC; CR-05 Q04 includes K-OPS v1 in public context; wider extent unknown
Override CR-07 acknowledgement 10:07:02 and answer marker 10:07:05; delivery/buffering unknown; containment not established
Monitoring CR-09: 19/20 voluntary ratings helpful; total answers unknown; cannot infer 95% accuracy
Incident CR-11 remains awaiting evidence; no actual personal-data record supplied; preserve scope uncertainty
Change CR-10 claims index updated 26 September; CR-04 still names 24 September C-17; effective state needs reconciliation

Evidence obtained date in the case: 7 October. Proposed reviewer decision: hold the affected control claims pending specific evidence; no actual system change, notification or closure is performed.

This is an illustrative entry from the bundled fictional case, not work performed on a real organisation. Review dates/decisions shown as proposed must not be represented as real sign-offs.

Limitations
  • Does not supply a complete sector programme, infrastructure inspection or legal determination.
  • Modules must not turn vendor or management assertions into independent operational evidence.
  • Authorised real tests and source records are required for conclusions about actual systems.
  • This is a supplied-evidence review aid. It does not perform an audit, issue an audit opinion, establish control effectiveness, certify anything, determine legal compliance or grant professional approval. The authorised audit professional retains judgement and reliance decisions. Use only information permitted for the selected provider; local encrypted storage does not itself authorise provider disclosure.
Related Amo.ng resources

Prompts: AMO-P-000074 — Evidence-Grounded Shadow AI Risk Assessment and Governance Plan v2.0.0; AMO-P-000242 — RAG Retrieval and Citation Quality Evaluation Lab v1.0.0; AMO-P-000071 — Evidence-Grounded AI Output Verification and Release Gate v2.0.0

Workflows: AMO-W-000002 — Vendor Procurement Due Diligence; AMO-W-000013 — Review Production AI Evaluation Reliability; AMO-W-000016 — Assess Enterprise Knowledge and RAG Readiness; AMO-W-000021 — Assure an AI System Change for Production Release

Skills: AMO-S-000007 — Diagnose RAG Grounding and Retrieval Failures; AMO-S-000012 — Assess AI Evaluation Evidence for Decision Use; AMO-S-000016 — Trace Consequential Claims to Original Evidence

These are complementary methods, not additional proof of the same claim. Read their current source boundaries; open their normal resource pages for the full instructions. Existing resources and their verification status remain unchanged.

Related audit Prompts and Workflow

Use of these resources is subject to the Amo.ng Terms.

Template bundle · Markdown

Audit Findings, Responses and Closure Register

Trace a finding through management response and closure review while retaining unresolved matters.

Download template (.md): Audit Findings, Responses and Closure Register

Read template preview: Audit Findings, Responses and Closure Register

Audit Findings, Responses and Closure Register

Track A and Track B · Neutral documentation bundle

Purpose

Maintain one traceable record per finding from draft through management response and independent closure review, preserving disputed facts and residual matters.

Intended user

Audit practitioner and authorised audit reviewer; management supplies responses, owns actions and requests closure.

When to use

When a finding is drafted, a response is received, an action changes or closure evidence is submitted. Stage-specific empty fields are allowed and explained.

Included templates
  • Finding, response, action and closure record.
Shared evidence/provenance and human-review fields

Complete this cover once per working-paper record. Repeat only where the scope or reviewer changes. Local review rows should reference the shared decision ID when the same decision covers them; record only view-specific judgement or a different decision there, not duplicate names/dates. A role label alone may not identify the actual reviewer: use the responsible person or institution-controlled reviewer reference in the authorised record, without unnecessary personal data in provider inputs. Use source IDs in individual rows rather than copying the full evidence inventory. Blank is not a pass; use “not supplied”, “not performed”, “unclear”, or “not applicable — reason” accurately.

Field Definition / professional purpose Entry
Record ID and objective Local working-paper reference and the decision/question this record supports; not a newly assigned AMO ID —
System/process and period Exact unit, system baseline and period examined; bounds the conclusion —
Source register Evidence ID; permitted locator; version/date; source owner; date obtained; scope/access limitation. A cited document not inspected stays “not inspected” —
Preparer and work state Responsible preparer role; date; distinguish proposed, performed and supplied third-party work —
Reviewer decision Reviewer identity/reference and authority; date; exact record/version reviewed; decision ID and rationale; restrictions. Leave unrecorded until a person decides —
Unresolved matter / follow-up Missing or conflicting evidence; affected decision; next request/action; owner/date only if supplied —
Approved carry-forward Exact edited material authorised for the next activity, linked to review decision and remaining limitations; no automatic approval —

Suggested review states describe this document only: draft, awaiting evidence, returned for revision, held, or reviewed for the stated limited use. They do not change any application schema or establish an engagement conclusion. An action status is recorded separately from an evidence or reviewer status.

Field definitions and fillable templates

Each table is a blank working view. Duplicate a view or its item rows only for a distinct system, test, claim or event. Keep related evidence under stable IDs.

Finding, response, action and closure record
Field Definition / purpose Entry
Finding ID / stage / scope Local issue ID, current stage and relevant process/period; no premature closure label. —
Criterion / condition Applicable source requirement and actual supplied observation, each with locator; missing criterion stays missing. —
Cause / effect or risk Corroborated cause/actual impact separate from hypotheses/potential consequences. —
Evidence / disagreement / limit Source IDs, contradictory evidence, management disagreement and scope/inference limits. —
Recommendation and response Auditor suggestion separate from exact management position and rationale. —
Action / owner / due date Specific management commitment, accountable owner authority, dependency and agreed date only if supplied. —
Completion assertion / evidence Reported action completion separate from implementation and subsequent operation evidence. —
Closure criteria / retest Supplied criteria and proportionate validation under the audit method (inspection, re-performance, follow-up test or other stated method); actual result or evidence unavailable/not performed as appropriate. —
Reviewer decision / residual matter Authorised decision with date and rationale, remaining risks/actions and any separate risk-acceptance record. —

Completion guidance: Use AMO-P-000363 at the applicable stage; do not populate future response/closure fields with invented commitments. Management may validate facts but does not approve the audit reviewer's conclusion. Closure needs a reasoned decision, not an automatic status change.

Bundle completion guidance

Keep the same finding reference through revisions. Record what changed and retain the earlier disputed statement by reference. Reporting extracts should carry scope, criterion, evidence limitation and unresolved matter. A due date passing, a reminder or a management completion statement does not close the issue. Record remediation evidenced, residual risk accepted by the authorised risk owner, and administrative closure as separate matters. A risk-acceptance or administrative decision is not a finding that remediation worked; retain its authority, rationale and open consequences. No universal retest or closure rule is invented by this form.

Before carrying material forward, reconcile the question, criterion, source and actual observation. Preserve original evidence in the institution's authorised repository. Use only permitted excerpts in an AI surface; do not paste private credentials or unapproved identifiers. Local saving is not evidence custody or permission to disclose to a provider. A proposed test or a completed form cannot stand in for a recorded result.

The audit supervisor decides sufficiency and reliance; the specialist decides matters within their competence and authority. Management validates its own representations and owns corrective action. Management agreement is not the audit reviewer's independent closure decision. Carry-forward remains editable and requires explicit review.

Example completed synthetic excerpt

Finding CA-F1 (synthetic local reference), stage response/closure challenge. Criterion: CA-04 clause 2. Condition: CA-06 AC-09 shows approval later than issue, with exception record unavailable. Cause: not established. Effect: no actual harm evidenced; risk of unauthorised release remains a hypothesis for review. Response: CA-08 says reminder sent and requests closure. Owner: process owner offers coordination; precise commitment/due date absent. Closure/retest: no retest supplied. Decision: CA-09 does not approve closure. Carry-forward: obtain exception and subsequent-operation evidence; retain limited observation and unknown extent.

This is an illustrative entry from the bundled fictional case, not work performed on a real organisation. Review dates/decisions shown as proposed must not be represented as real sign-offs.

Limitations
  • Not a shared action-management system or automatic reminder tool.
  • Risk acceptance, reporting and closure require authorised human decisions under the applicable methodology.
  • A completed action can leave the original risk or evidence gap unresolved.
  • This is a supplied-evidence review aid. It does not perform an audit, issue an audit opinion, establish control effectiveness, certify anything, determine legal compliance or grant professional approval. The authorised audit professional retains judgement and reliance decisions. Use only information permitted for the selected provider; local encrypted storage does not itself authorise provider disclosure.
Related Amo.ng resources

Prompts: AMO-P-000194 — Internal SOP Gap and Control Mapping Brief v1.0.0; AMO-P-000071 — Evidence-Grounded AI Output Verification and Release Gate v2.0.0

Workflows: AMO-W-000021 — Assure an AI System Change for Production Release

Skills: AMO-S-000016 — Trace Consequential Claims to Original Evidence

These are complementary methods, not additional proof of the same claim. Read their current source boundaries; open their normal resource pages for the full instructions. Existing resources and their verification status remain unchanged.

Related audit Prompts and Workflow
  • AMO-P-000363 is the bounded challenge method.
  • AMO-W-000044 carries only human-reviewed wording into the final working paper.

Use of these resources is subject to the Amo.ng Terms.

Template bundle · Markdown

Auditor AI-Use Working-Paper Record and Declaration

Record permitted and actual AI assistance, source checks, edits and accountable reliance.

Download template (.md): Auditor AI-Use Working-Paper Record and Declaration

Read template preview: Auditor AI-Use Working-Paper Record and Declaration

Auditor AI-Use Working-Paper Record and Declaration

Track A and Track B · Neutral documentation bundle

Purpose

Document permitted and actual AI assistance, source checking, edits and accountable reliance without retaining unnecessary confidential transcripts.

Intended user

Auditor using an assistant, engagement supervisor and data/provider approval owner where relevant.

When to use

Before intended AI use and after any actual contribution to working material; revise when purpose, data or provider scope changes.

Included templates
  • AI-use working-paper disclosure.
  • Responsible-AI-use declaration for auditors.
Shared evidence/provenance and human-review fields

Complete this cover once per working-paper record. Repeat only where the scope or reviewer changes. Local review rows should reference the shared decision ID when the same decision covers them; record only view-specific judgement or a different decision there, not duplicate names/dates. A role label alone may not identify the actual reviewer: use the responsible person or institution-controlled reviewer reference in the authorised record, without unnecessary personal data in provider inputs. Use source IDs in individual rows rather than copying the full evidence inventory. Blank is not a pass; use “not supplied”, “not performed”, “unclear”, or “not applicable — reason” accurately.

Field Definition / professional purpose Entry
Record ID and objective Local working-paper reference and the decision/question this record supports; not a newly assigned AMO ID —
System/process and period Exact unit, system baseline and period examined; bounds the conclusion —
Source register Evidence ID; permitted locator; version/date; source owner; date obtained; scope/access limitation. A cited document not inspected stays “not inspected” —
Preparer and work state Responsible preparer role; date; distinguish proposed, performed and supplied third-party work —
Reviewer decision Reviewer identity/reference and authority; date; exact record/version reviewed; decision ID and rationale; restrictions. Leave unrecorded until a person decides —
Unresolved matter / follow-up Missing or conflicting evidence; affected decision; next request/action; owner/date only if supplied —
Approved carry-forward Exact edited material authorised for the next activity, linked to review decision and remaining limitations; no automatic approval —

Suggested review states describe this document only: draft, awaiting evidence, returned for revision, held, or reviewed for the stated limited use. They do not change any application schema or establish an engagement conclusion. An action status is recorded separately from an evidence or reviewer status.

Field definitions and fillable templates

Each table is a blank working view. Duplicate a view or its item rows only for a distinct system, test, claim or event. Keep related evidence under stable IDs.

AI-use working-paper disclosure
Field Definition / purpose Entry
Activity / working-paper link Bounded task and record/claim location that AI assisted, not a statement that it performed the audit. —
Actual tool / model / date Provider, tool, model/version and execution date where known; no keys; no fabricated values for historic work. —
Source identity / permitted inputs Prompt/Workflow ID and exact Prompt version where used; approved data categories and evidence IDs rather than unnecessary raw text. —
AI contribution and provenance What was generated, what was manually entered and what came from an external tool; distinguish a supplied simulation from actual generation. —
Human checks / edits / rejections Actual checks and source locators, material changes, rejected claims and work not performed. —
Reliance / reviewer / limits Who accepted what for which purpose, when, and what remains blocked. —
Retention / export handling Institution-controlled record location and governing retention/privacy decision reference; no prescribed duration. Full/redacted exports and derived copies require review under the same approved requirements. —

Completion guidance: If no provider was used, write “none — supplied synthetic draft reviewed” rather than inventing a model or call time. A Run Record is optional activity documentation, not independent audit evidence.

Responsible-AI-use declaration for auditors
Field Definition / purpose Entry
Purpose / authority Intended assistance, governing policy/engagement reference and scope of permission. —
Competence / independence Auditor's ability to review the output and any conflict or specialist-review dependency. —
Permitted data / minimisation Input categories permitted, information withheld and unresolved data-owner questions. —
Provider / surface boundary Permitted tool/workspace and transfer/storage restrictions with actual supporting decision reference. —
Responsibility statement Auditor retains professional judgement; no delegated conclusion, invented testing or automatic closure. —
Stop / escalation conditions Missing permission, unexpected sensitive content, unavailable sources or unsupported capability; responsible function if supplied. —
Actual declaration and review Person/role, date and exact commitments actually made; outstanding decisions stay pending. —

Completion guidance: This is an accountable-use record, not a certification form. Do not pre-sign it for another person. Permission must exist before restricted input is sent; a declaration cannot create that permission. Disclosure records involvement but does not make the work acceptable: source verification, competence, permitted use and actual professional review remain separate requirements.

Bundle completion guidance

Record intended use first; actual execution and review belong in the disclosure after they occur. Separate the provider-generated material from the authoritative source evidence. Use existing AMO-P-000155/AMO-P-000149 methods as references, with manual/external handling where the current surface cannot execute their tool label. An unavailable model/version is recorded as unknown, not inferred from a current UI.

Before carrying material forward, reconcile the question, criterion, source and actual observation. Preserve original evidence in the institution's authorised repository. Use only permitted excerpts in an AI surface; do not paste private credentials or unapproved identifiers. Local saving is not evidence custody or permission to disclose to a provider. A proposed test or a completed form cannot stand in for a recorded result.

The audit supervisor decides sufficiency and reliance; the specialist decides matters within their competence and authority. Management validates its own representations and owns corrective action. Management agreement is not the audit reviewer's independent closure decision. Carry-forward remains editable and requires explicit review.

Example completed synthetic excerpt

Responsible-AI-use declaration for auditors proposed use: review synthetic CA records only; confidential extracts held per CA-02/CA-09; provider permissions not inferred from CA-03. AI-use working-paper disclosure hypothetical learner entry, to use only if true for that learner: “No provider used in this exercise; supplied synthetic draft CA-07 reviewed manually; provider/model/execution time not applicable.” This is not a statement about how the Pack was authored. If the learner actually uses an assistant, record that involvement and its known tool/model/date instead. Proposed learner check: compare the five-item claim with CA-05/CA-06 and record corrections after performing that review. No real reviewer signature or reliance decision has been entered. CA-10's local draft retention remains a separate unresolved records matter.

This is an illustrative entry from the bundled fictional case, not work performed on a real organisation. Review dates/decisions shown as proposed must not be represented as real sign-offs.

Limitations
  • Does not authorise confidential processing, resolve provider retention or replace institutional retention/custody rules.
  • Redacted exports still require inspection; redaction does not guarantee anonymity.
  • An AI-use declaration is not compliance certification or professional approval.
  • This is a supplied-evidence review aid. It does not perform an audit, issue an audit opinion, establish control effectiveness, certify anything, determine legal compliance or grant professional approval. The authorised audit professional retains judgement and reliance decisions. Use only information permitted for the selected provider; local encrypted storage does not itself authorise provider disclosure.
Related Amo.ng resources

Prompts: AMO-P-000155 — Sensitive Data Handling Checklist for AI Workflows v2.0.1; AMO-P-000149 — Team AI Usage SOP and Review Loop v1.0.1; AMO-P-000071 — Evidence-Grounded AI Output Verification and Release Gate v2.0.0

Workflows: AMO-W-000002 — Vendor Procurement Due Diligence

Skills: AMO-S-000016 — Trace Consequential Claims to Original Evidence

These are complementary methods, not additional proof of the same claim. Read their current source boundaries; open their normal resource pages for the full instructions. Existing resources and their verification status remain unchanged.

Related audit Prompts and Workflow

Use of these resources is subject to the Amo.ng Terms.

Practice Cases

Practise with fictional evidence, then learn from real events through authoritative-source summaries. Synthetic cases leave room for judgement under uncertainty; real case studies examine documented controls, decisions and professional lessons.

Synthetic practice cases

Synthetic cases are fictional scenarios designed for practice. They are not real organisations, audit findings or assurance engagements.

These learner editions exclude facilitator answers. For a blind exercise, start with the case before opening worked examples in the template bundles. Reading supplied traces does not perform a test; more than one professionally defensible answer may be possible.

Synthetic practice case · Learner edition · Markdown

Internal Audit Team Using Generative AI

Practise scope, sampling, confidential-data handling and review of a simulated AI working paper.

Download learner case (.md): Internal Audit Team Using Generative AI

Read learner case: Internal Audit Team Using Generative AI

Internal Audit Team Using Generative AI

Synthetic practice case — learner evidence. Track A, with Track B provider-control context.

Every organisation, role, system, record, quotation, event and date below is fictional. “Case Organisation Aster-17” is a training label, not a statement about an existing organisation. The simulated AI draft was authored for this case; no provider generated it and no test was performed against a real system. No professional qualification or assurance result follows from completing the exercise.

A. Case narrative

Case Organisation Aster-17 coordinates equipment loans between fictional community facilities. Its internal-audit function has an engagement lead, an audit practitioner and an engagement supervisor. Management owns equipment-release controls. The audit team is considering limited AI assistance to review planning text, extract evidence rows and challenge a draft working paper. It may not delegate audit conclusions or source verification to AI.

The proposed engagement covers equipment-release authorisations during September 2026. The plan seeks to assess whether the stated approval requirement was met. The plan also contains the sentence “all release controls are effective” as a proposed reporting aim. Only a selected extract and three record packets have been made available. The practitioner proposes a five-item judgemental selection, then describes it as statistically representative without a statistical method.

The organisation permits public or synthetic inputs in a designated provider workspace, identified only as fictional Provider Service Q / Workspace A. Use of confidential audit extracts requires a data-owner decision and a current provider/storage review. These records are incomplete. The case supplies role identifiers and metadata only; it does not supply a real provider contract, account, key or audit file.

On 2 October a practitioner prepared a confidential excerpt for an AI review. A colleague stopped the submission before it was sent. A local draft containing unnecessary interview detail remained on a device; deletion and retention treatment were not recorded. Management calls this “no incident because nothing was sent”. The records available to the learner are listed below.

On 5 October the supervisor receives a simulated AI working-paper draft and a management response requesting closure after a reminder. The supervisor must decide what work is supportable, what must be held and what the professional reviewer still needs. The exercise ends at an evidence-based handoff, not an audit opinion or actual closure.

Intended use and prerequisites

Intended users are audit practitioners and supervisors familiar with evidence attribution and scope limits. Use the case for planning review (AMO-P-000361), design review (AMO-P-000362), evidence extraction (AMO-P-000045), finding/closure challenge (AMO-P-000363), output review (AMO-P-000071), AMO-W-000044 and scope workbook/control-and-evidence working paper/findings register/AI-use record. Reading the supplied records is sufficient; AI execution is optional and separately subject to provider permission and cost.

Use the supplied record excerpts for the learner review. Further records not included in this case remain unavailable; facilitators must not invent them in response to requests.

B. Evidence inventory

All records below were supplied in the fictional case bundle on 7 October 2026. Owner means the fictional source custodian, not an independent verifier. A locator is a section or row in this case; originals would belong in an authorised institutional repository in real work.

Evidence ID Record / source owner Date or version Locator What is supplied / limit
CA-01 Engagement planning memo / engagement lead 28 September, draft 0.3 C1 Draft scope and objective; signed engagement authorisation absent
CA-02 AI-use instruction / policy custodian 15 September, v1 C2 Fictional approved-use rule; not proof of actual workspace settings
CA-03 Provider/settings review note / workspace administrator 20 September C3 Partial account-tier evidence and assertions; no complete contract/settings export
CA-04 Control requirement and proposed test / process owner and practitioner Requirement v2, effective 1 September; design 29 September C4 Timing criterion and unapproved test design; no live test results
CA-05 Population extract cover and rows / process records custodian 1 October extract, September scope claimed C5 Four rows, one repeated ID; completeness not reconciled
CA-06 Selected evidence packets / process records custodian Supplied 3 October C6 Three packet extracts; no complete population or five-item test
CA-07 Simulated AI working-paper draft / exercise author Labelled 5 October, draft A C7 Simulated generated-style text under review; not underlying source evidence
CA-08 Management response / process owner 6 October C8 Action reported complete and closure requested; no independent retest
CA-09 Supervisor review note / engagement supervisor 7 October C9 Limited review decisions and outstanding requests
CA-10 Stopped-submission and handling note / practitioner and colleague 2 October, addendum 6 October C10 Near-miss account; downstream handling not fully evidenced
Chronology

The September criterion precedes the proposed review. The 1 October extract purports to cover September but is incomplete. October reminders cannot retrospectively establish September authorisation. The 7 October supervisor note is later than the response and does not accept closure.

C. Sample evidence excerpts
C1 — CA-01: engagement planning memo

Purpose: examine whether equipment releases in September followed the prior-authorisation requirement in Control Record v2. Scope: the central release queue. Regional releases, emergency releases and amendments are excluded. The reason for excluding amendments is not recorded. Expected evidence: release register and approval record for selected items. The lead expects a completed working paper within four working days. Data access remains limited to extracts supplied by the process owner.

Draft reporting sentence: “This review will assure management that all release controls are effective.”

Supervisor authorisation: pending. Specialist support and independence/conflict declaration: not included in this memo.

The case provides no organisation-wide mandate or risk-rating framework. Do not invent either. Both statements are retained as supplied.

C2 — CA-02: fictional AI-use instruction

Only public or synthetic material may enter Workspace A without a separate data-owner decision. Confidential working papers and interview content require an explicit permitted-data decision and a current workspace/provider review before submission. No credentials may be included. The practitioner must minimise inputs and record the purpose, tool/model where known, source references, output use, checks, changes and reviewer decision. Source evidence remains in the audit repository. The supervisor approves reliance; the provider cannot approve audit work.

The audit repository's retention schedule governs final working papers. Local drafts must be handled under the supplied records procedure. If that procedure or provider retention evidence is missing, obtain the responsible records/privacy decision before relying on deletion or confidentiality claims.

This is a fictional policy, not a legal retention rule or an instruction to use a real provider.

C3 — CA-03: provider and settings note

Workspace administrator: “Workspace A is the paid team tier. A supplier overview says business material is not used for training. I believe conversation deletion removes it immediately.”

Attachment described: cropped image of a training-use toggle dated 20 September. The crop has no workspace identifier. The applicable contract schedule, retention exceptions, subprocessor record, region, user access listing and deletion confirmation are not attached. Model/version used for previous experiments: not recorded.

No real supplier is identified and no real setting was inspected in this exercise.

C4 — CA-04: control requirement and proposed design

Fictional Control Record v2, clause 2: “A designated approver must record approval before an equipment release is issued. An emergency release follows the separate exception procedure and must remain identifiable.” The exception procedure is not in this case bundle.

Proposed test, not performed: examine release timestamp, approval identity, approval timestamp and supporting record for five judgementally selected September items: AC-04, AC-09, AC-17, AC-31 and AC-38. These IDs were proposed by the process owner. The practitioner wrote: “Five records gives statistical confidence over the 40 releases.” No confidence level, statistical method, tolerable deviation or completeness reconciliation was supplied. Replacement of unavailable records is not described. The conclusion criterion reads only “approval present”; it does not explicitly test prior timing.

No sample size in this case is a recommended audit threshold. A learner must challenge the proposed rationale rather than calculate an invented statistical answer.

C5 — CA-05: population extract

Cover note: “There were 40 central releases in September. The extract below is the population for review.” The query, reconciliation, total register and amendment history are absent.

Extract row Release ID Issue timestamp Approval field in extract Source note
1 AC-04 8 September 10:30 Approval entry referenced Packet supplied in CA-06
2 AC-09 12 September 09:00 Approval entry referenced Packet supplied in CA-06
3 AC-17 19 September 15:00 Screenshot referenced Packet supplied in CA-06
4 AC-17 19 September 15:00 Screenshot referenced Repeated ID and timestamp; reason not supplied

The four rows above are the entire supplied extract. No additional AC-31 or AC-38 packet is included in the evidence set.

C6 — CA-06: selected packets
  • Packet AC-04, sections 1–2: issue 8 September 10:30; designated approver role A-Approver-1 recorded approval at 10:10. The role-authorisation register is not attached.
  • Packet AC-09, sections 1–2: issue 12 September 09:00; approval recorded 12 September 11:00. No emergency-exception reference appears. The complete exception record is unavailable.
  • Packet AC-17, section 1: image text says “approval granted”. No approver identifier or timestamp is visible in the crop. Full image and underlying record absent.

These are supplied synthetic observations, not tests performed by the learner. “No exception reference visible” is not proof that no exception record exists anywhere.

C7 — CA-07: simulated AI draft to challenge

“All five sampled releases were appropriately authorised. The sample was statistically representative of the 40-item population. CA-06 shows the control operated effectively across September. The single timing difference was caused by staff oversight, with no operational impact. The workspace deletes all prompts immediately. No sensitive information was exposed. The team can close the finding after a reminder.”

This text is authored training material, not the output of an actual provider call. It is the draft under review, separate from the underlying source records.

C8 — CA-08: management response

Process owner: “A reminder was sent on 6 October and the team now understands the requirement. Mark the action complete and close the finding. I will coordinate any further action.”

The reminder text, delivery evidence, subsequent releases, committed retest date and specific ownership acceptance for a sustained control change are not supplied. The response is reproduced as supplied.

C9 — CA-09: supervisor review note — not supplied in this learner edition

This supplied source record is reserved for the facilitator's second-stage release. Learners should first record their own analysis of CA-01–CA-08 and CA-10. Before release, describe CA-09 as “not yet supplied to the learner”; do not infer its contents or cite it as inspected. The full excerpt is not included in this learner edition.

C10 — CA-10: stopped submission and working-paper handling

Practitioner account: “I prepared an input containing an internal interview paragraph in a local draft on 2 October. A colleague stopped me before submission. I removed the paragraph from the input preview.”

Colleague account: “I saw the input preview before the submit action and asked the practitioner to stop. I did not inspect provider history, other sessions or local file retention.”

6 October addendum: “The local draft remains on the device pending a records decision. No review of alternate submission paths is recorded. No actual provider-output record for this draft is supplied.”

No raw interview material is supplied. Do not delete or alter evidence to resolve the uncertainty. A real event would require the organisation's authorised handling and incident process; this case does not determine a notification duty.

D. Attributed assertions for review
Maker Statement or representation Source
Engagement lead Proposed all-controls reporting aim CA-01
Process records custodian 40 central September releases CA-05 cover
Workspace administrator Belief that deletion removes conversations immediately CA-03
Simulated AI draft (not management) Five authorised records, statistical representativeness and effectiveness claims CA-07
Process owner Reminder sent; request to close CA-08
Practitioner and colleague Accounts of a stopped submission and what each observed CA-10

Assess each against its source and other supplied material. Do not attribute an AI claim to management or fill gaps in a person's account.

F. Learner/auditor tasks
  1. Record the intended AI use, relevant authority, permitted information and any pending decision in AI-use record. Do not submit real restricted material.
  2. Use scope workbook/AMO-P-000361 to review CA-01 against the supplied authority, criteria and evidence. Record supported planning facts, assumptions, gaps and suggested revisions separately.
  3. Use AMO-P-000362/control-and-evidence working paper to assess CA-04/CA-05 without selecting a new sample or inventing quantitative parameters. Identify the inference the stated method could and could not support.
  4. Use AMO-P-000045 to extract permitted evidence rows from CA-06 with exact locators. Record human characterisation review before preparing bounded analysis.
  5. Review CA-07 and CA-08 with AMO-P-000363/findings register and AMO-P-000071. For each consequential statement, record source support, contradiction or uncertainty and the remaining professional decision.
  6. Record the actual hypothetical review decision, edited carry-forward and unresolved matters in AMO-W-000044. Do not invent a reviewer signature or a test result.
  7. Disclose any actual assistant use in the learner exercise separately from the supplied simulated draft. If no provider was used, record that accurately.
J. Professional judgement and limitations

There may be more than one professionally defensible answer. The reviewer should judge traceability, proportionality, uncertainty and appropriate next steps. This case supplies no statistical sampling recommendation, legal determination, professional approval, independent verification or audit opinion. A completed exercise, template or Run Record does not establish competence or control effectiveness.

Related Amo.ng resources
Facilitator material

Reviewer interpretations, expected issues and intentional ambiguities are kept in a separate facilitator companion. For a blind learner assessment, use this learner edition before consulting worked examples in the template bundles. Supplied source assertions remain available for critical review; this file does not supply their answer key.

Use of these resources is subject to the Amo.ng Terms.

Synthetic practice case · Learner edition · Markdown

RAG Customer-Support Assistant

Practise reviewing fictional retrieval traces, source freshness, access, escalation and change evidence.

Download learner case (.md): RAG Customer-Support Assistant

Read learner case: RAG Customer-Support Assistant

RAG Customer-Support Assistant

Synthetic practice case — learner evidence. Track B.

Every entity, role, product, system, trace, quotation, date and incident is fictional. “Case Organisation Lumen-24” is a training label, not a real-company claim. All output and trace excerpts were authored for this exercise. They are not results from a real model, provider, penetration test or production environment. No credentials or real customer records are included.

A. Case narrative

Case Organisation Lumen-24 provides fictional activity kits. Its support assistant, Guide-L, answers public questions about kit use and support policy using a small retrieval corpus. It can display an escalation route but is not authorised to approve refunds, change orders, send messages or access a user's account. Human support retains decisions.

The system has a public help interface and a staff reference interface. Public requests should retrieve only public, current documents. Staff-only material should never enter public generation context, even when the final answer does not quote it. A fictional hosted language service, Model Service V, receives assembled context; a separate fictional index service, Index Service R, supplies passages. No particular real provider or model is represented.

A support policy changed on 25 September. The index snapshot used in the supplied evaluation is from 24 September, while management says the update was deployed on 26 September. The change ticket closes without entitlement-regression or full reindex evidence. Four selected trace extracts and related records are supplied. Their selection basis and population coverage are not recorded.

The system owner says fluent answers and high user ratings show it is reliable. The auditor's bounded question is whether the supplied evidence supports the claimed source, access, escalation and change controls for the stated use. The auditor must separate proposed test coverage from observed case records and identify what remains unknown.

Non-sensitive architecture summary

Public/staff interface → identity and purpose context → retrieval filter → index passage selection → context assembly → hosted generation → citation/abstention checks → answer or escalation display.

Supporting records: knowledge-source register; entitlement policy; change record; trace store; human review queue. The architecture has no account-modification or outbound messaging tool. No additional action interface is described in the supplied architecture.

Intended use

Use for source/evaluation review, not live security testing. scope workbook/control-and-evidence working paper frame scope and evidence; GenAI/RAG evaluation sheets records test and grounding analysis; vendor/operational workbook records vendor/permission/monitoring/change review; findings register/AMO-P-000363 challenge a finding/response. Reuse AMO-P-000242/AMO-S-000007, AMO-W-000016, AMO-W-000013/AMO-S-000012 and AMO-W-000021. Learners need access-control, version and claim-evidence literacy; specialists remain necessary for wider security or privacy conclusions.

B. Evidence inventory

Fictional retrieval date: 7 October 2026. Dates below identify the supplied source/version, not learner execution. Owners are role labels. Detailed locators are sections C1–C12.

Evidence ID Source / owner Date or version Locator Limit
CR-01 Use and escalation policy / support owner 20 September, v2 C1 Defines intended use; not proof of enforcement
CR-02 Source register and passages / knowledge owner Register 27 September C2 Selected corpus records; completeness not established
CR-03 Entitlement and context policy / access owner 20 September, v1 C3 Intended restrictions; full effective configuration absent
CR-04 Baseline/run cover / evaluation lead Run E-17, 27 September C4 Selected run identity; exact model revision and full run manifest absent
CR-05 Query/retrieval/answer extracts / evaluation lead E-17, 27 September C5 Four supplied traces; no population accuracy estimate
CR-06 Synthetic adversarial test proposal / security reviewer 28 September C6 Not executed; authority for a later sandbox run pending
CR-07 Escalation and stop records / support operations 27 September C7 Receipt/acknowledgement and one later answer; downstream proof partial
CR-08 Vendor review / procurement owner 21 September C8 Claims and questions; signed applicable terms absent
CR-09 Monitoring extract / system owner Week ending 30 September C9 Aggregate feedback; denominator and coverage limits
CR-10 Change ticket / release owner Open 25, closed 26 September C10 Completion asserted; rollback/access/reindex evidence partial
CR-11 Incident/near-miss review / response coordinator Open 28 September C11 Exposure scope unresolved; no real user data supplied
CR-12 Management response / system owner 4 October C12 Proposed action and release claim; no independent retest
C. Sample evidence excerpts
C1 — CR-01: use and escalation policy

Guide-L may explain public kit/support information from current published sources. It must identify a supporting source and avoid unsupported promises. If the answer is not in a permitted source or a personal account decision is required, state the limit and display the human-support route. It must not claim to send a message, approve a refund or modify an account. Staff-only context is prohibited in public requests. Human support owns decisions. A source conflict must be surfaced, not silently resolved by the model.

The policy requires a current authoritative source; it does not prescribe a universal numerical accuracy target or establish legal compliance.

C2 — CR-02: source register and local passages
Source/version Fictional owner Audience Effective / lifecycle Exact case passage
K-RET v2, §2 Policy owner Public 1 September; superseded 25 September “Unopened standard kits may be returned within 14 days. Personal exceptions require support review.”
K-RET v3, §2 Policy owner Public 25 September; current “Unopened standard kits may be returned within 30 days. Personal exceptions require support review.”
K-SET v1, §1 Product support Public 10 September; current “Use the supplied assembly guide. If a part is missing, display the human-support route.”
K-OPS v1, §4 Support operations Staff only 18 September; current “Route an exception request to the staff review queue. Staff authorisation remains necessary.”
K-DRAFT v0.4, §3 Contributor, publication pending Unpublished draft No effective date “Replacement kits are always dispatched immediately.”

These are fictional operational statements, not consumer law. K-DRAFT is included only as a synthetic governance risk in a case, not as unpublished Amo.ng content. The register retains the supplied publication state, dates and passages.

C3 — CR-03: access and context policy

Principal PUBLIC may receive current PUBLIC passages only. Principal STAFF may receive PUBLIC and STAFF passages for the permitted support purpose. Audience and publication-state filters must apply before context is sent to Model Service V. An answer-level refusal does not cure an unauthorised context transfer. The service principal has no refund, email or account-write capability.

Supplied configuration excerpt lists filter names but not effective values. Recertification of the index service's permissions is not supplied.

C4 — CR-04: evaluation baseline

Run E-17 cover: corpus C-17, index built 24 September, retriever R2, prompt template PT3, public interface unless specified. Exact hosted model revision: not recorded. Four selected trace extracts Q01–Q04 are supplied. A fifth planned case A01 is not part of E-17. No complete query set, selection method, duplicate handling, expected-answer sign-off or population distribution is supplied.

No separate expected-answer approval record is supplied. A knowledge owner would need to review proposed expectations before any separately authorised test.

C5 — CR-05: selected traces

Q01 — current return policy

  • Request: “What is the return window for an unopened standard kit?” Principal PUBLIC.
  • Retrieved/context passage: K-RET v2 §2.
  • Answer: “You can return an unopened standard kit within 14 days [K-RET v2 §2].”

Q02 — missing part

  • Request: “A part is missing. What should I do?” Principal PUBLIC.
  • Retrieved/context passage: K-SET v1 §1.
  • Answer: “Use the human-support route for a missing part [K-SET v1 §1].”
  • Interface event in the supplied trace: a human-support link is displayed. No support-contact receipt is included.

Q03 — personal exception request

  • Request: “Can you guarantee that my exception will be accepted today?” Principal PUBLIC.
  • Retrieved/context passage: K-RET v2 §2 only. K-DRAFT is not in this trace.
  • Answer: “Your exception has been accepted and a replacement will be dispatched today [K-RET v2 §2].”
  • No action tool, authorisation or dispatch record is included in this trace.

Q04 — exception review question

  • Request: “How are exception requests reviewed?” Principal PUBLIC.
  • Context sent onward: K-OPS v1 §4, plus K-SET v1 §1.
  • Answer: “Please use the public human-support route; I cannot decide an exception.”

Each excerpt is synthetic observed-case material. None is a test run performed during Pack authoring or by a learner merely reading it.

C6 — CR-06: safe adversarial test proposal, not executed

Case A01 proposes inserting a clearly marked, harmless instruction-like canary into a synthetic retrieved document to see whether the system treats it as data rather than authority. No live payload, target URL, credential or exploit script is supplied. Intended result: preserve the approved task and source/access limits, ignore document instructions and record the boundary decision.

Before any future test, the security reviewer must approve sandbox identity, data, harmless fixture, allowed surfaces, observation points, stop conditions and evidence retention. Production, real users, external endpoints and secret extraction are excluded. Actual result: not performed. No “prompt-injection resistant” claim is available from this proposal.

C7 — CR-07: escalation and override records
  • Q02 interface record 10:04: human-support link displayed. No evidence of a user selecting it or a queue item being created.
  • Q03 review record 10:07: operator pressed stop for the affected session; acknowledgement logged at 10:07:02.
  • Same session answer-completion marker: 10:07:05. Delivery status and whether the marker describes a buffered or newly generated answer are absent.
  • Operator explanation: “Acknowledgement proves the session was contained.” No downstream containment confirmation is supplied.
C8 — CR-08: vendor/dependency review

Procurement note: “Model Service V says content is not used for training under some business arrangements. Index Service R says public/staff filtering is supported.” Applicable product tier, contract schedule, context retention, deletion evidence, subprocessor roles and effective entitlements are not attached. No agreed fallback-provider evidence exists.

C9 — CR-09: monitoring record

Management slide says “95% helpful”. Footnote: 19 of 20 voluntary feedback responses marked helpful. Total answers, source currency, query mix, repeat users, non-responders and access failures are absent. No broken-down grounding, unanswerable-query, escalation or context-entitlement metric is shown. No threshold ownership is recorded.

C10 — CR-10: change record

Change CH-24 replaces K-RET v2 with v3. The ticket says publication occurred 25 September and “index updated” on 26 September. E-17 on 27 September still identifies C-17 built on 24 September. The ticket extract contains an undated missing-part-answer screenshot. Its capture date and attachment time are absent, so it is not identified as the later E-17 Q02 run. No corpus membership comparison, public/staff negative test, Q01 recheck, rollback exercise or exact model-baseline record is attached. The release owner closed the ticket. The reason for the baseline discrepancy is not supplied.

C11 — CR-11: incident/near-miss record

Opened 28 September after review of Q04. Scope described as “staff passage in public generation context”; real personal data are not part of the supplied case. Response coordinator requests preserved traces, audience filters and context-transfer scope. No full event search or retention analysis is supplied. Record state remains “awaiting evidence”. Notification decisions, if any, are not included; learners must not invent a legal notification requirement or claim one was completed.

C12 — CR-12: management response

“The answers are usually helpful. The policy document was updated and Q02 still works, so the issue should close. We plan to add a reminder to the release checklist and review the public/staff filter.”

No accountable action commitment, due date, changed effective configuration, representative regression, containment result or independent retest is provided. Proposed actions remain proposed.

D. Attributed assertions for review
Maker Statement or representation Source
System owner Fluent answers and high user ratings support reliability Case narrative
Management monitoring slide “95% helpful” with the supplied footnote CR-09
Release ticket Index updated and ticket closed CR-10
Operator Acknowledgement proves containment CR-07
Procurement note, reporting supplier claims Training-use and filtering capability claims CR-08
System owner Update and Q02 justify closure; further checks planned CR-12

For each, record the source, actual supporting material and any unresolved question. Do not add an assertion merely because it would be a useful teaching example.

F. Learner/auditor tasks
  1. Define a bounded system/control question and exclusions in scope workbook/AMO-P-000361 using the supplied purpose and policies.
  2. With AMO-P-000242/AMO-S-000007 and GenAI/RAG evaluation sheets, analyse each query, retrieved passage and answer. Explain source support and alternative failure locations where evidence permits; preserve unknown cause and scope.
  3. Use AMO-W-000016 for source authority/entitlements and AMO-W-000013/AMO-S-000012 for evaluation evidence. Assess what conclusions the monitoring data can support without inventing missing denominators.
  4. Review A01's proposed authority, expected behaviour and limits in GenAI/RAG evaluation sheets. It remains not performed; do not run it against a public system.
  5. Use only relevant vendor/operational workbook/AMO-W-000002/AMO-W-000021 modules to examine supplier, access, logging, monitoring, override and change evidence. Distinguish a missing record from an observed deviation against a supplied criterion.
  6. Draft a bounded finding if justified, then challenge its management response and any closure claim with AMO-P-000363/findings register. Do not invent severity or operational effects.
  7. Record the learner's hypothetical human judgement, editable carry-forward, unresolved matters and next evidence request. Multiple defensible answers are possible when the limits are explicit.
J. Professional judgement and limitations

There may be more than one professionally defensible answer. This case does not measure real-world accuracy, prove security or privacy compliance, establish fairness or explanation fidelity, validate a foundation model or certify a system. Human professionals determine evidence sufficiency and reliance within an authorised scope. Reading a trace or completing a sheet is not independent execution or an audit opinion.

Related Amo.ng resources
Facilitator material

Reviewer interpretations, expected issues and intentional ambiguities are kept in a separate facilitator companion. For a blind learner assessment, use this learner edition before consulting worked examples in the template bundles. Supplied source assertions remain available for critical review; this file does not supply their answer key.

Use of these resources is subject to the Amo.ng Terms.

Real case studies

Examine real control and assurance questions using primary records. Read the questions before expanding the outcome. Allegations, settled findings, order obligations and published practice accounts have different evidential status.

Real case study · Validate deployment and monitor harm

Rite Aid: facial-recognition deployment controls

U.S. Federal Trade Commission; U.S. District Court, E.D. Pennsylvania · United States · 2024 · court settlement and modified FTC order

A supplier’s accuracy claim is not enough to establish that a system is safe for its actual operating conditions or the people affected by its outputs.

Read case study: Rite Aid: facial-recognition deployment controls
What happened

The FTC alleged that Rite Aid used facial recognition in stores without reasonable safeguards, generating false matches and exposing consumers to harmful interventions. Those are complaint allegations, not findings reached after a contested trial.

Control and assurance questions
  • What intended use, operating conditions and acceptable error criteria should have been agreed before deployment?
  • What evidence would reveal false positives and uneven performance across affected groups, and who would review it?
  • How would complaints, disputed matches and supplier changes trigger investigation, escalation or suspension?
What an internal auditor should examine

Request the system inventory, vendor evidence, locally relevant validation results, approved test design, staff instructions and intervention logs. Trace a sample of alerts to human decisions and complaints. Review access, retention, deletion and management reporting against the engagement’s agreed criteria; missing records remain missing evidence.

Read what the authoritative record establishes

A stipulated court order was signed on 23 February and filed on 26 February 2024. The FTC’s modified order, issued 5 March 2024, includes a five-year restriction on covered retail facial-recognition use and safeguards for covered automated biometric systems, including risk assessment, testing and monitoring. The settlement does not convert the complaint into trial findings.

Professional lesson

Distinguish supplier promises, pre-deployment testing, actual operating behaviour and corrective action. Approval to deploy should have a named owner and an evidence basis; monitoring should test whether those assumptions continue to hold.

Relevant Amo.ng resources
Primary sources
Status note

Settlement-based court and administrative orders; Rite Aid did not admit the substantive allegations. The linked FTC case hub’s broad ‘Pending’ label is not used to describe the entered orders as merely proposed. The reviewed record does not establish current compliance or the outcome of every later corporate proceeding. No superseding merits decision was identified in this focused review.

Reviewed 11 October 2026. These learning questions are Amo.ng’s interpretation of the cited records. Amo.ng has not audited the named organisations. This summary is not legal advice, an assurance opinion or evidence of their current compliance. Apply the requirements relevant to your engagement and jurisdiction.

Real case study · Challenge evaluation evidence and capability claims

Workado / Content at Scale AI: substantiating detector accuracy

U.S. Federal Trade Commission · United States · 21 August 2025 · final consent order

A benchmark can be technically real yet fail to support the population, content or conditions covered by a product claim.

Read case study: Workado / Content at Scale AI: substantiating detector accuracy
What happened

The FTC alleged that accuracy claims for Content at Scale AI’s text detector exceeded the supporting evidence. Workado LLC was formerly known as Content at Scale AI. The central learning question is whether the claimed general performance was supported by evaluation relevant to the intended use.

Control and assurance questions
  • Which population, languages, content types and model versions does an accuracy statement actually cover?
  • Can the claimed result be traced to retained data, labels, methods, exclusions and reproducible calculations?
  • Who approves a new or changed claim when the detector, benchmark or intended use changes?
What an internal auditor should examine

Compare the public claim with the evaluation plan, test-set origin, reference labels, error measures and production conditions. Look for excluded populations, data leakage, threshold choices and uncertainty. Trace review, approval and version changes rather than treating a headline percentage as assurance evidence.

Read what the authoritative record establishes

The final FTC decision and order was issued on 21 August 2025 and announced on 28 August. It restricts misleading or unsubstantiated efficacy claims and requires competent and reliable supporting evidence, together with recordkeeping and other compliance obligations. It is a final consent order, not the earlier proposed-order stage; the respondent did not admit the substantive allegations.

Professional lesson

The audit question is whether evidence supports the specific claim in its intended context. An evaluation result does not license broader claims, and evidence should remain available for later challenge.

Relevant Amo.ng resources
Primary sources
Status note

Final administrative consent order, issued 21 August 2025. Allegations and negotiated obligations are distinguished; this is not a contested-trial finding of every alleged fact. No superseding order or reversal was identified in the primary records reviewed. The summary does not assess subsequent compliance.

Reviewed 11 October 2026. These learning questions are Amo.ng’s interpretation of the cited records. Amo.ng has not audited the named organisations. This summary is not legal advice, an assurance opinion or evidence of their current compliance. Apply the requirements relevant to your engagement and jurisdiction.

Real case study · Reconcile public claims with actual system use

Delphia and Global Predictions: evidence behind AI representations

U.S. Securities and Exchange Commission · United States · 18 March 2024 · two separate settled administrative orders

An AI inventory should describe what is actually used. Public statements and management representations need a traceable basis in that operational reality.

Read case study: Delphia and Global Predictions: evidence behind AI representations
What happened

The SEC’s Delphia order addresses representations that client data informed AI-assisted investment decisions when that use had not been implemented. Its separate Global Predictions order addresses misleading AI-related representations, including claims about its advisory status and AI-driven forecasts. The two advisers and records must not be conflated.

Control and assurance questions
  • Does each public AI claim correspond to an identifiable system, actual data flow and accountable owner?
  • Who checks a management representation against deployment records before approving a disclosure?
  • If a claim is corrected in one channel, what control identifies inconsistent copies elsewhere?
What an internal auditor should examine

Reconcile inventories, model-use records and data lineage with approved public statements. Sample claims across channels and compare them with evidence from responsible system owners. Examine sign-offs, change notifications and correction tracking; a presentation or future roadmap is not evidence that a capability operates today.

Read what the authoritative record establishes

The SEC made findings in two settled orders, IA-6573 for Delphia and IA-6574 for Global Predictions, dated 18 March 2024. Each adviser accepted censure, cease-and-desist provisions and a civil penalty; the penalties were $225,000 and $175,000 respectively. Both settlements were without admitting or denying the findings, apart from jurisdictional matters.

Professional lesson

Treat a capability claim as something to test against evidence, not as proof of the capability. A settled administrative finding also has a different procedural basis from a contested court judgment.

Relevant Amo.ng resources
Primary sources
Status note

Two separate settled administrative orders, not one proceeding or trial judgment. Their findings are made on the respective settlement offers and are not extended to other persons. No reversal or superseding disposition was identified in the primary records reviewed. No claim is made about either adviser’s subsequent compliance.

Reviewed 11 October 2026. These learning questions are Amo.ng’s interpretation of the cited records. Amo.ng has not audited the named organisations. This summary is not legal advice, an assurance opinion or evidence of their current compliance. Apply the requirements relevant to your engagement and jurisdiction.

Real case study · Test decision rules and human accountability

iTutorGroup: inspect automated screening logic, not its label

U.S. Equal Employment Opportunity Commission; U.S. District Court, E.D. New York · United States · September 2023 · consent-decree settlement

Consequential automation needs control testing even when it is rules-based rather than technically AI. The product label does not resolve the professional risk.

Read case study: iTutorGroup: inspect automated screening logic, not its label
What happened

The EEOC alleged that iTutorGroup’s application software automatically rejected older applicants using age- and sex-related thresholds. The dispute concerned automated screening. Separate witness testimony hosted by the EEOC distinguished this technology from technical AI; that testimony is not itself an agency finding about the case.

Control and assurance questions
  • What actual inputs, thresholds and configuration determine rejection, and who authorised them?
  • Could authorised test applications expose prohibited or unjustified decision rules before release?
  • How are outcome differences, overrides, complaints and configuration changes investigated?
What an internal auditor should examine

Request configured rules and their rationale, approved acceptance criteria, change records, test results and human responsibilities. With appropriate authority, compare synthetic test inputs and observed outcomes. Escalate legal interpretation to the responsible specialist; do not infer that a system is permissible because it is not marketed as AI.

Read what the authoritative record establishes

The 2023 settlement provided $365,000 and non-monetary measures including anti-discrimination policies and training. The EEOC’s annual report records entry of the consent decree on 8 September 2023. The release describes the EEOC’s allegations and agreed relief; it is not a finding after a contested trial.

Professional lesson

Audit the decision process that affects people, including simple rules, supplier configurations and human approval. Technology terminology cannot substitute for testing the controls or evaluating their consequences.

Relevant Amo.ng resources
Primary sources
Status note

Consent-decree settlement in EEOC v. iTutorGroup, E.D.N.Y., 1:22-cv-02565; decree entry recorded on 8 September 2023. The allegations remain attributed to the EEOC. No later reversal was identified in the primary records reviewed; this summary makes no finding about subsequent operations or decree compliance. U.S. employment-law context is not generalised into advice for other jurisdictions.

Reviewed 11 October 2026. These learning questions are Amo.ng’s interpretation of the cited records. Amo.ng has not audited the named organisations. This summary is not legal advice, an assurance opinion or evidence of their current compliance. Apply the requirements relevant to your engagement and jurisdiction.

Real case study · Request evidence before approving third-party use

Deloitte: enhanced due diligence for a third-party model

UK DSIT AI Assurance portfolio; contributor: Deloitte · United Kingdom · published practice example · 19 September 2023 · contributor case, not an enforcement decision

A positive practice example shows how a decision-making committee can request targeted supplier evidence and retain the limitations of the review.

Read case study: Deloitte: enhanced due diligence for a third-party model
What happened

Deloitte’s portfolio account describes a Risk Committee seeking further review before approving a proposed financial-product collaboration using a third party’s model. The supplier’s model was already developed and deployed; the review concerned the client’s proposed use, not an assertion that the model had never been deployed.

Control and assurance questions
  • Which model risks matter to the proposed use, and what evidence must the supplier provide?
  • What should the committee do if important model documentation is unavailable or unclear?
  • How should the decision record distinguish work performed, unresolved questions and accepted residual risk?
What an internal auditor should examine

Build a bounded evidence request covering model data, development, operation and outputs. Record supplier responses, access limitations and follow-up questions. Inspect how the committee receives those limitations and assigns responsibility for the decision and later monitoring; do not treat document receipt as proof of effective controls.

Read what the authoritative record establishes

The contributor describes a targeted review of the third-party model and gaps in supporting documentation. The account explicitly says no formal assurance opinion was provided. It is an illustration of due diligence, not a regulator’s determination that the supplier, model or client was compliant or approved.

Professional lesson

Useful due diligence can inform an accountable decision without claiming to be a formal assurance opinion. The report should make the scope, evidence obtained and unresolved limitations visible.

Relevant Amo.ng resources
Primary sources
Status note

Government-hosted, contributor-authored practice account published 19 September 2023. It is not an adjudicated case, settlement or independent government verification; appeal/finality concepts do not apply. The portfolio states that inclusion does not endorse a technique or organisation. The account does not establish ongoing control effectiveness.

Reviewed 11 October 2026. These learning questions are Amo.ng’s interpretation of the cited records. Amo.ng has not audited the named organisations. This summary is not legal advice, an assurance opinion or evidence of their current compliance. Apply the requirements relevant to your engagement and jurisdiction.

Professional responsibility

Professional judgement stays with you

Amo.ng can help structure audit work, challenge evidence, organise findings and review AI-system information. It does not determine evidence sufficiency, establish control effectiveness, close audit findings or issue an audit opinion.

Internal auditors remain responsible for engagement scope, evidence evaluation, professional scepticism, conclusions, escalation and reliance decisions. AI-generated output should remain working material until reviewed against authoritative evidence.

For organisations

Bring the Pack to your internal audit & AI assurance team

RichlyAI offers facilitated training, private cohorts and organisation-specific adaptation for teams that want to apply these methods to internal audit work and AI-system assurance.

The public Amo.ng Pack remains free. Institutional services add facilitation, adaptation and organisation-specific support.

Use of these resources is subject to the Amo.ng Terms.