GRF · AI and Digital Governance
AI oversight and accountability
When an AI system causes harm, someone must be able to find out what happened and answer for it. Oversight relies on documentation, logging, audit, incident reporting and authorities with the powers and skills to use them. Accountability is spread across developers, deployers, boards and regulators, and can dissolve between them. This page sets out how AI oversight holds or fails, the records that show it, and who holds each decision.
AI oversight and accountability in seven parts.
- 01The questionAI oversight and accountability: how the risk develops
- 02IndicatorsWhat is measured, and how well
- 03SourcesWhere the evidence comes from
- 04DecisionsWho decides, and what the evidence serves
- 05Core questionsWhat institutions ask about oversight
- 06MechanismsWhy accountability erodes
- 07Methods and limitsInstruments of oversight
AI oversight and accountability: how the risk develops.
Roles, validation and human review. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.
Responsibility diffuses along the chain
A model developer, a fine-tuner, an integrator and a deploying organisation each shape a system’s behaviour. When obligations attach to only one of them, the others can point elsewhere after harm.
Records decide what can be reviewed
Without technical documentation, logs and change records, auditors and regulators cannot reconstruct how a system reached an output. Record-keeping duties make later oversight possible.
Authorities lack capacity
Market surveillance, data protection and sector regulators need technical staff, access to systems and powers to test them. Thin capacity turns rules into self-assessment.
Incidents go unreported
Failures surface through complaints, journalism and litigation rather than reporting. Mandatory incident reporting and shared incident databases let patterns be seen across deployments.
Public algorithm register.
وہ اسکرین جو ایک ٹیم اس موضوع کی پیروی کے لیے استعمال کرے گی: اس کے پیمانے، حالتیں اور فیصلے۔ نام مثالیں ہیں اور اقدار توضیحی ہیں۔
Public algorithm register
AI oversight and accountability · Algorithm register · Quarter 2
Registered systems
| Benefit fraud flagging | Social agency | زیادہ | Missing | Partial |
| Permit triage | Planning | Limited | مکمل | ہاں |
| School placement | Education | زیادہ | مکمل | ہاں |
| Chat assistant | Tax office | Minimal | مکمل | لاگو نہیں |
Oversight action
- نظام
- Benefit fraud flagging
- Required
- impact assessment, appeal route
- Deadline
- 73 days
- اختیار
- Oversight body
Complaints about automated decisions
What is measured, and how well.
Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.
| Indicator | Unit | Cadence | Source type | Label |
|---|---|---|---|---|
| Designated AI supervisory or market surveillance authority | yes or no, with legal basis | on change | National legislation and notifications | Published statistics |
| Technical staff in AI-relevant authorities | full-time equivalents | annual | Authority annual reports | رپورٹ شدہ |
| Serious incidents reported under AI rules | count by sector | annual | Public records | Published statistics |
| Publicly recorded AI incidents | count by harm type | monthly | Incident databases | رپورٹ شدہ |
| Enforcement actions concerning AI systems | count by authority and type | annual | Regulator enforcement registers | Published statistics |
| ISO/IEC 42001 certificates issued | count | annual | Certification body records | رپورٹ شدہ |
Compare instruments: rules, incentives and information.
Three families of instruments side by side against the baseline, each with its own lag and adoption speed, under the coverage and compliance you set; effect sizes are teaching values to replace with evidence. Scenario: named assumptions about the future, not a forecast.
کنٹرولز
- Baseline trend of the outcome
- 2.0% a year
- Coverage of the instrument
- 70%
- Compliance
- 75%
- Effect size, against the teaching value
- 100%
- Years ahead
- 20 years
ریڈنگز
- Largest reduction at the horizon
- Regulation
- Its reduction against the baseline
- 21%
اعداد، طریقے اور ماخذات
| سال | بنیادی حوالہ | Regulation | Economic incentive | Information and capacity |
|---|---|---|---|---|
| 0 | 100.0 | 99.5 | 98.8 | 99.1 |
| 1 | 102.0 | 101.2 | 100.1 | 99.8 |
| 2 | 104.0 | 102.5 | 101.1 | 99.9 |
| 3 | 106.1 | 103.5 | 101.6 | 100.0 |
| 4 | 108.2 | 103.7 | 101.8 | 100.7 |
| 5 | 110.4 | 103.2 | 101.7 | 102.1 |
| 6 | 112.6 | 102.0 | 101.6 | 103.9 |
| 7 | 114.9 | 100.4 | 101.6 | 105.9 |
| 8 | 117.2 | 99.2 | 102.1 | 108.0 |
| 9 | 119.5 | 98.6 | 102.9 | 110.1 |
| 10 | 121.9 | 98.9 | 104.2 | 112.3 |
| 11 | 124.3 | 99.7 | 105.7 | 114.5 |
| 12 | 126.8 | 101.1 | 107.4 | 116.8 |
| 13 | 129.4 | 102.7 | 109.4 | 119.2 |
| 14 | 131.9 | 104.5 | 111.4 | 121.6 |
| 15 | 134.6 | 106.5 | 113.5 | 124.0 |
| 16 | 137.3 | 108.5 | 115.7 | 126.5 |
| 17 | 140.0 | 110.7 | 118.0 | 129.0 |
| 18 | 142.8 | 112.9 | 120.4 | 131.6 |
| 19 | 145.7 | 115.1 | 122.8 | 134.2 |
| 20 | 148.6 | 117.4 | 125.2 | 136.9 |
طریقے
- Tools of government Hood (1983), The Tools of Government, Macmillan
- Carrots, sticks and sermons Bemelmans-Videc, Rist and Vedung (1998), Transaction
- Diffusion of innovations Rogers (2003), Diffusion of Innovations, Free Press
- غیر یقینی کا پنکھا (پیرامیٹر Monte Carlo) Spiegelhalter، Pearson and Short (2011)، Visualising uncertainty about the future، Science 333
- ایک وقت میں ایک کی حساسیت (ٹورنیڈو) Saltelli and others (2008)، Global Sensitivity Analysis: The Primer، Wiley
ڈیٹا
The model runs on the teaching values set by the controls. To calibrate it for a place, read it against these admitted layers and series, which this page’s map can draw:
- Borders Natural Earth
- Cities Natural Earth
چھ ستونوں میں، Nexus Consortium کی قیادت میں
- تجربات تجربہ گاہیں
- Built in AI and Digital Governance in Foundry
- Tested at AI and Digital Governance in Universe
- میں مدون معیارات میں ڈیجیٹل، سائبر اور AI
- Published in AI and Digital Governance in Reports
- میں پڑھایا جاتا ہے اکیڈمی میں ٹیکنالوجی اور ڈیجیٹل نظاموں کی فیکلٹی
Where the evidence comes from.
Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.
| ماخذ | What it gives | Licence class |
|---|---|---|
| OECD.AI Policy Observatory | National AI policies, governance bodies and the AI Incidents Monitor | Free, OECD terms |
| AI Incident Database | Crowd-sourced records of harms involving AI systems | Open, licence to check |
| European Data Protection Board and national authority decisions | Decisions on automated processing and AI-related complaints | Public, EU and national reuse terms |
| Stanford AI Index Report | Data on AI development, policy and incidents | Free to read, licence to check |
| Regulator annual reports | Staffing, priorities and enforcement of authorities supervising AI | Public records, terms per authority |
From mandate to evaluation, by pillar.
The steps an instrument takes from mandate to evaluation, each with the pillar that runs it, and the decisions that stay with the authority. Teaching model with stated illustrative values, not a prediction.
- Mandate and problem framing Competent authority (outside the programme)
A competent authority frames the problem and the mandate under its own rules. Howlett, Ramesh and Perl (2009) - Evidence and system model Foundry
The system is modelled with its feedbacks, data and stated limits. OECD (2014), principle 2 - Options appraised with scenarios Foundry
Instruments are compared under scenarios, with uncertainty shown. Hood (1983) - Exercise with stakeholders Universe
The options are tested in an exercise with those who would implement and bear them. OECD (2014), principle 3 - Standard or guidance drafted Nexus Standards
What works is codified as a standard or guidance, open to comment. Nexus Standards process - Decision by the authority Competent authority (outside the programme)
The authority decides, outside the programme, with the evidence on record. Howlett, Ramesh and Perl (2009) - Capacity and training Risk Academy
Those who implement are trained on the decided instrument and its data. Sendai Framework (2015), priority 2 - Monitoring and public report Reports
Indicators are published with sources, limits and corrections. OECD (2014), principle 5 - Evaluation and revision Nexus Standards
Results return to the standard and the model: the cycle closes. Howlett, Ramesh and Perl (2009)
طریقے
- Policy cycle Howlett, Ramesh and Perl (2009), Studying Public Policy, Oxford University Press
- Governance of critical risks OECD (2014), Recommendation of the Council on the Governance of Critical Risks
- Layered drawing of directed graphs Sugiyama, Tagawa and Toda (1981), IEEE SMC 11
چھ ستونوں میں، Nexus Consortium کی قیادت میں
- تجربات تجربہ گاہیں
- Built in AI and Digital Governance in Foundry
- Tested at AI and Digital Governance in Universe
- میں مدون معیارات میں ڈیجیٹل، سائبر اور AI
- Published in AI and Digital Governance in Reports
- میں پڑھایا جاتا ہے اکیڈمی میں ٹیکنالوجی اور ڈیجیٹل نظاموں کی فیکلٹی
Who decides, and what the evidence serves.
AI and Digital Governance prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.
| کون فیصلہ کرتا ہے | The question | Evidence this page serves |
|---|---|---|
| Legislatures | Which obligations attach to developers, deployers and providers of general-purpose models | Comparative regimes and evidence from incidents |
| Market surveillance and sector regulators | Which systems to inspect and what powers to use | Incident records, risk categories and enforcement practice |
| Boards of deploying organisations | Who owns AI risk and what assurance they require | Governance practice and management system standards |
| Courts | Who is responsible for harm caused with an AI system | Records and expert evidence presented by parties; the page serves context only |
Outputs this topic produces
- Maps of accountability across the AI value chain for a given use
- Comparative notes on AI supervisory authorities and their powers
- Guide to AI incident reporting regimes and databases
- Questions for boards and regulators on AI oversight
How AI oversight and accountability is governed: instruments, mandates and commitments.
The instruments, mandates, actors and accountability arrangements a policymaker, diplomat or development agency works with, citing the agreements that set them. Structures follow the frameworks named. Any state or progress drawn is illustrative, not a record.
Accountability cycle
How commitments on AI oversight and accountability are held to account, from commitment to correction.
- CommitGovernmentA commitment with a mandate and a legal basis.
- PlanLead agencyA national plan with owners and milestones.
- ResourceMinistry of financeA budget line or financing on record.
- ImplementAgencies and local governmentDelivery against the plan.
- ReportStatistics officeIndicators reported in agreed definitions.
- ReviewLegislature, audit, civil societyIndependent review of results and gaps.
- CorrectGovernmentChanges to the plan, published with reasons.
What institutions ask about oversight.
- Who in the institution owns the decision to deploy this system, and who answers if it causes harm?
- Has the system been validated for this specific use and population, by someone independent of its developers?
- Can the people reviewing its outputs genuinely disagree with it, or do they simply approve what it suggests?
- How will performance be monitored once the system is in use, and what triggers suspension?
Why accountability erodes.
Accountability tends to dissolve gradually. Each actor in a long chain of developers, integrators, operators and managers can reasonably point to another as responsible, until no one is. Why now: human oversight duties are being written into law, including in the European Union AI Act (2024), and public bodies must show who can understand and override an automated output. The platform is designed to convene those bodies and to exercise oversight in Universe with a scenario in which a system is confidently wrong.
Rubber-stamp review
People tend to defer to automated outputs, especially under time pressure, so human review can become a formality.
Many hands
Developers, vendors, integrators and users each own part of the system and none owns the outcome.
Changing performance
Models degrade as the world changes, and without monitoring the degradation goes unnoticed.
Instruments of oversight.
- 01
Impact assessments
Structured analysis of risks to rights and outcomes before deployment. Limits: can become paperwork if not tied to decisions.
- 02
Independent validation
Testing by people independent of developers, using AI evaluation and assurance engineering. Limits: tests show performance on test data, not in every real situation.
- 03
Meaningful human review
Reviewers with the authority, time, information and training to override. Limits: costly, and hard to sustain at scale.
- 04
Audit trails and monitoring
Logs of inputs, outputs and decisions, with performance tracked over time. Limits: only useful if someone reviews them.
How it is studied, and what the methods cannot say.
- 01AI evaluation and assurance engineeringThird-party audit scope · Fairness testing in public systems · Post-deployment monitoringApplied here
- 02Policy, institutional and decision scienceComparing AI regimes · Value chain accountability mapping · Forum and mandate mappingApplied here
- 03Artificial intelligence and machine learningHow models fail in deployment · Reading model documentation · Agent architectures explainedApplied here
سوالات و جوابات۔
What is the difference between an AI provider and a deployer?
Why does logging matter for AI oversight?
Does ISO/IEC 42001 certify that an AI system is safe?
Is having a human in the loop enough?
Who should validate an AI system?
Does the platform audit AI systems?
What should trigger suspending a system?
اس صفحے سے شواہد فراہم کریں۔
Reports کنسورشیم کی سہ ماہی اشاعت ہے۔ اس موضوع کے بارے میں آپ کا علم اگلے شمارے میں شواہد، کیس یا تصحیح بن سکتا ہے، جو آپ کے نام سے منسوب ہوگا اور اگر یہ آپ کا اپنا کام ہو تو CC BY 4.0 کے تحت شائع ہوگا۔
- EmailGateway GW-GRFSend it from this pageEvidence, a correction, a case, a method, a review, a translation or profile input. It arrives tagged with this page, so the editor who owns it receives it.
- ZenodoOpen depositDeposit it and submit to the communityPublish your own record on Zenodo with your ORCID iD, then submit it to the Reports community there. Curators review it; the DOI stays yours.
- ReportsGlobal Risks ForumSee every way to contributeThe contribution types, how each is reviewed, what credit you receive, the licence and what is never accepted.
کبھی بھی ذاتی ڈیٹا، حساس بنیادی ڈھانچے کی تفصیل یا کوئی ایسی چیز نہ بھیجیں جسے شیئر کرنے کا آپ کو حق نہ ہو۔ ہر شراکت استعمال سے پہلے جانچی جاتی ہے؛ اسے بھیجنے سے کوئی تصنیفی یا ادارتی حق حاصل نہیں ہوتا، اور سرپرستی کبھی کوئی نتیجہ نہیں خریدتی۔
Bring a governance question to the Forum.
معلومات اور استفسارات آج کھلے ہیں۔ استفسار کو ایک حوالہ نمبر ملتا ہے اور اگلے مرحلے کی نشاندہی ہوتی ہے؛ درخواستیں، ادائیگیاں، کمپیوٹنگ کی تخصیص اور رجسٹریشن صرف اس وقت کھلتی ہیں جب ان کی ٹیم، شرائط اور جائزے کی استعداد موجود ہو۔
قانونی دستاویزات۔
Show all 18 legal documents
اس سائٹ کے نقشے، ڈیٹا اور اشکال سیاق اور عمومی معلومات کے لیے دکھائے جاتے ہیں۔ یہ مشورہ، پیش گوئیاں یا انتباہات نہیں؛ معلومات کی حدود دستبرداریوں اور ڈیٹا سے متعلق اطلاعات میں بیان کی گئی ہیں۔