Skip to content

GRF · AI and Digital Governance

Algorithmic public decisions

Governments use algorithms to assess benefit claims, detect fraud, allocate inspections, set risk scores in policing and migration, and support judges and caseworkers. These decisions affect rights and livelihoods at scale, and errors repeat across thousands of cases before anyone sees them. This page sets out how algorithmic public decisions go wrong and how safeguards work, the records that show them, and who decides whether and how a system is used.

02The question

Algorithmic public decisions: how the risk develops.

Contestability and transparency. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

यंत्रणा

Errors scale silently

A flawed rule or model applies to every case it touches. Without monitoring of outcomes and appeals, a systematic error can wrongly deny or penalise many people before it is detected.

यंत्रणा

Bias enters through data and design

Historical data reflect past decisions and enforcement patterns. Proxies such as postcode or nationality can produce unequal outcomes even when protected characteristics are excluded.

यंत्रणा

Human review becomes rubber-stamping

Public servants asked to review automated outputs under time pressure tend to accept them. Meaningful review needs time, authority to overrule and information about how the output was produced.

यंत्रणा

Opacity blocks challenge

People cannot contest a decision they do not know was automated or cannot understand. Notice, reasons and access to an appeal decide whether errors are corrected.

03देखरेख करा

Public algorithm register.

The screen a team would use to follow this subject: its measures, states and decisions. Names are examples and values are illustrative.

Public algorithm register

Algorithmic public decisions · Algorithm register · Quarter 1

Two high-risk systems without assessmentGRF · AI and Digital Governance

Registered systems

Benefit fraud flaggingSocial agencyउच्चMissingPartial
Permit triagePlanningLimitedपूर्णहोय
School placementEducationउच्चपूर्णहोय
Chat assistantTax officeMinimalपूर्णलागू नाही

Oversight action

प्रणाली
Benefit fraud flagging
Required
impact assessment, appeal route
Deadline
64 days
प्राधिकरण
Oversight body

Complaints about automated decisions

Public algorithm register: the screen’s structure, terms and states for Algorithmic public decisions.Example names and illustrative values; a design, not a record or a live system.
04निर्देशक

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeLabel
Public algorithmic systems in a transparency registercount by agencyon updateAlgorithm registersDECLARED
Algorithmic impact assessments publishedcountannualGovernment publicationsDECLARED
Appeals against automated decisionscount and share upheldannualAgency and tribunal recordsPublished statistics
Outcome disparity across groupsratio of adverse outcome ratesper auditIndependent auditsअंदाजित
Systems suspended or withdrawn after reviewcountannualGovernment and court recordsPublished statistics
Ombudsman complaints about automated decisionscountannualOmbudsman reportsPublished statistics
05Instruments and commitments

How algorithmic public decisions is governed: instruments, mandates and commitments.

The instruments, mandates, actors and accountability arrangements a policymaker, diplomat or development agency works with, citing the agreements that set them. Structures follow the frameworks named. Any state or progress drawn is illustrative, not a record.

Policy instrument matrix

The kinds of instrument available on algorithmic public decisions, by level of government and cooperation.

Instrument typeLocalराष्ट्रीयप्रादेशिकजागतिक
RegulatoryZoning, building codesLaws, standards, licensingHarmonised rulesConventions and treaties
EconomicLocal levies, grantsBudget lines, taxes, insurance schemesRisk pools, regional fundsFinancing mechanisms
माहितीLocal warningsDisclosure, early warning, statisticsData sharing arrangementsGlobal monitoring and reporting
InstitutionalLocal committeesLead agencies, coordination councilsRegional bodies and secretariatsMultilateral mandates
CooperativeCommunity agreementsPartnership compactsMemoranda and joint programmesAgreements and joint commitments
A typology after the OECD Recommendation on the Governance of Critical Risks; examples of instrument types, not an inventory of any country’s measures.
Sendai Framework for Disaster Risk Reduction · UNDRRParis Agreement · UNFCCC2030 Agenda and the Sustainable Development Goals · United NationsInternational Health Regulations · WHO
06स्रोत

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

स्रोतWhat it givesLicence class
UK Algorithmic Transparency Recording Standard recordsPublished records of algorithmic tools used by public bodiesOpen Government Licence
Amsterdam and Helsinki algorithm registersCity registers of algorithmic systems in useOpen data, terms per city
Canada Directive on Automated Decision-Making and Algorithmic Impact AssessmentsMandatory impact assessments for federal automated decisionsOpen Government Licence, Canada
Ombudsman and audit office reportsInvestigations of automated decision systems in public servicesPublic records, terms per office
Court judgments on automated public decisionsRulings on lawfulness of algorithmic systemsPublic records, terms per court
07Decisions

Who decides, and what the evidence serves.

AI and Digital Governance prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Who decidesThe questionEvidence this page serves
Ministers and agency headsWhether to automate a decision and with what safeguardsImpact assessments, audit evidence and lessons from comparable systems
Data protection authoritiesWhether processing and automated decisions are lawfulAssessment records and complaints
Ombudsmen and audit officesWhether to investigate a system and what to recommendAppeals, complaints and outcome data
Courts and tribunalsWhether a decision or system breached rights or lawRecords presented by parties; the page serves context only

Outputs this topic produces

  • Comparative notes on algorithm registers and impact assessments
  • Guide to meaningful human review in automated decisions
  • Dialogue briefs on lessons from suspended public algorithms
  • Questions for agencies before deploying an automated decision system
08Core questions

What experts ask about algorithmic public decisions.

  • What legal power authorises this use, and does the algorithm stay within it?
  • Can a person affected find out that an algorithm was used, understand how, and challenge the result?
  • Does the system perform differently for different groups, and is that justified?
  • What happens when the system is wrong, and how quickly is the error found and corrected?
09Mechanisms

How algorithmic decisions go wrong.

Algorithms trained on historical data can reproduce historical patterns of disadvantage. A proxy variable that seems neutral, such as postcode, may correlate with protected characteristics. Errors at scale differ from individual errors: a flawed rule applied to an entire caseload harms many people at once and in the same way, which can overwhelm complaint systems.

The burden of proof often shifts silently. When a system flags someone as high-risk, that person may need to prove a negative, without knowing what evidence the system used. Well-documented failures of automated benefits and fraud systems show that the greatest harm comes when automated flags are treated as findings rather than prompts for human investigation.

Why now: automated systems are used for eligibility, triage and fraud detection in public services, and courts and ombudsmen in several countries have examined cases where they went wrong. The platform is designed to compare review and redress arrangements and record what affected people can actually do.

10Methods and limits

Safeguards and their limits.

  1. 01

    Public registers of algorithms

    Listing systems used by public bodies and their purposes. Limits: registers are often incomplete and vary in detail.

  2. 02

    Explanation and notification

    Telling people when an algorithm was used and why it produced a result. Limits: explanations of complex models can be partial.

  3. 03

    Fairness testing

    Measuring performance across groups, using machine learning methods. Limits: different fairness measures can conflict, and choosing among them is a value judgement.

  4. 04

    Appeal and redress

    Routes to human review, appeal and remedy. Limits: depend on accessible processes and adequate staffing.

12प्रश्न

प्रश्न आणि उत्तरे.

What is an algorithmic impact assessment?
A structured review, before and during deployment, of the risks an automated system poses to people and how they are mitigated. Canada requires one for federal automated decisions.
What makes human review meaningful?
The reviewer has the time, competence, information and authority to depart from the system’s output, and does so in practice when warranted.
Do people have a right not to be subject to automated decisions?
Under the GDPR, people have rights concerning decisions based solely on automated processing that significantly affect them, with exceptions and safeguards. Other jurisdictions differ.
Can a public decision be made entirely by an algorithm?
That depends on the law of each jurisdiction. Many legal systems restrict fully automated decisions with significant effects on people and require human involvement and a right to contest.
Why can’t fairness be measured with one number?
Because there are several reasonable definitions of fairness, and mathematically they often cannot all be satisfied at once. Choosing among them is a policy decision.
Does the platform take up individual cases?
No. Individual cases belong to the deploying body, ombudsmen, tribunals and courts.
Are algorithm registers required?
Some jurisdictions and cities publish them voluntarily or under policy; requirements vary.
अहवालयोगदान द्या

या पानावरून पुरावा योगदान द्या.

Reports is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

Global Risks ForumAI and Digital GovernanceExponential TechnologyEvidence Brief

वैयक्तिक डेटा, संवेदनशील पायाभूत सुविधांचा तपशील किंवा सामायिक करण्याचा तुम्हाला अधिकार नसलेले काहीही कधीही पाठवू नका. योगदानाचे वापरापूर्वी पुनरावलोकन केले जाते; ते पाठवल्याने कोणतेही लेखकत्व किंवा संपादकीय अधिकार मिळत नाहीत, आणि प्रायोजकत्वाने कधीही निष्कर्ष विकत घेता येत नाही.

AI आणि डिजिटल प्रशासन

Bring a governance question to the Forum.

Information and enquiries are open today. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.

कायदेशीर
Show all 18 legal documents

या साइटवरील नकाशे, डेटा आणि आकृत्या संदर्भ आणि सर्वसाधारण माहितीसाठी दाखवल्या आहेत. त्या सल्ला, अंदाज किंवा इशारे नाहीत; माहितीच्या मर्यादा अस्वीकरणे आणि डेटा सूचनांमध्ये नमूद केल्या आहेत.