Skip to content

GRF · Rêveberiya AI û dîjîtal

Biryarên giştî yên algorîtmîk

Governments use algorithms to assess benefit claims, detect fraud, allocate inspections, set risk scores in policing and migration, and support judges and caseworkers. These decisions affect rights and livelihoods at scale, and errors repeat across thousands of cases before anyone sees them. This page sets out how algorithmic public decisions go wrong and how safeguards work, the records that show them, and who decides whether and how a system is used.

02Pirs

Algorithmic public decisions: how the risk develops.

Contestability and transparency. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mekanîzma

Errors scale silently

A flawed rule or model applies to every case it touches. Without monitoring of outcomes and appeals, a systematic error can wrongly deny or penalise many people before it is detected.

Mekanîzma

Bias enters through data and design

Historical data reflect past decisions and enforcement patterns. Proxies such as postcode or nationality can produce unequal outcomes even when protected characteristics are excluded.

Mekanîzma

Human review becomes rubber-stamping

Public servants asked to review automated outputs under time pressure tend to accept them. Meaningful review needs time, authority to overrule and information about how the output was produced.

Mekanîzma

Opacity blocks challenge

People cannot contest a decision they do not know was automated or cannot understand. Notice, reasons and access to an appeal decide whether errors are corrected.

03Çavdêrî bike

Tomara giştî ya algorîtmayan.

Ekrana ku tîmek dê ji bo şopandina vê mijarê bikar bîne: pîvan, rewş û biryarên wê. Nav mînak in û nirx nîşander in.

Tomara giştî ya algorîtmayan

Algorithmic public decisions · Algorithm register · Quarter 1

Du pergalên xetera bilind bê nirxandinGRF · Rêveberiya AI û dîjîtal

Pergalên tomarkirî

Nîşankirina sextekariya sûdanÇalakiya civakîBilindWendaBeşî
Dabeşkirina destûranPlansazîBisînorQediyaErê
Cihkirina dibistanêPerwerdeBilindQediyaErê
Arîkarê gotûbêjêOfîsa bacêKêmtirînQediyatune

Çalakiya çavdêriyê

Pergal
Nîşankirina sextekariya sûdan
Pêwîst
nirxandina bandorê, rêya îtîrazê
Dema dawî
64 days
Desthilat
Saziya çavdêriyê

Giliyên li ser biryarên otomatîk

Public algorithm register: the screen’s structure, terms and states for Algorithmic public decisions.Example names and illustrative values; a design, not a record or a live system.
04Nîşander

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeNîşan
Public algorithmic systems in a transparency registercount by agencyon updateAlgorithm registersDECLARED
Algorithmic impact assessments publishedcountannualGovernment publicationsDECLARED
Appeals against automated decisionscount and share upheldannualAgency and tribunal recordsStatîstîkên weşandî
Outcome disparity across groupsratio of adverse outcome ratesper auditIndependent auditsTEXMÎNKIRÎ
Systems suspended or withdrawn after reviewcountannualGovernment and court recordsStatîstîkên weşandî
Ombudsman complaints about automated decisionscountannualOmbudsman reportsStatîstîkên weşandî
05Amûr û berpirsiyarî

How algorithmic public decisions is governed: instruments, mandates and commitments.

Amûr, mandat, aktor û rêkxistinên berpirsiyariyê yên ku siyasetmedar, dîplomat an ajansek pêşveçûnê pê re dixebite, bi navkirina lihevkirinên ku wan datînin. Avahî li gorî çarçoveyên hatine nav kirin in. Her rewş an pêşketina hatî kişandin nimûneyî ye, ne tomar e.

Matrîsa amûrên siyasetê

The kinds of instrument available on algorithmic public decisions, by level of government and cooperation.

Cureya amûrêHerêmîNeteweyîHerêmîGerdûnî
RêziknameyîDabeşkirina herêman, qaîdeyên avahiyêQanûn, standard, lîsansRêgezên lihevkirîPeymanname û lihevkirin
AborîBacên herêmî, alîkarîXalên budceyê, bac, sîstemên bîmeyêHewzên xeterê, fonên herêmîMekanîzmayên fînansekirinê
AgahîHişyariyên herêmîEşkerekirin, hişyariya zû, îstatîstîkRêkxistinên parvekirina daneyanÇavdêrî û raporkirina gerdûnî
SaziyîKomîteyên herêmîAjansên pêşengî, encumenên hevrêziyêSaziyên herêmî û sekreteryayanMandatên pirealî
HevkarLihevkirinên civakîPeymanên hevkariyêMemorandûm û bernameyên hevparLihevkirin û berpirsiyariyên hevpar
A typology after the OECD Recommendation on the Governance of Critical Risks; examples of instrument types, not an inventory of any country’s measures.
Çarçoveya Sendaiyê ji bo Kêmkirina Xetera Karesatan · UNDRRPeymana Parîsê · UNFCCCAjandaya 2030 û Armancên Pêşveçûnê yên Domdar · Neteweyên YekbûyîRêzikên Tenduristiyê yên Navneteweyî · WHO
06Çavkanî

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

ÇavkanîWhat it givesLicence class
UK Algorithmic Transparency Recording Standard recordsPublished records of algorithmic tools used by public bodiesOpen Government Licence
Amsterdam and Helsinki algorithm registersCity registers of algorithmic systems in useOpen data, terms per city
Canada Directive on Automated Decision-Making and Algorithmic Impact AssessmentsMandatory impact assessments for federal automated decisionsOpen Government Licence, Canada
Ombudsman and audit office reportsInvestigations of automated decision systems in public servicesPublic records, terms per office
Court judgments on automated public decisionsRulings on lawfulness of algorithmic systemsPublic records, terms per court
07Biryar

Who decides, and what the evidence serves.

AI and Digital Governance prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Kî biryarê didePirsEvidence this page serves
Ministers and agency headsWhether to automate a decision and with what safeguardsImpact assessments, audit evidence and lessons from comparable systems
Data protection authoritiesWhether processing and automated decisions are lawfulAssessment records and complaints
Ombudsmen and audit officesWhether to investigate a system and what to recommendAppeals, complaints and outcome data
Courts and tribunalsWhether a decision or system breached rights or lawRecords presented by parties; the page serves context only

Outputs this topic produces

  • Comparative notes on algorithm registers and impact assessments
  • Guide to meaningful human review in automated decisions
  • Dialogue briefs on lessons from suspended public algorithms
  • Questions for agencies before deploying an automated decision system
08Core questions

What experts ask about algorithmic public decisions.

  • What legal power authorises this use, and does the algorithm stay within it?
  • Can a person affected find out that an algorithm was used, understand how, and challenge the result?
  • Does the system perform differently for different groups, and is that justified?
  • What happens when the system is wrong, and how quickly is the error found and corrected?
09Mechanisms

How algorithmic decisions go wrong.

Algorithms trained on historical data can reproduce historical patterns of disadvantage. A proxy variable that seems neutral, such as postcode, may correlate with protected characteristics. Errors at scale differ from individual errors: a flawed rule applied to an entire caseload harms many people at once and in the same way, which can overwhelm complaint systems.

The burden of proof often shifts silently. When a system flags someone as high-risk, that person may need to prove a negative, without knowing what evidence the system used. Well-documented failures of automated benefits and fraud systems show that the greatest harm comes when automated flags are treated as findings rather than prompts for human investigation.

Why now: automated systems are used for eligibility, triage and fraud detection in public services, and courts and ombudsmen in several countries have examined cases where they went wrong. The platform is designed to compare review and redress arrangements and record what affected people can actually do.

10Methods and limits

Safeguards and their limits.

  1. 01

    Public registers of algorithms

    Listing systems used by public bodies and their purposes. Limits: registers are often incomplete and vary in detail.

  2. 02

    Explanation and notification

    Telling people when an algorithm was used and why it produced a result. Limits: explanations of complex models can be partial.

  3. 03

    Fairness testing

    Measuring performance across groups, using machine learning methods. Limits: different fairness measures can conflict, and choosing among them is a value judgement.

  4. 04

    Appeal and redress

    Routes to human review, appeal and remedy. Limits: depend on accessible processes and adequate staffing.

12Pirs

Pirs û bersiv.

What is an algorithmic impact assessment?
A structured review, before and during deployment, of the risks an automated system poses to people and how they are mitigated. Canada requires one for federal automated decisions.
What makes human review meaningful?
The reviewer has the time, competence, information and authority to depart from the system’s output, and does so in practice when warranted.
Do people have a right not to be subject to automated decisions?
Under the GDPR, people have rights concerning decisions based solely on automated processing that significantly affect them, with exceptions and safeguards. Other jurisdictions differ.
Can a public decision be made entirely by an algorithm?
That depends on the law of each jurisdiction. Many legal systems restrict fully automated decisions with significant effects on people and require human involvement and a right to contest.
Why can’t fairness be measured with one number?
Because there are several reasonable definitions of fairness, and mathematically they often cannot all be satisfied at once. Choosing among them is a policy decision.
Does the platform take up individual cases?
No. Individual cases belong to the deploying body, ombudsmen, tribunals and courts.
Are algorithm registers required?
Some jurisdictions and cities publish them voluntarily or under policy; requirements vary.
rêzeya Pergalên StratejîkTevkarî bike

Ji vê rûpelê delîl bidin.

Reports weşana sê mehane ya Konsorsiyûmê ye. Tiştê ku tu li ser vê mijarê dizanî dikare di çapa pêş de bibe delîl, dosya an rastkirin, bi navê te û di bin CC BY 4.0 de weşandî li cihê ku karê te bi xwe be.

Global Risks ForumAI and Digital GovernanceExponential TechnologyEvidence Brief
Rêveberî: AI û ya dîjîtal

Pirsek ya rêveberiyê bînin Forumê.

Agahî û pirs îro vekirî ne. Pirsek referansekê distîne û gava piştî wê dide nasîn; serlêdan, drav, veqetandina hesabkirinê û tomarkirin tenê dema ku tîm, mercên wê û kapasîteya vekolînê hebin vedibin.