Building bibliometric indicators
Counts of outputs, co-authorship and retractions are normalised by field, year and output volume, with the errors from author and institution disambiguation estimated and reported beside each indicator.
GRF · Research Nexus
Probability and statistics give research governance its measurement discipline: how bibliometric and survey indicators are built, how uncertainty is stated in advice, how selective reporting is detected, and how confident a synthesis can be. In this field they are applied to evidence about research systems, and the indicators carry their construction with them.
Probability and statistics provide the mathematical framework for describing uncertainty and learning from data. They underpin estimation, testing and prediction in every risk discipline. In research and evidence and governance and institutions, statistical methods quantify the likelihood and uncertainty of losses across interconnected systems. They make the evidence behind risk decisions explicit and reproducible. The canonical description is on the STEM Commons.
Counts of outputs, co-authorship and retractions are normalised by field, year and output volume, with the errors from author and institution disambiguation estimated and reported beside each indicator.
Distributions of reported test statistics across a literature are examined for patterns consistent with selective reporting, and outcomes registered in advance are compared with outcomes published.
Verbal likelihood and confidence scales, such as those in IPCC guidance, are compared with how readers interpret them, to inform how advisers state probability in plain words.
The screen a team would use to follow this method: its measures, states and decisions. Names are examples and values are illustrative.
Research · Statistics for research governance · Run R-0211
generalised Pareto fit
| Shape ξ | 0.27 | 0.00 | 0.49 | heavy tail if above zero |
| Scale σ | 4.7 | 1.0 | 5.8 | units of the variable |
| Exceedances | 45 | declustered |
Datasets and records used by probability and statistics on this platform, with the role each plays and the label its values carry. Sources are listed in the source register.
| Idatha | Indima | Label |
|---|---|---|
| OpenAlex and Crossref metadata | Bibliometric counts and citation links | OBSERVED |
| R&D surveys under the Frascati Manual | Expenditure and personnel series | Published statistics |
| Trial and study registries | Planned outcomes against reported outcomes | OBSERVED |
| Surveys of researchers and institutions | Measures of practice and perception | REPORTED |
Three families of instruments side by side against the baseline, each with its own lag and adoption speed, under the coverage and compliance you set; effect sizes are teaching values to replace with evidence. Scenario: named assumptions about the future, not a forecast.
Controls
Readouts
| Year | Isisekelo | Regulation | Economic incentive | Information and capacity |
|---|---|---|---|---|
| 0 | 100.0 | 99.5 | 98.8 | 99.1 |
| 1 | 102.0 | 101.2 | 100.1 | 99.8 |
| 2 | 104.0 | 102.5 | 101.1 | 99.9 |
| 3 | 106.1 | 103.5 | 101.6 | 100.0 |
| 4 | 108.2 | 103.7 | 101.8 | 100.7 |
| 5 | 110.4 | 103.2 | 101.7 | 102.1 |
| 6 | 112.6 | 102.0 | 101.6 | 103.9 |
| 7 | 114.9 | 100.4 | 101.6 | 105.9 |
| 8 | 117.2 | 99.2 | 102.1 | 108.0 |
| 9 | 119.5 | 98.6 | 102.9 | 110.1 |
| 10 | 121.9 | 98.9 | 104.2 | 112.3 |
| 11 | 124.3 | 99.7 | 105.7 | 114.5 |
| 12 | 126.8 | 101.1 | 107.4 | 116.8 |
| 13 | 129.4 | 102.7 | 109.4 | 119.2 |
| 14 | 131.9 | 104.5 | 111.4 | 121.6 |
| 15 | 134.6 | 106.5 | 113.5 | 124.0 |
| 16 | 137.3 | 108.5 | 115.7 | 126.5 |
| 17 | 140.0 | 110.7 | 118.0 | 129.0 |
| 18 | 142.8 | 112.9 | 120.4 | 131.6 |
| 19 | 145.7 | 115.1 | 122.8 | 134.2 |
| 20 | 148.6 | 117.4 | 125.2 | 136.9 |
The model runs on the teaching values set by the controls. To calibrate it for a place, read it against these admitted layers and series, which this page's map can draw:
Across the six pillars, led by Nexus Consortium
Results are checked through diagnostics, cross-validation and sensitivity to assumptions. Independent replication confirms findings.
| Check | How it is done |
|---|---|
| Normalisation stated | Every comparative indicator states its field and time normalisation; raw counts are not compared across fields |
| Coverage audit | Index coverage by language, region and output type is reported before any comparison is made |
| Uncertainty reported | Estimates carry intervals from resampling or a stated sampling error |
| Multiple comparisons | Analyses that test many indicators adjust for multiplicity or say that they did not |
Inference depends on assumptions about independence, distribution and sampling that may not hold. Small or biased samples limit reliability.
The steps an instrument takes from mandate to evaluation, each with the pillar that runs it, and the decisions that stay with the authority. Teaching model with stated illustrative values, not a prediction.
Across the six pillars, led by Nexus Consortium
The instruments, mandates, actors and accountability arrangements a policymaker, diplomat or development agency works with, citing the agreements that set them. Structures follow the frameworks named. Any state or progress drawn is illustrative, not a record.
The actors around statistics for research governance: who decides, who implements, who finances and who brings knowledge and voice.
Systems Science and Modelling stewards probability and statistics for the Consortium and reviews how it is applied across platforms.
I-Reports iyincwadi yekota ye-Consortium. Lokho oakwaziyo ngalesi sihloko kungaba ubufakazi, icala noma ukulungisa kuhlelo olulandelayo, kubongwe wena futhi kushicilelwe ngaphansi kwe-CC BY 4.0 lapho kungumsebenzi wakho.
Ungalokothi uthumele idatha yomuntu siqu, imininingwane ebucayi yengqalasizinda noma noma yini ongenalo ilungelo lokuyabelana ngayo. Umnikelo ubuyekezwa ngaphambi kokusetshenziswa; ukuwuthumela akunikezi ubuqambi noma amalungelo okuhlela, futhi ukusekela akuthengi muphumela.
Information and enquiries are open today. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.
Maps, data and figures on this site are shown for context and general information. They are not advice, forecasts or warnings; the limits of the information are set out in the Disclaimers and Data Notices.
This site uses only strictly necessary cookies to work and to remember your privacy choices. Nothing loads from other companies, and we never sell or share your personal information.
This site uses only strictly necessary cookies to work and to remember your privacy choices. Nothing loads from other companies, and we never sell or share your personal information. We run no advertising. You can review your choices at any time through Privacy choices at the foot of every page.