Government Operational Research Service (GORS) Assessment Quality Assurance, Standards and the Wider Analytical Context Syllabus

Quality Assurance, Standards and the Wider Analytical Context syllabus — full chapter and topic list

Expand any chapter to see its topics and sub-topics. This is the whole examinable outline for Quality Assurance, Standards and the Wider Analytical Context in Government Operational Research Service (GORS) Assessment, not a summary of it.

1. 1

   Quality assurance of analysis

   4 topics

   • The Aqua Book: quality analysis for government
     • Proportionate verification and validation
     • Roles of commissioner, analyst and approver
   • Managing analytical risk and assumptions
   • Business-critical models and the MacPherson review
   • Documentation, audit trails and reproducibility
2. 2

   Government appraisal and evaluation standards

   4 topics

   • HM Treasury Green Book appraisal
     • Five-case model and options appraisal
     • Discounting and net present value
   • The Magenta Book and evaluation
     • Process, impact and economic evaluation
     • Counterfactuals and attribution
   • Risk and uncertainty in appraisal (Optimism bias)
   • Cost-effectiveness and value-for-money analysis
3. 3

   The Government Analysis Function and professions

   4 topics

   • Structure of the Analysis Function
     • GORS, GSG, GES, GSR and data science
     • Working across analytical professions
   • Analytical leadership and Heads of Profession
   • Standards and code of practice for analysis
   • Collaboration with policy and digital functions
4. 4

   Professional ethics and governance

   4 topics

   • Ethical use of data and models in policymaking
     • The Data Ethics Framework
     • Transparency and accountability
   • Speaking truth to power and analytical impartiality
   • Data protection and information governance
     • UK GDPR and the Data Protection Act
   • Equality, diversity and inclusion in analysis

Quality Assurance, Standards and the Wider Analytical Context flashcards for Government Operational Research Service (GORS) Assessment

18 of 51 cards from the Quality Assurance, Standards and the Wider Analytical Context deck — real questions with worked answers.

1. What is the Aqua Book and who published it?

   The Aqua Book is HM Treasury's guidance on producing quality analysis for government (published 2015). It sets out the principles and processes analysts should follow to ensure analysis is fit for purpose, trustworthy and supports good decision-making.

2. What are the three core qualities of good analysis according to the Aqua Book?

   Analysis should be: (1) appropriate/fit for purpose (proportionate to the decision), (2) verified and validated, and (3) communicated honestly with assumptions, uncertainties and limitations made clear (quality, uncertainty and transparency).

3. In the Aqua Book, who are the three key roles in the analytical process and what does each do?

   The Commissioner (asks for and uses the analysis, defines the question), the Analyst (produces the analysis), and the Approver/Assurer (signs off that the analysis is fit for purpose). Clear communication between these roles is essential.

4. What does the Aqua Book mean by analysis being 'proportionate'?

   The depth, rigour and resources devoted to analysis should match the significance, risk and timescale of the decision it supports — neither over-engineered nor under-developed relative to what is at stake.

5. What is a key Aqua Book message about uncertainty and assumptions in analysis?

   Uncertainty is inherent and should not be hidden. Analysts must identify, document and communicate assumptions and uncertainty clearly so decision-makers understand the limitations and confidence of the analysis.

6. What prompted the 2013 Review of quality assurance of government analytical models, and who led it?

   It was led by Sir Nicholas (Nick) Macpherson, then Permanent Secretary to the Treasury, prompted by high-profile model errors — notably the West Coast Main Line franchise competition collapse (2012) caused by flawed modelling.

7. What is a 'business-critical model' as defined by the Macpherson review?

   A model is business-critical if an error in it could lead to serious financial, legal or reputational consequences, or significantly affect a major decision. Each department must maintain a list of its business-critical models with a Senior Responsible Owner (SRO).

8. What governance requirement did the Macpherson review introduce for business-critical models?

   Each business-critical model must have a named Senior Responsible Owner (SRO) accountable for it, departments must keep a register of these models, and there must be appropriate, proportionate quality assurance throughout the model's lifecycle.

9. List the four common causes of model error highlighted by the Macpherson review.

   (1) Weak quality assurance culture/processes, (2) lack of clear ownership and accountability, (3) inadequate documentation and version control, and (4) over-reliance on a single individual ('key person' risk) without independent checking.

10. Why are documentation and audit trails essential for analytical quality?

    They make analysis reproducible, allow others to verify and review it, support continuity if key staff leave, provide accountability for decisions, and enable errors to be traced and corrected. Reproducibility is a cornerstone of trustworthy analysis.

11. What is 'Reproducible Analytical Pipelines' (RAP) and why is it promoted?

    RAP is an approach using code (e.g. R or Python), version control and automation to make statistical/analytical production reproducible, transparent, auditable and less error-prone than manual processes like spreadsheets. It is promoted across the Analysis Function and ONS.

12. What is the HM Treasury Green Book?

    The Green Book is HM Treasury's guidance on how to appraise and evaluate policies, programmes and projects. It sets out the framework for assessing whether interventions deliver public value and represent value for money before and after decisions.

13. What is the 'rationale, objectives, appraisal' logic underlying the Green Book?

    Appraisal must start from a clear rationale for intervention (e.g. market failure or equity), set out SMART objectives, then appraise options against those objectives — never appraise without first establishing why government should act and what success looks like.

14. What is the 'Five Case Model' used in Green Book business cases?

    The five cases are: Strategic, Economic, Commercial, Financial, and Management. A robust business case must make a compelling argument across all five for the proposal to proceed.

15. What discount rate does the Green Book recommend for social time preference, and what does it represent?

    The standard Social Time Preference Rate (STPR) is $3.5\%$ per year for the first 30 years (declining thereafter for longer horizons). It reflects society's preference for benefits sooner rather than later, plus growth in per-capita consumption.

16. What is the Green Book formula for discounting a future value to present value?

    The present value is $PV = \frac{V_t}{(1+r)^{t}}$, where $V_t$ is the value in year $t$ and $r$ is the discount rate (the discount factor is $\frac{1}{(1+r)^{t}}$).

17. What is the Net Present Value (NPV) and its decision rule in appraisal?

    NPV is the sum of discounted benefits minus discounted costs: $NPV = \sum_{t=0}^{T} \frac{B_t - C_t}{(1+r)^{t}}$. A project is worthwhile if $NPV > 0$; among options, prefer the one with the highest NPV (social value).

18. What is the Benefit-Cost Ratio (BCR) and how is it interpreted?

    $BCR = \frac{\text{Present Value of Benefits}}{\text{Present Value of Costs}}$. A BCR greater than 1 means benefits exceed costs. It is used to compare value for money but should be read alongside NPV and non-monetised impacts.

See more Quality Assurance, Standards and the Wider Analytical Context flashcards →

Planning Quality Assurance, Standards and the Wider Analytical Context for Government Operational Research Service (GORS) Assessment

Quality Assurance, Standards and the Wider Analytical Context (Government Operational Research Service (GORS) Assessment) FAQ