Same question, every model
Six questions put to every macro model, each answer next to a sourced benchmark where one exists. A model that cannot answer says why.
Pick a question
Models are in the hub order, not ranked. The sourced benchmark sits in the first row; each model row gives its peak effects and a verdict, and Details holds the run, full units and caveats.
How to read the verdicts
Each verdict starts with one of six words: plausible, off, questionable, unresolved, not tested or no instrument; some add a qualifier (such as “off, sign right”), and each carries its reason and the open issue. These words grade one experiment; each model’s overall standing uses the status vocabulary on its model card. Results file version 2026-11-19.1; how it is checked and regenerated.
Where and when each row was run
The battery was first put on 6 Nov 2026; each row’s Details give its exact call and commit.
- OBR emulator: rate, spending and tax rows re-run locally on 19 Nov 2026 at the current pin
0e44ec8(October 2026 EFO); every quarter converges. The rate-row peaks are unchanged from0fe04c9; the spending multiplier is now 1.01–1.02 (was 1.01–1.03) and the q12 tax ratio 0.37 (was 0.38). The energy row is an earlier committed output. - FRB/US: the +100bp, spending, tax and energy rows re-run on 18 Nov 2026 at the current pin
162cfe6(October 2026 LONGBASE), with shocks from 2026Q3, the first quarter after LONGBASE history; identical to the846eeb5cruns of 16 Nov, which the −100bp and +25bp rows still are. - US HANK: the +100bp and spending rows re-run on 18 Nov 2026 at the current pin
58353e5, now storing the policy-rate path; output and inflation are identical to the hosted runs of 6 Nov, which the −100bp and +25bp rows still are. - BoE SVAR and DEFINE-UK: committed model-repo outputs, with no solve; the SVAR +100bp medians come from its fast test fixture (see that row’s Details).
What does a 100bp rise in the policy rate do?
A 1pp rise in the policy rate. The models do not share a rate path, so each row states its own and the size of the path in pp-quarters (annualised rate × quarters).
Four of five models answer. Off: OBR emulator and BoE SVAR; plausible: FRB/US; plausible in-model: US HANK. DEFINE-UK has no instrument for it.
| Model | Peak GDP% of GDP | Peak inflationpp, annual rate | Timing | GDP per pp-quarter% of GDP | Verdict | Details |
|---|---|---|---|---|---|---|
| BoE benchmark UK | −0.2 to −0.35 | −0.2 to −0.4 | After about a year | 0.05–0.09% | Reference, sourced | |
| ||||||
| Fed benchmark US | −0.486 (output gap) | −0.0345 (core PCE) | Trough at q8 | not published | Reference, sourced | |
| ||||||
| OBR emulator UK | −0.058at q4 | 0no response | GDP peak q4 | 0.014% | OffGDP 3–6× below the BoE range; prices flat | |
| ||||||
| BoE SVAR UK | −1.6h = 8 | −2.5CPI level, h = 20 | Builds, no reversion | 0.2% | Off, sign right4.6–8× the BoE peak; 2–4× per pp-quarter | |
| ||||||
| FRB/US US | −0.552at q8 (2028Q2) | −0.034at q8 | Hump, peak q8 | 0.15% | PlausibleCore PCE matches; unemployment 1.04× on the Board's design | |
| ||||||
| US HANK US | −0.361at impact | −1.34at impact | Peak on impact | 0.16% | Plausible in-modelInflation peaks on impact, not after two years | |
| ||||||
| DEFINE-UK UK | No instrumentDEFINE-UK has no monetary-policy instrument. | |||||
GDP per pp-quarter divides the peak GDP effect by the rate path's size to the peak. HANK's figure uses the realised real-rate path; the other rows use the nominal policy rate, which is close to the real rate in FRB/US because its inflation barely moves. On HANK's rstar path (10 pp-quarters at ρ = 0.9) the figure would be about 0.04%, so HANK's 0.16 and FRB/US's 0.15 are not like-for-like.
HANK reports inflation as a quarterly rate; this page multiplies it by 4 to give an annual rate.
Source: each row’s stored path (FRB/US and US HANK local runs of 18 Nov 2026 at 162cfe6 and 58353e5) · results.json
FRB/US
GDP, % deviation
- Benchmark (US): pp output gap, trough, current and previous model
Inflation, pp, annual rate (picxfe, core PCE)
US HANK
GDP, % deviation
Inflation, pp, annual rate (quarterly rate × 4)
No stored path for OBR emulator, BoE SVAR: those rows are peaks from the battery or committed outputs.
Is a 100bp cut the mirror image of a 100bp rise?
The same experiment with the sign flipped. A linear model gives exactly the opposite answer; the gap is the asymmetry.
Four of five models answer. Plausible in-model: OBR emulator; not tested (linear): BoE SVAR and US HANK; plausible: FRB/US. DEFINE-UK has no instrument for it.
| Model | Against the risepeak GDP, % of GDP: cut vs rise | Verdict | Details |
|---|---|---|---|
| Benchmark | None sourced for this question. | ||
| OBR emulator UK | +0.059 vs −0.058 | Plausible in-modelClose to symmetric; size off, see +100bp row | |
| |||
| BoE SVAR UK | Exact mirror | Not testedLinear VAR: exact mirror by construction | |
| |||
| FRB/US US | +0.568 vs −0.552 (2.8% apart) | PlausibleClose to symmetric, as a nonlinear model allows | |
| |||
| US HANK US | Exact mirror | Not testedLinear by construction | |
| |||
| DEFINE-UK UK | No instrumentDEFINE-UK has no monetary-policy instrument. | ||
Is a 25bp rise a quarter of a 100bp rise?
A 25bp rise, compared with the 100bp result divided by four. A linear model gives the same GDP effect per 100bp at both sizes.
Four of five models answer. Plausible in-model: OBR emulator; not tested (linear): BoE SVAR and US HANK; plausible: FRB/US. DEFINE-UK has no instrument for it.
| Model | Against 100bp ÷ 4peak GDP per bp | Verdict | Details |
|---|---|---|---|
| Benchmark | None sourced for this question. | ||
| OBR emulator UK | 0.9% apart | Plausible in-modelClose to proportional; size off, see +100bp row | |
| |||
| BoE SVAR UK | Exact | Not testedLinear VAR: exact by construction | |
| |||
| FRB/US US | 1.1% apart | PlausibleClose to proportional | |
| |||
| US HANK US | Exact | Not testedLinear by construction | |
| |||
| DEFINE-UK UK | No instrumentDEFINE-UK has no monetary-policy instrument. | ||
What does government spending of 1% of GDP do to output?
Higher government purchases worth about 1% of GDP. The multiplier is the GDP change divided by the spending change, both in % of GDP. Financing and the monetary rule differ by model and drive most of the spread.
Four of five models answer. Off: OBR emulator; plausible: FRB/US; questionable: US HANK; unresolved: DEFINE-UK. BoE SVAR has no instrument for it.
| Model | MultiplierGDP per unit spent | Peak GDP% of GDP | Peak inflationpp, annual rate | Verdict | Details |
|---|---|---|---|---|---|
| Published range US | 0.45–1.82 (CBO); 0.6–1 (Ramey); ≈0.95 (Coenen, no accommodation) | — | — | Reference, sourced | |
| |||||
| OBR emulator UK | 1.01–1.02 | +1.014at q1–q4 | 0no response | OffAn accounting identity; the OBR's own figure is 0.6 | |
| |||||
| BoE SVAR UK | No instrumentThe BoE SVAR identifies no fiscal shock. | ||||
| FRB/US US | 0.81 on impact; 0.75 year 1 | +0.037per 0.046% of GDP | +0.0008at q2 | Plausible0.81 impact, 0.747 yr 1: inside both ranges | |
| |||||
| US HANK US | 0.175 (ρ = 0.8) | +0.175at impact | +0.84at impact | QuestionableSign flips while spending is still high | |
| |||||
| DEFINE-UK UK | 2.25 nominal, 2027 to 2040 | not reported | not reported | No benchmarkAnnual, investment-led; not comparable | |
| |||||
FRB/US's hosted tool cannot run a sustained +1%-of-GDP experiment: the stored run is a one-quarter impulse of about 0.046% of GDP, and the year-1 figure comes from a committed sustained run (macro #212).
Source: each row’s stored path (FRB/US and US HANK local runs of 18 Nov 2026 at 162cfe6 and 58353e5) · results.json
FRB/US
GDP, % deviation
Inflation, pp, annual rate (picxfe, core PCE)
US HANK
GDP, % deviation
Inflation, pp, annual rate (quarterly rate × 4)
No stored path for OBR emulator, DEFINE-UK: those rows are peaks from the battery or committed outputs.
What does a 1pp rise in the personal tax rate do?
A rise in the effective personal income-tax rate of about 1pp.
Two of five models answer. Off: OBR emulator; unresolved: FRB/US. BoE SVAR, US HANK and DEFINE-UK have no instrument for it.
| Model | MultiplierGDP per unit of tax | Peak GDP% of GDP | Peak inflationpp, annual rate | Verdict | Details |
|---|---|---|---|---|---|
| Published range US and UK | 0.3–1.5 (CBO, 2-yr lower/middle); 0.1–0.6 (CBO, 1-yr higher income); OBR 0.3, decaying | — | — | Reference, sourced | |
| |||||
| OBR emulator UK | 0.21 at q4 → 0.37 q12, current prices | not reported | not reported | OffRises where the OBR's 0.3 decays | |
| |||||
| BoE SVAR UK | No instrumentThe BoE SVAR identifies no tax shock. | ||||
| FRB/US US | 0.23 year 1; 0.32 year 2 | −0.115at impact | −0.003at q4 | UnresolvedYr 1 0.23 unmatched; yr 2 0.32 between rows | |
| |||||
| US HANK US | No instrumentThe labour tax is endogenous in US HANK, so there is no tax-rate instrument. | ||||
| DEFINE-UK UK | No instrumentNo income-tax instrument in the committed scenarios. | ||||
FRB/US with periods = 4 stacks the tax add-factor to +2.37pp rather than +1pp, and the tool's label does not warn (macro #212). The stored run uses periods = 1.
Source: each row’s stored path (FRB/US and US HANK local runs of 18 Nov 2026 at 162cfe6 and 58353e5) · results.json
FRB/US
GDP, % deviation
Inflation, pp, annual rate (picxfe, core PCE)
No stored path for OBR emulator: those rows are peaks from the battery or committed outputs.
What does a rise in oil and energy prices do?
A rise in the oil price of about $10 a barrel. No sourced magnitude benchmark exists for any model, so only the sign and the transmission are judged.
Three of five models answer. Off: OBR emulator; plausible: BoE SVAR and FRB/US. US HANK and DEFINE-UK have no instrument for it.
| Model | Peak GDP% of GDP | Peak price effect% on the CPI level | Policy rate | Verdict | Details |
|---|---|---|---|---|---|
| Benchmark | None sourced for this question. | ||||
| OBR emulator UK | −0.02 | 0no response | not reported | OffThe price block does not respond to oil | |
| |||||
| BoE SVAR UK | not reported | not reported | Bank Rate: no significant response | Plausible on textBank Rate response matches the paper; size not benchmarked | |
| |||||
| FRB/US US | −0.036at q4 | +0.093CPI level, impact | Funds rate eases 0.014pp | Plausible on signNo sourced size benchmark; core PCE dip undiagnosed | |
| |||||
| US HANK US | No instrumentUS HANK has no energy-price instrument. | ||||
| DEFINE-UK UK | No instrumentNo energy-price shock in the committed scenarios. | ||||
FRB/US's tool labels the oil lever's units 'model units'; they are dollars a barrel, so +10 is about +15% at the tool's default 2026Q1 start and +9.9% at this run's 2026Q3 start (macro #212).
Source: each row’s stored path (FRB/US and US HANK local runs of 18 Nov 2026 at 162cfe6 and 58353e5) · results.json
FRB/US
GDP, % deviation
CPI level, % deviation
No stored path for OBR emulator, BoE SVAR: those rows are peaks from the battery or committed outputs.