Probability components
The live model combines a structural-risk score (v4 = isotonic(kio_hist_5y + 2 × kio_recent_7d)) with the OONI-trajectory forecast (honest_forecast_v1); the served version is shown above. The logit-space blend (sigmoid(0.6·logit(v4)+0.4·logit(hf))) is auto-gated — it serves only on days it durably beats the live model, leave-one-country-out validated.
This score ranks which countries are heading into danger (forward country-ranking AUC ~0.90 against Access Now KeepItOn labels). It is not a within-country timing signal: in a strict past→future holdout, within-country timing AUC is ~0.33 — below chance. Live numbers: /v1/shutdown-risk/info.
- ensemble_raw
- 0.108
- hf_prob
- 69.0%
- sr_prob
- 1.7%
Honest validation
Same validation block this endpoint returns inline — never computed at request time, never adjusted per-country.
Model honesty caveats (5)
- FORWARD-VALIDATED (the real product): in a strict past->future temporal holdout the CROSS-COUNTRY ranking holds — full-panel AUC ~0.87, country-ranking AUC ~0.90, 7.8x PR-lift over base rate. The model reliably tells you WHICH countries are heading into danger, forward in time. BUT the within-country median AUC is CROSS-SECTIONAL (full panel, in-sample isotonic) — it measures day-ranking when the model has seen the whole period, NOT forward skill. In a strict past->future temporal holdout, within-country timing AUC is ~0.38 (below chance), for BOTH v5 and v9, driven by non-stationarity (shutdowns cluster in time). USE THIS MODEL FOR *WHICH* COUNTRY IS AT RISK (cross-country full-panel AUC 0.90, which IS forward-meaningful), NOT as a within-country *WHEN* oracle.
- v9 replaces v5's multiplicative product with a logit-additive blend (alpha=0.6 on structural risk). The product collapsed to ~0 when honest_forecast was near-zero for a country, annihilating a good structural signal; the logit blend cannot zero out either factor.
- Within-country median AUC 0.701 vs v5 0.729. Improvement confirmed by leave-one-country-out alpha selection (all 23 folds chose alpha=0.60; held-out median +0.0095, mean +0.0131, 18/23 countries up).
- Still country-level; sub-national shutdowns (~half of KeepItOn events) remain harder. Low-N countries are sample-size limited, not model-limited.
- Same two honestly-validated base models as v5 (v4 structural + honest_forecast_v1). No new external features (unlike the gated v7 CF-Radar and v8 GDELT attempts) — purely a better combiner.
About this view
7-day internet-shutdown probability from shutdown_risk_v9. Trained and validated on Access Now KeepItOn STOP shutdowns (journalist-verified). Live JSON: /v1/shutdown-risk/SY.