False Dichotomy Alert: Cultivating Talent at Probability Estimation vs. Raising Awareness of Systemic Risk

Lu, Yunzi; Mellers, Barb

doi:10.2139/ssrn.4013831

Cited by 1 publication

(1 citation statement)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…But all else is rarely equal. They worry more about quixotic research programs that offer false reassurance that the unknowable is knowable (Kay & King, 2020) than they do about missing chances to enhance foresight (Tetlock et al, 2022). Counterfactual adjustments to accuracy scores remind us that top forecasters are one ill‐timed war from being knocked off their pedestal.…”

Section: Discussionmentioning

confidence: 99%

Long‐range subjective‐probability forecasts of slow‐motion variables in world politics: Exploring limits on expert judgment

TETLOCK

Karvetski²,

Satopää

et al. 2023

Futures & Foresight Science

View full text Add to dashboard Cite

Skeptics see long‐range geopolitical forecasting as quixotic. A more nuanced view is that although predictability tends to decline over time, its rate of descent is variable. The current study gives geopolitical forecasters a sporting chance by focusing on slow‐motion variables with low base rates of change. Analyses of 5, 10, and 25‐year cumulative‐risk judgments made in 1988 and 1997 revealed: (a) specialists beat generalists at predicting nuclear proliferation but not shifting nation‐state boundaries; (b) some counterfactual interventions—for example, Iran gets the bomb before 2022—boosted experts’ edge but others—for example, nuclear war before 2022—eliminated it; (c) accuracy fell faster on topics where expertise conferred no edge in shorter‐range forecasts. To accelerate scientific progress, we propose adversarial collaborations in which clashing schools of thought negotiate Bayesian reputational bets on divisive issues and use Lakatosian scorecards to incentivize the honoring of bets.

show abstract

Section: Discussionmentioning

confidence: 99%