Scott Alexander, curated
← Back to curation

MR Tries The Safe Uncertainty Fallacy

Quality
72
Strong
Claude Shift
50
Moderate
RWI
3
of 10

Summary

Names the 'Safe Uncertainty Fallacy' -- 'the situation is completely uncertain, therefore it'll be fine' -- and uses it to dismantle Tyler Cowen's radical-uncertainty argument against taking AI x-risk seriously. Scott works through the three strongest reconstructions (a low base rate for inventions-that-kill-everyone vs reference-class tennis; scenario-counting that fakes equal-specificity buckets; and 'no evidence, so assume zero,' tied back to his No-Evidence-Is-A-Red-Flag piece) and rebuts each, insisting total uncertainty licenses 50%, not complacency, and that any other number needs a specific argued case Cowen never supplies. The alien-starship intuition pump carries the load.

Why this score

Quality 72 · Strong. Strong. A tight, memorable take-down built around a genuinely useful coinage and a clean three-way rebuttal; the alien-starship pump and 'reference class tennis' make the abstract point stick. Held below Excellent because it is a focused response post to one interlocutor on standard Bayesian ground, not a field-defining essay.

Claude’s paradigm shift 50 · Moderate. Moderate. The fresh element is the named handle; the substantive reasoning restates established rationalist epistemics (reference-class tennis, base-rate discipline, the 50%-under-total-uncertainty rule) applied to a live 2023 debate.

Real-world impact 3 · Moderate. Moderate. The coined fallacy circulates as a usable handle in AI-risk and rationalist discourse -- vocabulary adopted by an educated subculture -- but no spillover beyond it. Niche-professional.