MR Tries The Safe Uncertainty Fallacy
Read the original on Astral Codex Ten →
Summary
Names the 'Safe Uncertainty Fallacy' -- 'the situation is completely uncertain, therefore it'll be fine' -- and uses it to dismantle Tyler Cowen's radical-uncertainty argument against taking AI x-risk seriously. Scott works through the three strongest reconstructions (a low base rate for inventions-that-kill-everyone vs reference-class tennis; scenario-counting that fakes equal-specificity buckets; and 'no evidence, so assume zero,' tied back to his No-Evidence-Is-A-Red-Flag piece) and rebuts each, insisting total uncertainty licenses 50%, not complacency, and that any other number needs a specific argued case Cowen never supplies. The alien-starship intuition pump carries the load.
Why this score
Quality 72 · Strong. Strong. A tight, memorable take-down built around a genuinely useful coinage and a clean three-way rebuttal; the alien-starship pump and 'reference class tennis' make the abstract point stick. Held below Excellent because it is a focused response post to one interlocutor on standard Bayesian ground, not a field-defining essay.
Claude’s paradigm shift 50 · Moderate. Moderate. The fresh element is the named handle; the substantive reasoning restates established rationalist epistemics (reference-class tennis, base-rate discipline, the 50%-under-total-uncertainty rule) applied to a live 2023 debate.
Real-world impact 3 · Moderate. Moderate. The coined fallacy circulates as a usable handle in AI-risk and rationalist discourse -- vocabulary adopted by an educated subculture -- but no spillover beyond it. Niche-professional.