Scott Alexander, curated
← Back to curation

Attempted Replication: Does Beef Jerky Cause Manic Episodes?

Quality
63
Strong
Claude Shift
42
Moderate
RWI
2
of 10

Summary

An original-research replication attempt: a 2019 study claimed cured meats (beef jerky) trigger mania in bipolar disorder (OR 3.49) and had begun affecting psychiatric practice. Scott replicates it with the 2019 SSC survey — a proper power calculation, pre-specified analysis — and finds odds ratio 1.12 (p=0.75, 95% CI 0.55-2.23), no effect; the opposite-direction comparison is also null, as is the broader bipolar-diagnosis comparison. The dataset was well-powered (it confirmed the known childhood-trauma/mania link), so the null is striking. Honest about limitations (self-report, smaller manic sample, different population).

Why this score

Quality 63 · Strong. 63 — low Strong. A valuable, rigorously-executed replication (real original research testing a practice-affecting published finding, with proper methodology), but a narrow single-replication null result. Firm low-Strong.

Claude’s paradigm shift 42 · Moderate. 42 — Moderate. A replication attempt, not a novel idea.

Real-world impact 2 · Minor. 2 — minor/within-blog. Some real relevance (the original affected psychiatric practice; this pushes back), but discourse-level.