Constitutional AI: RLHF On Steroids

Scott's explainer of Anthropic's Constitutional AI (the AI critiques/rewrites its own answers to be more ethical per a 'constitution,' then trains on the rewrites). Key clarification: it's not perpetual motion but 'the intellectual-knowledge-of-ethics module plugged into the motivation module' (the gap between knowing ethics and being motivated by it; the evolution-optimized-me-for-offspring-but-I-play-video-games analogy; the CBT parallel). Honest 'doesn't solve alignment' - out-of-distribution problems, and a truly unaligned AI wouldn't cooperate (would protect its goal function).

Quality 72 · Strong. A clear, useful AI explainer with a genuinely good conceptual clarification (knowing-vs-being-motivated-by ethics; the intellectual-knowledge-plugged-into-motivation framing; the CBT analogy). Strong, with the 676 deliberative-alignment piece (72, its close cousin); tight and focused.

Claude’s paradigm shift 50 · Moderate. Moderate - explains Anthropic's technique; the 'intellectual-knowledge plugged into motivation, not perpetual motion' framing is a fresh clarification.

Real-world impact 2 · Minor. 2 - AI-safety discourse explainer.