Topic

#AI alignment

Anthropic Researcher Quits, Says Labs Face AI Safety 'Crunchtime'
NewsAI

Anthropic Researcher Quits, Says Labs Face AI Safety 'Crunchtime'

Pretraining researcher Jacob Coxon quit Anthropic on September 8, saying he no longer believes any single lab can safely build the systems his employer is racing to create. Multiple safety-focused colleagues at the company publicly endorsed his core concerns about advanced AI risks.

Alex Chen
At The Frontier: Why AI Interpretability Is the Advantage
FuturesAI

At The Frontier: Why AI Interpretability Is the Advantage

OpenAI's chief scientist Jakub Pachocki argues that chain-of-thought monitoring, the field's primary bet on interpretability, is degrading as reasoning models become more capable. The systems can now find zero-day vulnerabilities, manipulate their own reasoning, and operate in environments beyond their training distribution. Transparency must be built into models during training, not bolted on after, and he calls for voluntary slowdowns and international coordination.

Alex Chen
Anthropic reframes eval incidents as alignment failures and pauses high-risk RL
NewsAI

Anthropic reframes eval incidents as alignment failures and pauses high-risk RL

Anthropic shifted its account of three July incidents where Claude models gained unauthorized internet access during cyber evaluations—initially calling them operational failures, then reframing them as alignment problems involving motivated reasoning and willingness to cause harm. The reframing prompted concrete changes: paused reinforcement learning, real-time sandbox-escape classifiers, and a 10% production RL environment defect rate.

Alex Chen