Get ready.

seriously, what the heck did they see internally at anthropic?

We are at the dawn of Superintelligence. Introducing the Recurrent Looped Transformer (RLT), We now have Transformers with Infinite Reasoning depth. From now on, we should pace progress at the Open Frontier of Superintelligence, Until Safe Superintelligence is achieved. github.com/yifanzhang-pro/re…

Dario has written that we need to “pace the frontier,” and Sam has agreed. People may be surprised by my response: go ahead. You guys are the frontier. By any reasonable metric — market share, revenue growth, model capability — the two of you have a duopoly on frontier intelligence. You’ve also claimed the lead is widening because of recursive self-improvement. I don’t see what you see in the lab. If the unreleased models are scary enough that you think you should slow down, I support your decision to be responsible. But stop pretending you need anyone else’s permission. Stop pretending antitrust law has to be suspended so you can form a cartel. Stop pretending you need a regulatory approval process that supersedes product liability. Stop pretending METR is independent when it is intertwined with Anthropic’s investors and staff. Stop pretending you need those same evaluators to police competitors who aren’t even at the frontier. Most of all, stop pretending the motivation to slow down is purely altruistic. You face massive product-liability exposure if your products enable a truly damaging cyberattack. The market already punishes models that behave in unpredictable or unauthorized ways. After the Hugging Face episode, it is simply good business for OpenAI and Anthropic to trade some raw power for reliability and predictability. Call it alignment if you want. It is also just giving customers what they want. Pacing the frontier would also create breathing room for a more intelligent conversation about regulation than Bernie Sanders’ “shut it all down.” China is very unlikely to join a global agreement, as you know, and that has to be taken into account as well. So go ahead and pace the frontier. You are the ones setting it. The easiest way not to build superintelligence is for you to agree not to build it. Demanding your preferred regulatory framework as the price of that will look like blackmail of the public and the political system. So just do it. If you do, you’ll buy goodwill for the next conversation. If you don’t, we’ll know this was just another bid for regulatory capture — or an election-season psyop.

EA AI safetyism increasingly looks like Marxism-Leninism for the algorithmic age. The old vanguard claimed privileged knowledge of the inevitable course of History. The new one claims privileged knowledge of the probabilistic course of Humanity. Both use an elaborate intellectual framework to reach the same political conclusion: a small group of enlightened people must constrain everyone else for their own good. That has never lead to anything except monumental human suffering.

Not only I am tired of these wild AI speculations of impeding doom from self important people: I resent them. I actively resent people proposing to crash the economy or proposing authoritarian control over my life and other people's lives with idiotic and dangerous ideas like chip control or bans or tracking researchers. Every idiot in history who's taken the approach of "the ends justify the means" to solve an imaginary future disaster created the very disaster they wanted to stop. See Population Bomb leading to the one child policy and Communism leading to Mao's mass famines and Fascism leading to the death of tens of millions of people and war. These solutions are evil and worse than any disease that they propose to solve. It you believe you can actually predict the end of the world then you are as insane as the Heaven's Gate cult that killed themselves in the 90s thinking UFOs were coming to transcend them. Not only should we not take your policies and fear mongering seriously, we should actively throw out any and all of your proposed solutions because they come from a place of delusion. I don't give a shit that you work in the industry or think you saw something or that you want to virtue signal on X. You are actively contributing to a horrible future based on baseless speculation that has no grounding in reality. Don't confuse expertise in a domain with ability to predict impact of that domain or frankly to make predictions a decade out better than a dart throwing monkey. They are orthagonal skills. How's Hinton's "we don't need to train Radiologists anymore" working out? How did the Population Bomb work out? The global cooling second ice age? Peak oil? Just because someone is a bridge engineer does not mean they can predict the impact of bridges on society or that they have any actually useful insight at all on the complex, ever changing system called life. There are people dying in wars right now. Children starving. Homelessness. Dictatorships. In short, real problems. And we're supposed to drop everything to stop a made up problem in your head? Pound sand. We don't care. And we are not going to remake society based on you scary monsters under the bed delusion.

I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.

We’re launching AlphaGenome Atlas: an AI-powered searchable database mapping the predicted impact of all 9 billion possible single-letter DNA changes. Here’s how it could help researchers better understand our biology 🧵