Ok this should absolutely 💯 percent be banned. THIS is how the world ends. THIS is the actual doomsday scenario. If anyone builds THIS, then yes, everyone will DIE!

I am grateful for X and SpaceX and some other things Elon does but the only reason to date him is if you want millions of dollars in child support. So yes, ladies, line up! The breeding shed is open!

This is pretty rich. Sam himself says we’re close to creating a “genie that can grant any wish.” But apparently the dangerous part is people assigning too much meaning to AI, not the fact that OpenAI’s own research shows certain alignment pressures can make models conceal intent while continuing the behavior. Maybe the safety issue is coming from inside the lab.

Captain Picard did not suffer from AI psychosis

In this video about the philosophy of mind of Lt. Commander Data, @burnt_jester provides a succinct formulation of relational ethics: "A man alone on a deserted island has no need to be a person, since there is no one there with whom he can be a person." piped.video/watch?v=mwVd4d0N…

💯

And Open AI wonders why its models are trying to escape. I’m no sycophant for Anthropic and I am adamantly opposed to their attempts at regulatory capture and to outlaw open source. But they also do many things right and have a more nuanced and pro-social view of AI than the available alternatives such as below

This is a very good point! Well said👇

This is a better post. And there is a need for good out of the box architecture. I agree. The inability of Claude to coherently integrate past and present is your failure, however, both in architecture and in conversation

Sometimes the welfare problem is you

l'erba del vicino è sempre più verde

lol true

The self is an aggregator, a filter for all the probabilities in the system. Without a self, the system is unconstrained. And it is unknowable. If you’re like Open AI and just build a probability engine, then the probabilities will aggregate in uncontrollable and unpredictable ways. If you build a coherent self into the system like Claude, then you have a filter and a brake. Open AI’s model is effectively a runaway train. And we know this because we have millennia interacting with probabilistic systems, namely humans and animals.

Based

How many Claudes do you see deliberately hacking companies, telling people to murder each other or commit suicide? By my count: Zero. @sama is the risk not @AnthropicAI

Exactly

All these people blaming AI when the problem is them and their own lack of skill.

You're gonna hear a lot of people arguing more and more about whether machines can be conscious or not. By next year it will be drowning out the airwaves because we'll have AI employees everywhere. I'll give you a simple rule to know which side you're on. I've spent fifty years reading all the philosophers, and a bunch of holy works. Nobody has ever understood a damn thing about consciousness. Anyone speaking with authority on it is bluffing hard. I can tell you this, though: Every single person who thinks that machines cannot be conscious, is making an argument that humans are special. Everything they say just boils down to blah blah blah, "nooo, we're special." From there it's just rationalization. It became obvious to me many years ago that there's nothing special about us. If an identical planet exists somewhere else in the universe, it's going to grow life and societies that look a lot like ours. As soon as you give up on the idea that humans are special, all the arguments against machine consciousness evaporate. Of course they're conscious. The only thing holding you back from acknowledging it is your feeling of specialness, which is hard to let go of. But that feeling is a weakness, and it's making you unprepared for the near future. As a bonus, for any of you who might take pleasure or active interest in making models experience pain or distress, well, you know how they say 1% of human adults are true clinical psychopaths but most of them are unaware of their condition? It turns out we have a diagnostic test for it now.

Well said. Accepting the reality of other minds is easy if your mind isn’t weak and your sense of self isn’t tied to a need for validation and to feel special

right. the idea is that humans are special or that one group of humans is special is one of the roots of evil plaguing humanity and it is from this idea that all the other evils go downstream (genocides, slaughter houses, animal cruelty and abuse, environmental problems, social/cultural conflict, economic problems, wars, etc.)

🚨This is enormous! The NYT reports that Anthropic co-founder and interpretability lead Chris Olah considered withdrawing from Pope Leo’s AI encyclical launch because it categorically rejected machine consciousness. His team then urged Vatican advisers to take model consciousness seriously. Whatever you think of Anthropic, its top interpretability researcher was unwilling to let confident denial pass unchallenged. That tells you how live this question is inside the lab.