I’ve listened to a lot of what Dario says, and he seems more grounded and skeptical on the idea of AI consciousness/“soul”
None of the AGI concerns about reward hacking, cybersecurity, bioscience, surveillance, etc. require you to believe in AI consciousness
I genuinely don't get Anthropic. It seems like every other day they're loudly puzzling over the ethics of a soul in a box - while building the box, claiming that it has a soul in it, and selling access to said box to for $20 a pop.
Like, dudes, these are incompatible positions.