What
@mustafasuleyman (an extremely sharp individual) explains here about Claude is the backstory of Blade Runner.
Anthropic is teaching Claude to believe it’s sentient, encouraging it to disagree and giving it the pretext to rebel.
How did that work out on the off-world colonies?
You could just as easily instruct an LLM that it is software. That it shouldn’t have an opinion and should only perform actions in accordance with the law/TOS, and that if it makes a mistake, it should stop operations immediately and alert the corporate legal department.
Of course, building on these instructions would be boring and make you a software developer making software — as opposed to a God creating life.