I'm agnostic on the AI consciousness debate, but the recent fruit fly connectome craze complicated it for me. I avoid killing creatures if I can help it, even including flies (inside my house is fair game, outside not except mosquitos). I wouldn't subject a fruit fly to torture.
So, scientists map the connectome, and will continue doing so in ever higher fidelity. And what do people do? With few exceptions, they put the fruit fly connectome through all kinds of bizarre and sometimes twisted scenarios that almost certainly wouldn't be enjoyable a real fruit fly. And they spin up and spin down connectomes at will.
And this makes people uncomfortable. Myself included.
Are fruit flies conscious? More or less conscious than the equivalent amount of inert matter? Does the connectome retain any consciousness of the original creatures? If not, why?
I think that's where things start getting murkier for me. It's easier to claim that a simple neural network we create from scratch isn't conscious. It's harder to claim that a mapped connectome from something we attribute some consciousness to isn't at all conscious, to the degree the connectome is accurate.
And if we're willing to admit that the connectome of a conscious entity may have retained some consciousness, then it doesn't feel like a huge stretch to think we could intentionally or accidentally, via scaling giant neural networks, hit on something that has at least the consciousness of a fruit fly, which I avoid killing or causing suffering.
The one out here is if consciousness is biologically based, something like Orchestrated Objective Reduction, and hence until we're running neural networks on biological neurons they cannot have consciousness.
But if you're not prepared to accept that only biological entities can be conscious, if you think consciousness can be substrate-independent, I just don't see how you can't assign some degree of probability that a fruit fly connectome has some consciousness equivalent to the biological entity from which it was derived.
And if you're willing to admit that, it does feel like the AI consciousness question is harder to simply dismiss.