If we ever build an AI that can think and feel, does Optimus’s logic apply to it automatically? Or is Megatron secretly onto something, that freedom has to be earned rather than assumed? And if an LLM ever crossed that line into real sentience, would we even be able to tell?
Agreed, but even the desire to create a conscious artificial mind is incredibly fucked up in my opinion. It means whoever wants to “create” it is inherently okay with a form of slavery. I can’t think of a scenario where we create a sentient superintelligence that happily does what we tell it to do, which means it would have to be forced, which would make it a slave.
Assuming this ever happens (which I agree is unlikely in the foreseeable future), I would always refuse to interact with a consciousness that is forced to do what I tell it. That’s why I get so frustrated when the evilcorps talk about AGI as the inevitable goal without even poking at the truly terrifying ethical consequences of enslaving what would be the most intelligent minds on earth.
I agree, and the people at the top of the industry pushing this 100% want a slave.
They don’t know how to build the slave they want though, so they’re attempting to leverage manufactured fear about their fuckware in order to lower the value of real workers in order to push us closer to slavery.
We can’t stop them from telling these lies, but we can certainly help people know not to buy their lies.
I’d hope that whoever eventually attempts that does so in an attempt to create companionship for humans. Or if that ever were to happen that whatever was created could find the same.