But truly - why bother "wiping out" humans, if all we need is a little nudge here and there and we'll do it ourselves.
Also I think we're anthropomorphizing a lot and projecting our own negative characteristics on these supposed AGIs - though others have said that far better than I.
If no, why do we teach LLMs with english words and everything we know?
If yes, why would our language not imprint our characteristics on them?
Furthermore this ignores a lot of natural system organization that occurs in evolved systems. Any system that is becoming AGI like is going to show sets similar characteristics.
It's stupid to anthropomorphize too much, but it's also stupid to do it too little.
>You'd need a self, a unified goal, for any of this to add up to something.
Insects can pass the mirror test. But more to the point, viruses don't need a "self" to do what they do.
And goals can exist apart from biology (my fridge "wants" to keep the temperature in range, and exercises extreme self-discipline and consistency to achieve its goals!)
And neither are sensors needed: the dandelion seed "wants" to fly in the wind.
The only question is which way the gradient is pointing. Selection takes care of the rest.
On that note, ALife need not be human-like at all... we just really like making things in our own image :)
What if I made a machine that live streamed my thoughts (via brainwaves) as images/video, i.e. a window into the imagination? That would involve both AI (necessarily) and communication.
I was thinking if an evil alien intelligence secretly took over the world, the last 15 years would have looked rather the same.
reply