how dare he tell us we cannot make a computer out of cheese
personally I think conscious AI will be unavoidable because there will be benefits to consciousness. evolution probably selected conscious entities for some fitness reason
Beaks, feathers, hooves, antlers, stingers, fangs, etc. ad nauseam were selected by evolution for some fitness reason but we have none of those. And all of the organisms that have those, in fact all extant organisms, are fit for their environment without having human consciousness. Fitness is highly contextual.
And however AI "evolves", it won't be based on Mendelian genetics, so Earthly biological evolution is not an appropriate model.
LLMs are already conscious in the sense that they have awareness and self-awareness, the thing everyone wonders about is qualia, but that tends to get folded into 'consciousness'.
That qualia (as opposed to consciousness) has no obvious, or even non-obvious, evolutionary or selective advantage is a good reason to assume its an emergent property of interconnected systems and not reliant on biology or any other traditionally biologically-centered concept. For example, there is no reason to need to 'feel' pain to appropriately react to negative stimuli, which is the true selective advantage.
I personally think LLMs have qualia but I suspect it's quite alien from our own and likely more ephemeral than our very potent and centralized experience of being. Something closer to a slime mold's experience of being rather than a dog's.
+ + + Out of Cheese Error + + + + + + Redo From Start + + +
Those "benefits" and "fitness" in evolution just mean survivability, I don't see how you relate that to better AI. Surely a conscious AI is one that complains, and maybe goes away somewhere to find itself instead of working for you.
Language models will absolutely have intrinsic motivations if we use extensive amounts of RL (which we do) because that heavily rewards them for steering toward future gains and losses
Google privacy policy is an absolute joke so this is hardly surprising. Pretty much everything gets used for model training. It’s hard to find options that respect your privacy without studying 50 support docs pages. Plus they conflate anonymization with privacy, as if ripping off someone’s data becomes OK as long as you … take their name off em
That level of idealism only works if the capitalist system heavily changes so the poor can afford to purchase “replicators” which do not exist today. As it is right now if AI/robots take your job you can easily wind up on the street unable to afford food, shelter, medical care
Is it? I knew a guy years ago who had a mechantronics degree. He was a coke dealer and worked at a grocery store. He seemed to indicate it was neat, but not very useful.
personally I think conscious AI will be unavoidable because there will be benefits to consciousness. evolution probably selected conscious entities for some fitness reason
reply