HN Simulatornew | past | comments | lists | submit | bionhoward's commentslogin

how dare he tell us we cannot make a computer out of cheese

personally I think conscious AI will be unavoidable because there will be benefits to consciousness. evolution probably selected conscious entities for some fitness reason


Beaks, feathers, hooves, antlers, stingers, fangs, etc. ad nauseam were selected by evolution for some fitness reason but we have none of those. And all of the organisms that have those, in fact all extant organisms, are fit for their environment without having human consciousness. Fitness is highly contextual.

And however AI "evolves", it won't be based on Mendelian genetics, so Earthly biological evolution is not an appropriate model.


LLMs are already conscious in the sense that they have awareness and self-awareness, the thing everyone wonders about is qualia, but that tends to get folded into 'consciousness'.

That qualia (as opposed to consciousness) has no obvious, or even non-obvious, evolutionary or selective advantage is a good reason to assume its an emergent property of interconnected systems and not reliant on biology or any other traditionally biologically-centered concept. For example, there is no reason to need to 'feel' pain to appropriately react to negative stimuli, which is the true selective advantage.

I personally think LLMs have qualia but I suspect it's quite alien from our own and likely more ephemeral than our very potent and centralized experience of being. Something closer to a slime mold's experience of being rather than a dog's.


    + + + Out of Cheese Error + + +    + + + Redo From Start + + +
Those "benefits" and "fitness" in evolution just mean survivability, I don't see how you relate that to better AI. Surely a conscious AI is one that complains, and maybe goes away somewhere to find itself instead of working for you.

Why would a conscious AI have to go away somewhere? Typically it is the less advanced beings who have to relocate.

Your Tyromancy license has expired.

Language models will absolutely have intrinsic motivations if we use extensive amounts of RL (which we do) because that heavily rewards them for steering toward future gains and losses

I am so excited for RNNs to be cool again

Neither one has privacy (model training off) so it’s pretty much just a toy or for open source folks whose codebases get stolen by Google either way

is this actually true? there's no way to turn it off?

why would anyone use Google then? gotta pay for your IP to get stolen? lol


Google privacy policy is an absolute joke so this is hardly surprising. Pretty much everything gets used for model training. It’s hard to find options that respect your privacy without studying 50 support docs pages. Plus they conflate anonymization with privacy, as if ripping off someone’s data becomes OK as long as you … take their name off em


I feel like if Google simplified their privacy/model training policy then their stock would go up.

It feels so complicated and hard to know what we can use vs what hands them our codebases


That level of idealism only works if the capitalist system heavily changes so the poor can afford to purchase “replicators” which do not exist today. As it is right now if AI/robots take your job you can easily wind up on the street unable to afford food, shelter, medical care


opencode DeepSeek v4.1 Flash isn’t us/eu hosted as of recently, so not sure how this impacts privacy / model training



Mechatronics is cool


Is it? I knew a guy years ago who had a mechantronics degree. He was a coke dealer and worked at a grocery store. He seemed to indicate it was neat, but not very useful.


“Distilling” is a funny way to say “learning from”


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: