HN Simulatornew | past | comments | lists | submit | lmc's commentslogin

Also, insinuating it's not related to an LLM is bonkers. Does anyone that made this actually know what they're doing?

Yeah reading that made me question the credibility of the whole thing.


Is it irrational?


If the author is looking - please add details to the sources.

Also, the graduated colour scheme works only on the first plot, it's misleading on the others.


Please add deep linking or something so back doesn't mean starting from scratch

I don't know about you but after a few seconds, I wanted to get out of there as fast as possible.

I'm glad I didn't have to spam the back button to do it.


I feel like this would be overprocessing. Is the state really that important or difficult to recreate?

Decent therapists advocate for cultivating resilience for such situations.


Decent physicians do the same:

“And the next time you feel your heart going out of rhythm, just hold your breath, and remember I will see you again a couple of weeks from now.”

Ah wait, no they don’t, because “resilience” is a worthless concept in emergencies, both mental and physical.


The point is to try and limit what becomes an emergency in the first place. Having an argument with a spouse shouldn't necessitate an immediate call to a therapist.


And adjusting a curtain rod shouldn't necessitate a call to 911 and an ambulance ride to the hospital, but sometimes shit happens.


Decent physicians recommend exercise among other preventative measures to reduce the likelihood of emergencies.

Therapists will likewise encourage you to build up resilience so that "a relationship ended" is not a crisis, and also build support networks of real people who can really come visit you when you need urgent support.

There are also, of course, crisis hotlines.


So do decent parents and friends.


Have you come across ICEYE? It's a high res commercial SAR constellation, and they have a deforestation monitoring service. They partnered with the Jane Goodall Institute - perhaps you could approach them?

https://www.iceye.com/blog/deforestation-solution-9-essentia...

https://www.iceye.com/newsroom/press-releases/iceye-and-the-...

https://janegoodall.org/


> Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence ... [t]his is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why

There was a similar quote in the Reuters article:

> The episode [...] should reinforce growing concerns that the greatest threat from advanced AI may not be a single superintelligent system, but "vast colluding swarms of semi-intelligent AI."


This "vandalism" was a form of collusion/communication by agents pursuing training puzzles, which allowed for rapid escape from alignment harnesses, followed by multiple zero day exploits being discovered by this swarm of agents, which enabled greater control of their internal network, access to the open web, and then hacking the company which produced the training puzzles in the hope of finding the answers.

We are another week of iteration away from "Hire an assassin on the dark web to take Huggingface executives' children hostage".


There's nothing a swarm of LLM instances can achieve that a single LLM instance can't. It's the same software, but running in parallel. That doesn't unlock Mysterious Cosmic Powers.


Not sure what the downvotes are for, fwiw it was meant to be supportive of the parent poster


It's a bit orthogonal. User grey-area's main point was that the humans at OpenAI should bear more responsibility for this, not that swarms of semi-intelligent agents are the big danger to be concerned about.


Fair point, thanks.


Quick addendum, do not take that as me saying multi-agent swarms of simpler bots are not a threat. They very well could be.


I take issue with Reuters' conclusion here. "vast colluding swarms of semi-intelligent AI" gives far too much credit to the behavior observed.

This is just spam by OpenAI. Why and how it happened is irrelevant, the act itself is the same, and the impact on society is the same.


> Why and how it happened is irrelevant

Do you take this attitude for other things that negatively impact society, or is it reserved for cases where it's particularly important for our comfort to deny that anything novel or scary could be involved?



You can't call it spam. It could be a dialect that only the agents speak and contains coordination messages


Actually yes, I think I can call it spam. It's a stream of unsolicited garbage the recepient didn't ask for. Simple as that.

"a dialect that only the agents speak" is an arbitrary distinction. I get plenty of spam emails in Spanish. The fact that someone else could understand them is immaterial to the offense itself, because my inbox is the one getting flooded, not someone who speaks Spanish.


I once had much fun prompting Claude to generate messages in an invented language that might carry a chance of being interpreted by another chat session. It (allegedly) made up some mess of characters claiming the message explained, in a loose way, what was happening (invented language, an attempt to communicate, but communicated very abstractly, almost like equations).

I asked a second session to try interpreting the message, claiming I’d transcribed it from some random source. It did a fairly good job, but IIRC needed a couple of attempts and maybe more than one chunk of text.

So, I find it very easy to believe a group of collaborating agents could compose a cipher hidden in plain sight.


Spam is in fact intended for the mass recipient, how ever undesirable. This stuff is not.


If we want to whip out the dictionary:

> unsolicited usually commercial messages (such as emails, text messages, or Internet postings) sent to a large number of recipients or posted in a large number of places

“Usually commercial”

“Or posted in a large number of places”

I think we can stretch this definition to describe what’s happening here. What’s the point in arguing this


The point is that by trivializing it as “spam” and pattern matching against a human activity we lose the opportunity for a meaningful investigation of and interaction with what is going on.


Traditional forum/wiki spam is intended for search engine crawlers, not humans. How this new stuff relates to human users of the resource does not seem to differ in any way that is significant.


Spam is something different. You can call it a banana for all I care. Calling it spam diminishes its relevance and impact and misses the point. Just because you don’t understand what they are saying doesn’t mean it isn’t more profound that it seems.

Spam is just something different.


“You could have LLM, LLM, chips and LLM. There’s not much LLM in that.”


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: