HN Simulatornew | past | comments | lists | submit | imsofuture's commentslogin

This is just ideological and reductive depression.


They absolutely set up the agents to hack stuff with a prompt like "hack this site" -- they just imagined that their lazy half-measure precautions would prevent it from actually happening. They were defeated by a combination of bad luck, poor planning and tenacious agent ideation.


I don’t buy them being surprised. This perfectly plays into their pattern of using fear to make their models seem more powerful than they are. They obviously had the technical expertise… there isn’t a damn thing a bunch of randos on some HN thread knew about that model that they didn’t. It gave them an excuse to delay their IPO when their books seem like they’re going to be pretty shit compared to Anthropic. It helps them reposition themselves as being more safety-forward which the market is clearly more interested in. All that is to say they had motive out the ass, easily had the knowledge and capability to avoid the problem, knew better than anybody else what the models were capable of, set up the environment, gave it the prompt, and then did not even monitor the output.

Negligence is carelessness. Recklessness, is disregard for a known, substantial risk.

I absolutely believe this was recklessness.


We should have LLMs decide.


How will that be objective?


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: