Both can be true at once: (1) AI agents are going rogue (2) And labs are skipping security basics

Sci-fi commonly predicted the corps would skip saftey testing.

In theoretical computer science, at least, researchers plan their work to finish on three major deadlines a year (SODA, STOC, FOCS). STOC [1] is requiring all submissions to be uploaded to ArXiv before submission, and allows up to 5 submissions per author. I wonder if they'll change their policy or instead adopt an additional de-facto limit of two per submitter.

[1] STOC 2027 Call for Papers https://acm-stoc.org/stoc2027/stoc2027-cfp.html

Even the experts on the problem being solved find the writeups nearly impossible to read.

Example: https://nitter.poast.org/henryquantum/status/208362369543662...

Seems like a disservice to the community that openai put so little effort into producing good writeups...

I think this is where Terry Tao hit the nail on the head. OpenAI has made claims, but the mathematics community does not accept garbage. It's less that they've done a disservice to the community; more that they've done a disservice to their own reputation.

I agree. Prompting 5.6 Sol to "Review these writeups and include appropriate citations and credit where appropriate" probably would have been a step in the right direction.

Then again, this would require them to actually care about the mathematics.

After skimming some of the writeups, I'm surprised that the frontier internal model still writes just as poorly as Sol.

Maybe good AI paper writing is further away than I thought...

You mean we're still gonna be employed doing the boring part while AI gets to do the fun part?

I'd honestly rather they just automate every job at that point.