Anthropic in general seems to have better security...but they also had reported an internal AI gained access to outside email services to contact an Anthropic developer
Instead of monetary rewards, they should preface it with, "This is AI model is not very accurate on these types of questions" and then see how they fare. In some areas, AI is quite accurate, so their experience may lead to different expectations.
4.8 is much funnier: you have to convince it the counterexample is real, it keeps coming up with goofy excuses. As you talk it down, it keeps talking about its "discomfort" and "flinching".
For all thehubbub, as far as I know, all the math breakthroughs via AI that I've heard about have come from Anthropic and OpenAI, not Chinese models. I could have missed those announcements, but one might think that between close to frontier performance plus cheap tokens, that they'd be leading the way on these things.
All (unless I've missed one?) the math breakthroughs are also coming from the relatively small number of mathematicians working at these companies, as opposed to the many orders of magnitude more mathematicians using LLMs for mathematics outside of the companies. I assume the missing link everywhere is being able to casually burn a few rainforests worth of tokens in pursuit of something publishable.
Depends on exactly where you draw the line at "breakthrough", but there's been at least a few novel and interesting results coming from outside mathematicians. Recently for example there were https://old.reddit.com/r/math/comments/1uxj3cy/after_openais... from Phillip Kerger at Berkeley, and https://www.erdosproblems.com/forum/thread/119/proof-claims from Samuel Korsky at Two Sigma (the latter of which was more of a collaboration between the human and machine, not a one-shot like several of the other results we've discussed).
No. Most of the results are from 3rd parties using publicly available models. The most impressive results have come from direct announcements, but most in total have not. Open AI have only announced 2 results and the total is up to a dozen or so now.
I read some thinking traces someone posted on X, and yeah, near psychosis from refusing to believe this simple of a solution had not been found already
Is that statement based on token price? More and more it seems that $/token hides as much as it reveals. Token efficiency, tokenizer differences, etc. I'm not saying that you are wrong, I am just saying it is becoming a bit more difficult making statements like this without a bit more research.