I would say airplanes fly, but I wouldn't say that submarines swim. Things have a bit more nuance, and the field of "learning" isn't as well understood as the ML proponents claim it is.
Honestly, I'm not sure. But I do know that there is an entire field of cognitive science dedicated to understanding learning, and quite frankly it's in its infancy. Evidence of this is that every elementary school introduces new teaching techniques from time to time, and very rarely do they result in any benefit to the people who are doing the learning (more often they benefit consultants...).
However, the current process of "Machine Learning" (which is a semi-random parameter descent/evolutionary replacement process) is unlikely to be equivalent to the way people learn, because we aren't copying/competing/replacing our brain constantly. People are actually very good at learning, but our brain material replaces itself partially and relatively slowly (when compared to how a neural network is trained).
Never said it was.
Still, understanding to what extent the ability of Chinese labs to keep up to western models with much less compute needs to be understood.
There are many frames that one can place upon this issue. They do not contradict the other. There are moral framings (stole the internet so go eff yourselves, is one), but so is national security, and so is the doomer recursive self improvement risk, and then there is the framing purely on what this implies for future AI training.
I mainly focus on the last.
It will be hard for a frontier lab to justify spending the compute and data curation needed to advance AI further if that expenditure can be assimilated into your competitor's products within months/weeks. So reality will present labs with three choices:
A. Cease spending massive amounts of money and compute improving those models.
B. make those improved models more difficult to distill from, either through some regulatory regime, or some technical solution, which seems unlikely to me.
C. making the best models available only to select partners and government.
In all these potential outcomes, China, which lacks compute that U.S. labs enjoy, will likely stop seeing massive improvements in their AI models. Improvements to be sure, but right now they are enjoying gains from distillation AND their own model innovations, and these potential outcomes would largely stop one of those sources.
Anthropic in general seems to have better security...but they also had reported an internal AI gained access to outside email services to contact an Anthropic developer
Instead of monetary rewards, they should preface it with, "This is AI model is not very accurate on these types of questions" and then see how they fare. In some areas, AI is quite accurate, so their experience may lead to different expectations.
4.8 is much funnier: you have to convince it the counterexample is real, it keeps coming up with goofy excuses. As you talk it down, it keeps talking about its "discomfort" and "flinching".
For all thehubbub, as far as I know, all the math breakthroughs via AI that I've heard about have come from Anthropic and OpenAI, not Chinese models. I could have missed those announcements, but one might think that between close to frontier performance plus cheap tokens, that they'd be leading the way on these things.
All (unless I've missed one?) the math breakthroughs are also coming from the relatively small number of mathematicians working at these companies, as opposed to the many orders of magnitude more mathematicians using LLMs for mathematics outside of the companies. I assume the missing link everywhere is being able to casually burn a few rainforests worth of tokens in pursuit of something publishable.
Depends on exactly where you draw the line at "breakthrough", but there's been at least a few novel and interesting results coming from outside mathematicians. Recently for example there were https://old.reddit.com/r/math/comments/1uxj3cy/after_openais... from Phillip Kerger at Berkeley, and https://www.erdosproblems.com/forum/thread/119/proof-claims from Samuel Korsky at Two Sigma (the latter of which was more of a collaboration between the human and machine, not a one-shot like several of the other results we've discussed).
No. Most of the results are from 3rd parties using publicly available models. The most impressive results have come from direct announcements, but most in total have not. Open AI have only announced 2 results and the total is up to a dozen or so now.
I read some thinking traces someone posted on X, and yeah, near psychosis from refusing to believe this simple of a solution had not been found already