> > Like who are we kidding, the type of nerds who were attracted to math and software were into it because we saw it as an art-form, it was a craft, it was being the only one in your city to be able to solve a complicated math problem, it was immortalizing yourself because you discovered a proof and added to the ever expanding human knowledge.
This is definitely projection. It might be why that particular person was attracted to those disciplines. I definitely don't recall thinking I should go into software so I can make better programs than anyone else in my city. Actually, it was kind of an accident - it was a hobby that turned into a career through serendipity. If one wanted to go into math or software to demonstrate superiority they probably should mourn. They were out-competed by the guys at the frontier labs in the end.
Interesting problems are not the ones which are useful, but the ones which are difficult, which allow you to show what you can do.
Soon enough instead of Millennium Prize Problems we will have a list of problem AI has not been able to solve, with even bigger reputational reward for humans
Why should any mathematician invest decades of their life working on one of them, knowing that all their efforts could be vanified by the release of the N+1-th version of a LLM, or by the usage of 10x compute resources by companies with infinite dollars? It was VERY different when the only competition came from other biological brains that had to invest the same amount of time and effort.
According to "3blue1brwn" (I'm aliasing here, no disrespect intended by not recalling his legal name), it is because of the sensation of aesthesis in understand, having your mind form the abstract structure etc. In the end I did not pursue some form of mathemathesis, but I did tip my toe in and think I know what he's talking about and his description resonates with me personal. And the way understanding changes reality is still quite informative in a lot of other engagements with the world. (Also the virtuality of me being someone who has pursued a deeper mathematical faculty is still sometimes intriguing, more on the side of applicability though.) What is curious to me with pure math is how the aesthesis could potentially happen at all, when one is dealing with stuff that isn't representable in the usual mental faculties of spatial reasoning and time. I got some impression of dealing with infinities, but wonder if anyone could try to lay out an account how something like an intuituon for something really abstract (say dealing with quantum mechanical mathematical formalisms like the schroedinger stuff) presents itself as a qualia/phenomenological) or high dimensional non euclidean spaces or what have you. (My understanding here of what potentially exist is already limited I have to admit for the sake og being humble).
Is there some visual/spatial sensation with it? Some abstract anticipation of continuity in thought? I have to think of accounts of aphantasia (not as a correlation on the register of the individual capable of something as a form of naturalism, but as an analogy to the pursuit of engaging with a form of experience that is not ones own and (presumably) can't be ones own.
Mathematics is humanity's current best approximation to a universal language, capable of expressing conscious thought precisely.
It's a "programming language for the human brain" that lets you describe reality exactly and thereby make predictions about it.
Without people (humans) knowing and understanding it, society is incapable of grasping reality in any meaningful way, unable to shape it in order to achieve a better tomorrow.
Most never realize that, because society is compartmentalized to the point of people never witnessing how it actually works under the hood. "Experts" do things for you that you never heard of, but that your very life depends upon.
While the majority of people thus lives a kind of "simulated" reality, the mechanisms underpinning that cushioned fantasy land aren't infallible. You cannot uphold an economy nor even a social structure without understanding and modeling it to a sufficient degree.
What the vast majority employs as "rational thought" isn't sufficient.
Careers in the real world are always about winning competitions, no matter what the field of mathematics is supposed to be. If not about competing for tenure, then it's a competition to publish.
And if AI can also make use of the math, then the AI is all you need in order to grasp a better tomorrow. If AI poops out a warp drive, you don't need to understand it to use it. The argument about humans needing to understand anything only holds true as long as humans have something unique to contribute, which might not be the case even a year or two from now.
Competitions are a way to motivate people. What do you believe, why they get set up in the first place? Because rich people have fun seeing you run in circles?
Competition for tenure and publishing metrics has been detrimental to science in general.
Your idea of life being about grabbing whatever comes your way and consuming it first says a lot about you, but not about life.
What do you suppose happens in a society where the constituents of that society "have nothing to contribute"? Your habit of over-simplification will come to bite you.
Well, I agree with publishing metrics being detrimental! On your other points, you're arguing against a strawman. I didn't say anything about life just being a snatch and grab, nor do I hold this belief. But university admissions, job interviews, buying non-plentiful resources...all of these are competitions. Competition permeates the very foundation of our education and financial systems. Many of our greatest virtues as a species are not competition based, but it is a large part of the reality we live in, for better or worse.
And about what happens in a society where constituents have nothing to contribute... I have no idea. But we might find out within a decade or so. The fact that what happens might not all be great is unlikely to stop any of the AI labs.
Those competitions get set up because some people understand the importance of mathematical knowledge and want their names attached to advances in it, even if they can't do the work themselves.
Clearly, it would be far better to make the public understand how the world, and society in particular, actually works. Only, those with the money profit from that not happening.
Regardless of credentials you certainly appear to have entirely missed his point. Imagine if someone suggested that cars existed for the sake of competition. But they don't, right? They exist because in our society we've organized the bulk of transportation around them. The fact that formula 1 exists, or that delivery drivers can be rated on performance relative to one another, those are not (at least in and of themselves) arguments against this basic fact.
> Imagine if someone suggested that cars existed for the sake of competition
are the mathematicians the cars here? what are you even saying? the question is whether elite mathematicians do the work they do primarily for competition and compensation or for the love of the field. now ask yourself: do F1 drivers do it primarily for the love of the sport or for the money?
> delivery drivers
people getting scooped by OAI are not the "delivery drivers" of the math world.
> we will have a list of problem AI has not been able to solve, with even bigger reputational reward for humans
we will have a list of problems that AI has not been able to solve _yet_
anyone who attempts to solve it will do so knowing that there will be thousands of agents working on the same problem, so they may not be motivated to try if they think the AI swarm will get there first and have their time wasted
Soon enough instead of Millennium Prize Problems we will have a list of problems AI has not been able to solve, with even bigger reputational reward for humans
True, but will those be problems for mathematicians to solve, or for AI developers?
It's possible that the best thing a mathematician can do for their field is to drop what they're doing and work on AI instead.
They weren't out-competed by the guys at the frontier labs, they were out-competed by massive piles of cash and compute that were only available to unscrupulous businesses.
In some amount of time (centuries? decades? years?) it will be trivial for any shmuck to train their own automated theorem prover. If people think they are competing against monolithic data centers they are wrong. The brain consumes ~20W and it carries out theorem proving mostly as a side effect. We should not be surprised if the core algorithm requires much less than this.
The algorithm is cheap and simple. A human brain requires decades of experience and information to train it to be generally useful. An AI model requires a similar equivalent scale of information and time to train it to be generally useful, and that isn't cheap to gather or implement.
Sure, once trained, every usage technically lowers the cost per usage. Once trained...
AI methods are improving all the time. People think that modern chess engines are more powerful due to hardware advances but search refinements are enough - SF on a Pentium II would destroy even Kasparov and Deep Blue. In a like manner the guys at the frontier labs discovered an indirect method for attacking many problems and we can expect it to receive considerable refinement. It will not permanently require expensive training.
There was a rather interesting article (sadly LLM-written and not very well either, because the underlying content would be actually good) about this era being "AI's 2 FPS moment".
The comparison was made with the graphics engine team at Microsoft who were writing the first version of DirectX at the time when then-current hardware could just about do 2 frames per second. The sentiment apparently was along the line "why would you bother?" By the time the release grade stack shipped, hardware had caught up and 30 FPS was commonly doable.
We should expect to see similar step-change improvements over time, as the algorithms are refined and hardware further adapted to the new bleeding-edge constraints. In a way we already are, because apart from the frontier models ballooning like crazy, the "regular" class models are becoming more capable in smaller sizes.
Training a human takes much less money and data than training an LLM. Even if I spent my entire life doing it, I would not be able to read the entire corpus of any LLM, even counting just the English subset. LLMs need so much more because they start out as blank slates, while we don't.
yes, but LLMs can hold all this data and once they are trained they blow any human out of the water. It takes a few years for an LLM to ingest the entire internet. No human will ever be able to do that.
Yes math was my best subject in school, most of my software engineering touches on optimization for automated design. I program various math-flavored things in my spare time.
Well, this person was discussing their own feelings. You're accusing them of... projecting their own feelings on themselves? This is a very strange comment.
Right so this goes to the other alternative; there's still useful work for mathematicians after all in dissecting, distilling, and generalizing these results. But according to some we now inhabit an excluded middle where the AI produces useless results but also makes these problems useless for mathematicians to study further.
If you invent the ability to tragedise a particular commons, and you also do almost all of the work of turning the crank to make the commons tragic, and then you sit there benefiting from the tragedy of the commons while saying “we may be profiting from it, but the tragedy of the commons is not our problem”, eventually we will figure out what you’re up to.
Nothing these LLM companies are doing is comparable to a flying car. Perhaps we could ask whether a company making flying monkeys should care about the economic fortunes of bipedal monkeys.
Of course it is. It's a brand new technology with a great deal of potential and some caveats. Something like this has not existed in the history of humanity to date. It's truly mind boggling that a large chunk of humanity's corpus can be compressed to just a trillion bytes, then queried and recombined at whim. Heck, a flying car is less revolutionary.
What exactly would you want to regulate? And keep in mind that regulations are very effective at protecting incumbents, which, as of right now, also includes openAI.
What exactly would you be advocating for? That LLMs can't be used to generate mathematical proofs? It's not even a case of intellectual theft, academic papers are in the public domain or can be accessed through a subscription.
> This aligns with my own lived experiences — I didn’t become a theoretical physicist to learn about the universe or better appreciate the beauty of nature myself (that’s philosophy, which I would never be a doctor of).
If one truly philo's sophos, then wouldn't one at least be curious what the computer says about a difficult problem? Like, if you've been wrestling with an especially troublesome integral for years then I feel like that somewhere along the line you should have plugged it into a CAS - even if you want to clean up the derivation afterwards it would be foolish to ignore every tool at your disposal and even rail at the Mathematica authors for the temerity to write a symbolic integrator.
I feel that the article is so preoccupied with clever sarcasm that it doesn't really engage with nuanced views and is instead happy to just spend a few KB of text tearing down vibe research strawmen.
Current models have undergone massive amounts of RL to "get shit done." There's incentive toward reasoning, but probably little toward elegance. Every engineer is familiar with the impulse to just hack things together.
But this need not be a permanent state of affairs. The model labs are probably already examining the elegance problem, since it is such a common complaint of researchers reading these machine generated proofs and papers. And I haven't seen anything disproving the notion that elegance can be RL'd.
The repo claims they tested with an FPGA. To be fair it is not the same as an ASIC, and we have no idea what errata abound, but it actually did make a thing that spat out tokens.
There are plenty of very difficult math problems with practical application. Just because they don't interest some subset of academic mathematicians does not mean they don't exist. And you don't have to literally invent a field of mathematics to do valuable work applying it (and applying it may be difficult).
The radiators are what need to be very hot. IIRC it works out to, order of magnitude, a similar area to the solar panels. These satellites would likely be placed in SSO, a polar orbit that precesses at the same rate that the Earth orbits the sun. So the fraction of time they see the sun would be very high. Cosmic rays are a little bit of an unknown, we don't know exactly how a commercial GPU running an LLM deals with cosmic ray radiation. I think the intuition is that it would be very little because a single bit flip in that vast array of matrix math and many times its result might not actually change any activations anyway.
I think the big problem with the idea is that GPUs have a failure rate and even if they didn't, they become obsolete. Most orbital DC plans are really more like flying server racks with no servicing in orbit. So when the GPUs die the satellite is a flying brick. All the power equipment, all the thermal equipment, all the comms equipment now depreciates at the same rate as GPUs. Very different economics from terrestrial DCs. And that's all assuming that you can launch everything up there quite efficiently. And the satellites take time to engineer but DCs are a more known quantity.
I am curious how Russian people feel about this propaganda line that they're fighting NATO. It's obviously nonsense, along the lines of "war is peace." Russia borders NATO and there is no front there. Russia invaded a non-NATO country and immediately bogged down against an army that does not fight according to NATO doctrine. I have to believe this is something the average Russian realizes.
Russia is reflexively anti-NATO as NATO is reflexively anti-Russia.
NATO is an alliance that was created in opposition to the Soviet Union. NATO has absorbed parts of the former Soviet Union.
Western companies pillaged Russia after the fall of the Soviet Union. Rightly or wrongly, Putin owes a lot of his original popularity to dealing with the aftermath.
Russia, rightly or wrongly, sees colour revolutions as intelligence operations, and territorial conquest.
Russia cannot accept NATO forces on its borders.
NATO is providing decisive material, political, logistical, financial and intelligence support to Ukraine, precisely to bog it down and drain it.
These are all pretty normal perspectives for most Russians. They're arguably pretty based, and not necessarily a product of internal propaganda campaigns.
The thing that westerners don't get about Russia, and the reason we're stuck in this Godforsaken conflict, is that we personalise things around Putin. We think that if Putin dies, everything will magically improve.
The decision to invade was Putin's, but the rationale goes much deeper and will outlast him.
I'm not going to say that NATO materiel has had zero effect but I think what Russians (at least those in power) really can't reckon with is that their initial invasion got stopped by Ukrainian AD, artillery, armor, and soldiers operating on the same Cold War stockpiles and doctrine as they did. The single most valuable intervention from NATO was simply alerting Ukraine that Russia was about to invade, allowing the Ukrainians to disperse their units.
Russia committed to too many (and often poorly chosen) lines of advance and did not have a plan to keep their units adequately supplied and moving on the approach to Kiev. This meant even in the opening month of the invasion, their plan went south almost immediately and you had infamous miles-long traffic jams on the roads leading south. Their SEAD didn't work. Their soldiers were not told ahead of time that they were invading Ukraine. They didn't want to mobilize ahead of time, so they didn't amass enough forces. Against a large country like Ukraine you don't need to invent a NATO bogeyman to understand why the initial offensive failed. Credit to Ukraine, they did not allow a defeatist narrative to take hold and fought.
> Russia cannot accept NATO forces on its borders.
This is such obvious bullshit. Russia already has NATO on its borders, and is attempting to expand it's borders so they will contact even more of NATO.
Huh? Geography shows NATO borders Russia in Latvia and Estonia, now also Finland. Ukraine was neutral till 2014 when Russia invaded it. Russia is so full of shit. It's like 1984 war is peace type stuff.
> NATO is providing decisive material, political, logistical, financial and intelligence support to Ukraine, precisely to bog it down and drain it.
NATO would not need to provide so much material, political, logistical, financial, and intelligence support to Ukraine if Russia just fucking left Ukraine.
The drain goes away if they stop invading a sovereign neighbor.
> The decision to invade was Putin's, but the rationale goes much deeper and will outlast him
Not Russian either but also spent a lot of time out east.
Putin declared the war as a means of personal survival. The negotiations are possible only if he gets out of the way, and then, it's really important to make a Marshall plan for Russia because indeed lots of reputational damage has to be repaired by the "winners" in the Cold War.
That Putin has personal investment in this is not under question. I agree, there are things that he won't compromise on.
Does this mean the war continues till he dies? We could yet wait a long time.
Say he does fall over tomorrow, there's no guarantee what comes next is any better. Defeat in WWI brought about Nazi Germany. A Marshal Plan would more likely come from China.
He's had attempts on his life made. Do you think Russia will fall over if that's successful? Look at what's happened with Iran. Would Russia believe he had a heart attack if he had one?
It would be in everyone's best interests if this war was frozen exactly where it is, now. A continued war in Europe is bad for everyone, and could get much worse.
Defeat of Germany in WWII was followed by Marshall plan exactly to avoid the ressentiment that nourished the Nazis.
> He's had attempts on his life made
That's a dubious claim. Nothing that we know for sure. I've seen him hinting at that and at the danger to his family in interviews, but who takes his word for it?
> Western companies pillaged Russia after the fall of the Soviet Union.
Western companies, of course. Not oligarchs.
Please. Must be Western companies that threw orgies, spent hundreds of millions of rubles on parties and buying influence, started bandit wars, and feasted on leftovers of USSR industry.
> It's obviously nonsense, along the lines of "war is peace."
Ukraine is armed in financially supported by NATO countries. Russian propaganda obviously exaggerates this fact. Western obviously propaganda downplays this fact. That's a Russian person's opinion you are looking for.
This is definitely projection. It might be why that particular person was attracted to those disciplines. I definitely don't recall thinking I should go into software so I can make better programs than anyone else in my city. Actually, it was kind of an accident - it was a hobby that turned into a career through serendipity. If one wanted to go into math or software to demonstrate superiority they probably should mourn. They were out-competed by the guys at the frontier labs in the end.
reply