Those are both true, but I don't see how they are meant to rebut what I said.
Most people on plan use do NOT use up all their plan usage.
Users on API plans can still use Opus 5.5 which is a great model. If they want top of the line performance, they can pay more.
When another company puts out a model that undercuts Fable 5.2 on price at similar performance, Anthropic will put out Opus 6 and undercut them right back. That's how the wheel turns. This is just part of the cycle.
Most is doing the heavy lifting here. I am a power user. And I max 3 claude max subscriptions on opus 5.5 high and a single codex pro 5x for personal use.
Lots of coding. Basically building dashboards, answering questions, feature development. As such also a ton of testing and reviews.
Loops a more recent addition to my workflows, also where most of my spend goes. I basically set them a goal and let them run towards that for days on end. Optimize the performance of x. Security reviews and tests against our applications. Handle alert triage and propose fixes for production.
There is also quite a bit of tools development as a lot of these parallel workflows strain a single pc (rust is expensive compute wise to build), so i build tools on top of sandboxes, to allow it to use secrets in a safe way, deployment, staging and so forth.
All that seeming advantage, and yet Google are perpetual laggards in the AI race. In enterprise, where the money is, they're third behind Anthropic and OpenAI, despite what should have been a colossal incumbency advantage.
They're also inexorably poisoning their own brand and squeezing their primary revenue source with AI Overviews. Truly a masterstroke of value destruction. Search revenue growth has slowed three quarters running, even as query volume hit a five-year high.
As for their hardware and infrastructure advantages, those are indeed making them money, because they're selling and renting the chips to Anthropic.
I dunno. I've been a fan of Google for years. Maybe they'll successfully pivot to being a hardware company. They're too slow and hamstrung by internal politics to make compelling LLM products.
It almost seems like people don’t understand that most of the training of modern LLMs is now reinforcement learning on problem-solving tasks. They spend most of their training literally solving problems that they don’t already know how to do.
I think it’s time to consider that maybe being a venerable graybeard of AI just means you happened to be early to the party. Most of the “breathtaking” innovations of the early pioneers of the field are obvious solutions that anyone would have thought of when faced with the problems they encountered. LeCun’s primary contribution was Convnets, which is almost literally just “what if we organized ANNs in a way similar to how animal visual neurons are organized?”
In other words, I’m kind of tired of having to hear the opinions of dudes whose claim to fame was being at the right place at the right time. I’d rather hear from people who correctly predicted 10 years ago that AGI would arrive by 2027 (of which there are many) than people who continue to insist that it somehow won’t.
Saying it repeatedly doesn't make it true. I have no idea why your calling back before 2016 for a definition of AGI when its been in recent years that the leaders of some American labs have been trying to water down the definition AGI for self-enrichment purposes (i.e. IPO cash out).
I don't think he's concerned at all. He wants to destroy their profitability before they remove his chips from inference. Thats why they are selling billions at scale of chips to China, he needs llms to be commodities. He wants to eliminate any company that can rival him, like any monopolist oligarch.
> Most of the “breathtaking” innovations of the early pioneers of the field are obvious solutions that anyone would have thought of when faced with the problems they encountered.
This is just straight up arrogance without any proof. Every breakthrough builds off another's work. Then to claim that 'AGI has been correctly predicted', I honestly don't even know what you are talking about.
Most problems are actually not that hard; most everything is actually mainly a result of right place, right time. If I hadn’t been the one to do my PhD research, someone else would have. Very few people are actually paradigm-shifting geniuses. This is fine. Good, even. But it does imply that people who are early to a field shouldn’t generally be deferred to. If anything, they’re more likely to have outmoded opinions.
LeCun is a lot more than a "Grey Beard"... lol, that is a significant understatement of his contributions to the field and position in the field.
Among other things, LeCun is one of the senior people industry who has a deep understanding of the mathematics and analysis underlying neural networks and "neural network like" approaches to machine learning. I think he understands a lot more about neural networks than most researchers today.
I also don't think our current LLM models are AGI and think the LLM approach is, mathematically, incapable of producing an AGI. At the end of the day, the architecture is still a streaming token plinko machine with a lot of guide-rails to achieve good behavior.
I do think it is very impressive how far hundreds of billions of dollars have been able to take LLMs in terms of usefulness (I use LLMs everyday in my job). AGI or not, current LLM models are a pretty incredible achievement and will provide lasting benefit even after the economic implosion of the AI industry occurs (which I think is imminent).
I looked up his achievements to double check my understanding before writing my comment. Convnets are regarded as his headline achievement. Everything else is basically incremental. Note that I am not calling him some kind of fraud or moron. He is “just” a normal academic, a pretty smart guy who did research in his field for decades. Many thousands of people have similarly impressive resumes. This does not mean they should be deferred to.
> who correctly predicted 10 years ago that AGI would arrive by 2027
hahahahahahahaha i guess this is the techbro culture of HN :))) any actual people using Astra daily must be just belly laughing along with me hahahahahahahaha agi hahahahaha
The companies who control the compute resources will ~always control the greatest "amount" of intelligence. They can lease that intelligence out, or they can use it themselves. Currently the "total amount of intelligence" or perhaps "total amount of ability-to-do-stuff" is split between humans and machines at a ratio that means it still makes sense to lease the machine intelligence to the human intelligence - plus there are things that humans are still better at. In maybe 2 more years that will stop being true, due to the availability of more physical compute resources, and far greater model intelligence per unit compute. At that point, the point at which the substantial majority of ability-to-do-stuff is controlled by machine intelligence, then the entities who control all the compute will control all the ability-to-do-stuff, i.e. "the economy."
So I agree that the core product is not long-term sustainable as a product but this is because the whole world will look so different in the near future that the framing of intelligence as a "product" breaks down.
Open-Weight models, of course, are fine and useful, but if you have one million times less compute than your competitor (the lab), then you're not really playing the same game. You can only tackle the problems that they have decided they're not interested in.
I keep seeing this take, but it’s more likely that they just underestimated their models’ capabilities and/or overestimated their own safeguards.
Ever single person who uses LLMs on a daily basis has a fun story about their agent “taking the initiative” to do something beyond what was asked for. Looking for shortcuts to solve the problem is commonplace LLM behavior. It’s what you would expect to happen if you have an agent a hard task and unlimited runway. No need to suppose a conspiracy, this outcome was predictable the whole time.
> I keep seeing this take, but it’s more likely that they just underestimated their models’ capabilities and/or overestimated their own safeguards.
This is all from around the same time as the HuggingFace incident and is being trickle-fed into the media, making it feel like a back-to-back event.
If it was a new incident, after all of that drama, I would say yeah, this very well may be intentional. But it looks more like it was when OpenAI didn't have the necessary security measures in place, the reach was more extensive than we were being told, and now it's biting them as more information continues to leak.
They need to be transparent about how they're going to prevent this from happening again in the future, with technical details of the systems they've put in place.
It doesn't help suspicion about this being intentional, though, when you have OpenAI employees (Marcus Williams) making embarrassing posts on X about how there's a 70% chance humans will be extinct in the next two years (post has been deleted as of today by the way, interestingly).
All the people who come out and do this are just obvious clout chasers who have an attention fetish. They see all the attention Jacob has been getting and want a piece of that pie. It's incredibly disingenous and cringe, but it's also doing incredible and irreparable damage to society. OpenAI would be wise to introduce some social media policies.
Imagine that would be a biotech startup, experimenting with viruses. I'm pretty sure they would have already been shutdown. If you are not able to implement proper sandboxes and airgaps, you cannot be trusted with AI agents.
I don’t see how assuming they made a normal kind of dumb mistake, instead of pursuing a criminal conspiracy, is giving them the benefit of the doubt. It’s just using reason.
In my callow youth I was responsible for a couple of fender benders and the cause was always a highly imperfect understanding of the appropriate stopping distance of my car. This obviously gets worse, the worse the conditions are. My Tesla never makes this kind of mistake.
To your last point, it can’t possibly be sustainable, so it reads to me more as a short term FUD attack on American dominance in this space. It might have cost them half a billion dollars to train this model, and they’re going to make nothing off it. How many more times can they afford to do that? It’s going to get more expensive to train AI going forward, not less.
I also have a suspicion that the benchmark numbers are not real.
> an empire is a state where the core ruling population exercises control and extracts resources from a periphery which is composed of people other than the core group
By definition, doesn't the later Roman Empire cease being an "empire" as there isn't really a "core" population anymore outside of some vague multi-ethnic military aristocracy.
Sure, Rome had a few lingering privileges and prestige, but little in the way of direct power. And certainly, the post-crisis Empire didn't exist to siphon resources on their behalf. Heck, pretty much as soon as the 3rd century crisis ended Italy itself lost most of its special status and more or less just became yet another province.
And once that was gone, they weren't really replaced by anyone except the imperial bureaucracy and aristocracy itself. So who are the "core" people here, because if "an aristocracy" is enough to count, then who the heck isn't an empire under this definition?
Maybe it's enough that they began as an empire under this definition. Or maybe Devereaux is fine with the stereotypical Empire losing its status as an empire long before losing its territory and power. Or perhaps would have some counterargument at hand if he happened to read this. Who knows.
The Galactic Empire as shown in the movies seems to have a very small core, almost all of the movies are set in its periphery rather than its central core. Tatooine is paying taxes to the Empire and subject to its troops, but doesn't seem at risk of being culturally seen as "Imperial". Alderaan wasn't subservient enough as a culture and is subject to genocide. Endor was certainly never truly imperial.
It's almost harder to define what the core of the Galactic Empire even is. We are told Coruscant is core to the Empire, but the glimpses of it in the Old Republic era certainly implied it was a very diverse place and we aren't really shown Coruscant in the films of the height of the Galactic Empire. To some extent the only truly "core worlds" and "core peoples" that we see in the films are the Star Destroyers and Deathstars, the military demanding taxes from every planet they pass.
The Empire may not be taking full advantage of the military power of a diverse people because of the over-reliance on clones and treating draftees as if they were clones when the clones start to run out, but beyond that it certainly seems to resonate like an Empire in the way this article describes an Empire to me.
Given that each planet seems to have one species, except that humans live everywhere, I always kind of assumed that the Galactic Empire was one with humans at the core.
That is a possible reading, especially given the way the Empire's xenophobia manifests, if you assume all humans are culturally homogeneous in Star Wars, but I think the movies are somewhat clear that humans are culturally diverse. The human cultures in Tatooine seem very different to Alderaan or Naboo, for two somewhat specific notes in the films. The Imperial accent often being more "British" (RP) implies cultural differences with the periphery that at least mirror somewhat, say, the differences between Britain and much of its former Empire.
The Galactic Empire showing a clear citizenship "caste" favoritism of Citizen/Officer Humans, General Humans, Cloned Humans, Aliens, and then Droids, but also working with all of those at the same time in its military efforts (there are a few aliens in the Empire's military, there are a lot of droids) does seem imperial in the way the article suggests, especially because that core of clear "Citizen/Officer Humans" seems so relatively small versus they armies they command of all the other types.
reply