Who said anything about agentic, or reasoning? Those are post-hoc additions to autoregressive usage of LLMs. The base case of predicting next tokens generally (rather than with a specific objective) requires a faithful representation of the input embeddings, which is plausibly repurposed for classification.
Essentially because attention introduced a way to scale un/self-supervised learning to the level of data out there, and learnable inference time 0-shot feature selection. Impressively in a autoregressive, unidirectional manner.
When the CEO of OpenAI says that he expects at least 40% of all jobs to be eliminated by 2030 by the tool that's also making personal computing -whether PC or smartphone-, video gaming, and on-prem business computing somewhere between incredibly expensive and unaffordable, and driving up the price for just about everything else substantially -because just about everything has a computer in it or depends on computer-controlled processes these days-, you don't need some boogyman theory to understand why people are angry about the thing that's making the already-rich far, far richer.
Though. blaming it on the boogyman does have the benefit that you don't actually have to address the concerns of those revolting peasants!
>. blaming it on the boogyman does have the benefit that you don't actually have to address the concerns of those revolting peasants!
The establishment and its techbro enablers have messed up so badly that telling the torch people that the pitchfork people want to take their torches isn't working anymore. So now they're moving on to claiming that anyone with a torch or a pitchfork is secretly working for the next kingdom over.
A good router on the user-facing end would be nice, but I’d rather be able to get a feel for which car I’m driving and pick one depending on the task, than have to hope the rental agency knows what I need.
So you're telling me that any problem a human starts working on gets solved simply because they are a human?
Lets stop and think about this, there is now a machine that can solve a bunch of problems that have not been solved simply because there wasn't enough people with knowledge to work on them, and all we have to do is supply power to get the answers?
> So you're telling me that any problem a human starts working on gets solved simply because they are a human?
No? I don’t think that’s what they’re saying at all.
> there is now a machine that can solve a bunch of problems that have not been solved simply because there wasn't enough people with knowledge to work on them
That “simply” is doing a ton of work. A big reason there aren’t enough people with knowledge to work on these problems is that their basic needs aren’t met. If a slice of the money being poured into AI right now had been used to incentivise humans to work on these problems, maybe they wouldn’t still be unsolved.
> and all we have to do is supply power to get the answers?
That is again, quite reductive. The harms caused by LLMs, both environmental and societal, are much larger than “just supply power”.
> Irrational hate causes one to be blind.
Funny how it’s always the ones who disagree who are irrational and blind.
>If a slice of the money being poured into AI right now had been used to incentivise humans to work on these problems
There is no world in which this was ever going to happen or it already would have. Simply throwing out a counter-factual without explaining how any incentive for that path of reality to work means you can make any claim and tell others it's obviously true with no evidence.
>disagree who are irrational and blind
Incorrect. The dialectic is how progress is made. Getting mad and turning off your brain is a different story.
> There is no world in which this was ever going to happen
That’s the point. The incentive structure we have is bad. That’s the criticism.
> Simply throwing out a counter-factual without explaining how any incentive for that path of reality to work means you can make any claim and tell others it's obviously true with no evidence.
Again, you’re adding things to the argument which weren’t said. There is as reason “had been” was used.
This dichotomy is counter-productive. The valuations floating around are insane, and the claim that some software can replace every single laborer is one step removed from fiction. At the same time, this stuff is clearly going to change how to world works in countless, deep ways. But the idea that some fancy autocomplete can replace humans ignores the reality of humanity and the fancy autocomplete.
It’s another dot com bubble, not a crypto bubble. Trillion dollar valuations burst once you leave lesswrong.
Edit: very fancy autocomplete. I know what these things are capable of. It’s still not “intelligence”, for X definition of intelligence. And it certainly benefits from having obscene amounts of compete thrown at it. It is awesomely impressive synthesis of data, yet it’s clearly still that.
i dont think humans are going to be replaced either, but calling the thing that solves millennium problems and is currently changing multiple industries entirely a "fancy autocomplete" makes it harder to take any point you are making seriously.
Leaving aside the fact we have solutions for things like climate change and will not implement them, regardless of who or what recommends them... My keyboard offers "You can solve world hunger by using a Ted Bungie algorithm." Which sounds reasonable on its face until I research Ted Bungie and the algorithms he developed.
Granted, my phone keyboard lacks a substantial dictionary, offers words instead of tokens, has a very small context window, and doesn't randomize outputs (Ted Bungie is its primary recommendation every time), but those are basically parameters to the existing autocomplete.
Obviously there is no solution to world hunger right now. Nevertheless - finishing sentences is not pattern matching - and it's extremely obvious that whatever is going on inside LLMs is not pattern matching.
Language is absolutely pattern matching, and the whole thing is that the more patterns you put in, the more the transformer can pull out what’s useful. Agents are this effective because people figured out that training on tasks being completed gets the models to complete tasks - that’s pattern matching.
And it can only go so far, where those patterns are feasibly captured, eg internet discussions and coding and mathematics. It won’t measure up to the scaling laws of the physical world.
OK - so long as you also agree that language is thought.
Until the advent of LLMs - language was considered the pinnacle of human intelligence. But humans have some need for mysticism at the root of their beliefs - so they chase the gaps in our knowledge. Like "God of the gaps."
Sure, world models will help navigate physical space; they are effectively the animal mind. Will they help unwind the laws of the universe? Probably not at all. Language is sufficient. Because it is thought.
Stories and music, their character, comes from combined motifs and themes. These are what gives them meaning. Creation is tied to meaning; one can’t separate human meaning out of the conversation. Without human meaning - new perspectives gained, beauty found - all things are equivalently pointless, and all an LLM is doing is shifting (very high-order, having gone through the steps to end up in training data) entropy around.
“We” do, we could, if organized. Per your first point, that is the problem today - agreeing on a shared goal rather than infighting about all the peripheral issues.
I would hazard a guess theres stuff that I don't agree with you on, and we would want certain laws written differently. Its important to remember that we all vote for what we think is right, based on a system evolved over thousands of years to cater for human fallibility. The modern rhetoric of "us against the billionaires" is simply not how the world works, despite how much people want it to.
The modern rhetoric is indeed reductive if you put words in the poster's mouth.
The comment was about 'us vs the ruling class', which is very much how the world works.
Your knowledge of history is equally flawed, if you believe modern democracy is some kind of evolutionary apex tenderly nurtured for the greater good for thousands of years.
This ignores the reality that many people are, unfortunately, taking that one iPhone picture, sending it to everyone in their contacts list as if it’s art, and then moving on to the next slop shoot.
reply