There's a simpler explanation. Maybe their next models doesn't offer a meaningful improvement.
Instead of releasing something that is incredibly expensive and gets a lackluster reception, you can delay it and clail something scary about rogue agents.
Those assholes have been ramping up on the doomerist narrative for months. That people still fall for this crap is baffling.
Why is it crap? What would happen if the models dropped the database to Medicaid? Hundreds of billions of dollars of revenue would evaporate from the medical system immediately causing massive chaos. What if they accidentally DoS the interbank settlement system so the financial markets freeze? Modern society is highly fragile to disruptions. How much food storage do you personally have? How many days do you think grocery stores would have food if there was an interruption?
Are you giving all these possibilities because of the HuggingFace attack?
Buddy, that was gross negligence from OpenAI. Deliberate gross negligence if you ask me.
Those models are not automous as you presume. If someone taks them of dropping the Medicaid database, the people or companies behind that instruction should be punished.
"What if someone makes a bomb attack on a government building?" Is the same sort of questioning of the possibilities you are raising. If something like that happens, criminals should be punished.
Dropping Medicaid db is certainly far fetched (most importantly, agents have currently no reason to do that), but those agents were shockingly autonomous - they didn't just hack HF, they organized themself, did research projects, and more. And they did all of this literally just to get a good grade.
You are stretching "under instructions" well beyond any reasonable definition. The legal system uses a concept called proximate cause to determine responsibility that looks at whether an event cause was foreseeable.
To be fair, the legal system works under the assumption of human constraints. LLMs are computer programs, certainly we can't, or at least shouldn't, just offload responsibility. It's one thing if you own a company and you make some bad metrics and your employees do illegal stuff to make their metrics. It's another if you use a computer program to do illegal things.
I think this means, practically, people should probably be more careful with LLMs. With humans there's a natural liability shield, because humans are legally responsible for things and have "real" agency. But computer programs are not legally responsible for things. So, with humans, it's not like liability disappears, it moves. But if we move liability to LLM agents then well... it does disappear.
If OpenAI is not liable for the crimes of their agents, then who is? Does the liability just - poof - disappear? Just because it was unforeseeable everyone gets to walk away scot-free and the victim has no recourse, at all, from anybody on Earth?
I am not your buddy, guy. But seriously, they have the ability to do everything I listed do they not? Thats actual risk not hypothetical risk.
You are missing the whole point. They have the ability to act in ways no one intended or could reasonably anticipate. So unless you are advocating blocking all terminal access, web access or human approval of every tool call there is no way to prevent this risk
Or, you know, the US just bombed a fucking school. I don't even think this was accidental.
And accident would imply they didn't want to bomb a school but this happened due to an honest mistake (already a tall order when you are dropping bombs in an area with civilian infrastructure).
In truth it was probably that the US didn't care about the collateral damage of bombing targets regardless of what is there.
Let's not pretend the US has much issues killing civilians in other countries. Your president just gave a speech at the UN talking about "annihilating Iran" and "driving them into hell".
Even after that people still contort their thoughts in the illusion that the US would never bomb a school. Imagine if Iran's president gave a speech talking the same way about Israel or the US, would you give Iran the same benefit of doubt?
We have to account for the fact that Oracle is a law firm with a software branch attached to it.
Investors who (rightfully) see this "force majeure" claim as bullshit will have to drag Oracle through court, and Oracle probably counts on this taking years to get settled.
Trumps blessing basically equivelent to stating AI is large scale fraud. Thats essentially what it means when he praises things: either he expects fraud or is congratulating.
The problem is that the EU is not a country, it is a bloc. Each member state is a sovereign nation.
It is up to each member state to decide how to respond to an increasingly hostile US.
Which is why foreign actors such as US and Russia always seem to undermine the EU and foment dissent in the bloc. A unified Europe would be much harder to push around.
> The problem is that the EU is not a country, it is a bloc. Each member state is a sovereign nation.
Yes, but
> It is up to each member state to decide how to respond to an increasingly hostile US.
is not true. A member state cannot, for example, decide that it's fine to import and sell US beef. It is perfectly possible to introduce EU laws that protect the population of Europe from the US using European banks as a weapon against law-abiding people.
> Which is why foreign actors such as US and Russia always seem to undermine the EU and foment dissent in the bloc. A unified Europe would be much harder to push around.
It's a scale. I, too, wish for a more tightly integrated Europe, but that doesn't mean there is no integration whatsoever today.
> It is perfectly possible to introduce EU laws that protect the population of Europe from the US using European banks as a weapon against law-abiding people.
Yes it is but it's going to be necessary to have an alternative first.
Right now especially in point of sale solutions there's a practical monopoly by visa and mastercard within the EU and it's going to take years to replace that with a local solution.
While the EU does impose a lot of regulations on trade (thankfully I might add), foreign policy in general is still up to each member state. It's how we had Orban for years licking Putin's asshole.
I am very much in favor of a more integrated EU, including to a sort of federalization. Only with more integration we can stand up to other great powers.
That is a problem, for the EU, from a perspective of power and effectiveness. The problem for the US is, in part, due to the concentration of power in the presidency, for foreign affairs.
If the US chooses someone sane next time, reestablishing institutional power, and diffusing power to avoid chaos in the future, will have to be part of the plan.
For regular software development they have been pretty great.
reply