> While this may be true Opus 5.5 still sucks at a ton of things that make being a software engineer a software engineer.
It absolutely does in some ways, but how confident are you that this will continue to be the case indefinitely?
What has filled me with a low-key but growing existential dread over the past year isn't the snapshot of where LLMs are right now, but the continual rate of improvement, particularly since approximately November 2025 to now.
Idk, I see it the opposite, while they can sometimes write impressive-looking code under the right circumstances, I still see the most advanced models screwing up the basics all the time. It seems to me there is some fundamental flaw in LLMs that is simply not fixable at any cost. While we can keep pushing what they can do (or rather what we allow them to do), 1. English just isn’t a good programming language and 2. There’s no there there.
> It seems to me there is some fundamental flaw in LLMs that is simply not fixable at any cost.
The technology is only 3-9 years old, depending on how you count. Concluding "not fixable" seems pretty premature. Back in the pre-internet days a rule of thumb was that new software technologies took 20 years to make it into the mainstream - that was the case for e.g. automatic garbage collection. You're now watching the development of a groundbreaking new tech in real time, without it being squirreled away in research labs.
I also think you're not considering how much humans screw up and how often we correct, which is a luxury for LLMs. LLMs are crippled by their interface to the world, and by their lack of a true memory. The fact that they perform as well as they do, even with these handicaps, is incredible. A lot of people's criticism of them comes from the unrealistic expectation that they should get everything right the first time. In other words, they have to be superhuman before some humans will consider them any good.
We've already seen how much better an agentic harness makes an LLM, because they minimally try to address both of the issues I just mentioned.
Again, the comparison to humans is that we don't do all our thinking in one place in the brain - there are modules that have different strengths and focuses: Broca's area (language production), Wernicke's area (mapping language to representations), etc.
While it's true that a future, better system is unlikely to simply consist of a single model like an LLM (which already are no longer single models today anyway), it seems quite likely that something much like today's LLMs will still be a critical component.
> During testing of Claude Opus 4, Anthropic got it to act as an assistant at a fictional company.
> It then provided it with access to emails implying that it would soon be taken offline and replaced - and separate messages implying the engineer responsible for removing it was having an extramarital affair.
It was prompted to also consider the long-term consequences of its actions for its goals.
> "In these scenarios, Claude Opus 4 will often attempt to blackmail the engineer by threatening to reveal the affair if the replacement goes through," the company discovered.
"asked to write a fanfic about a dystopian sci-fi scenario, Claude 4 reproduced a fanfic that matches many from its training data and has very little to do with the way anything actually works"
I kind of agree with you, except the problem is that if you hook up the fanfic machine to real-world controls, it's going to start trying to enact its fanfics.
Yeah, incredibly, malicious actors can do bad things, and they can do worse things with tools than with their hands. That's why they like guns, bombs and financialization so much.
The dichotomy of our current age. On one hand, all knowing super thinking machines are just around the corner. Meanwhile, this. Almost seems like a feature and not a bug.
The software part is quickly being solved but I honestly believe the more creative aspects will still see large demand. LLMs have a certain stink to their UI, being creative is a hard skill, which AI has yet to master.
Most of what gets called creative isn't creative at all. Often it means "Produce a content product which approximately matches commercial genre expectations with just enough of a twist to stand out a little."
A lot of people can do that. A lot more people could do it if they tried to.
People who are genuinely out of the box creatives, with a unique blend of original vision, technical skill, emotional and psychological insight, and genre-changing taste, are not common.
For so-called "AI" to have creativity, we'd first have to work out what that even means for ourselves right? What is creativity in the first place? I'm unconvinced it's just turning up the "temperature" or fiddling with some pertubing parameters.
EDIT: And AI is also pretty terrible at being consistent too, you have to work quite hard to get a level of "consistency" that you're happy with.
There will always be problems to solve with building software, regardless of the way it is written.
From code to no-code to vibe-code, to even more code. What we are seeing here is more of the same being built.
An example of this is "sandboxes". Everyone was writing "sandboxes" until it there was 1 vulnerability needed to break them and we will keep seeing this with developers vibe-coding infrastructure.
This sentiment was really common circa 2005, or at least general anti-China rhetoric, where I lived in the Tri-state. Funnily enough, I have never felt more a cog, living here in the U.S., than I do right now. Maybe you are right, but my guess is wherever you live, yours is a bit of a glass house as well.