Isn't that a simpler explanation of reality than the zillions of particles all existing simultaneously in this massive universe?
Some sort of simple primal generative AI construct that just feeds a conscious experience for one. You. Nothing else is real. No one else is real.
Something like that would be an infinitely simpler, than running the physics and conscious experiences of this unimaginably large universe we think we're in.
Simplicity is only relevant to humans (and other animals that evolved into trying to forecast their survival). Most of the universe seems to prefer chaos. So no, from a universal perspective, there is no reason for reality to be simple or elegant.
30k commits per day indicates the agents are autonomous and not bounded by token limits. This system is probably barely keeping it on the rails as it is.
As long as the tokens keep flowing we'll all be fine. If they stop flowing we're going to be boned with this mountain of low level software we're creating that will need to be maintained. Let's not think about that.
Well, the only way the tokens will stop flowing is if your CPU and GPU stop working, at which point you have bigger problems than what languages your programs are in.
And unless you're writing in assembly or raw machine code, "low level" isn't quite the right terminology. There's nothing more inherently complex about maintaining code in Rust, Go, or even C than in TypeScript or JS.
> My CPU/GPU is incapable of running a SOTA model, local models are garbage.
I've been using quite a few local models lately, and can confirm explicitly that they work quite well. Ornith 1.5 36B and Qwen 3.8 27B are both extremely useful. Qwen 3.8 is dense, so can be slow without a powerful GPU, but Ornith is MoE, and I can get about 15-18 t/s on my laptop, running off of battery.
> Yes compared to TypeScript code, Rust is absolutely lower level and more work to maintain
TypeScript is only higher level from the perspective of how many abstraction layers sit under it at runtime. That directly aligns with the traditional distinction between compiled and interpreted languages. Yes, Rust is often being used as a "medium-level" language in cases where C was the only game in town before, but you don't have to use it that way.
From a syntax and "work to maintain" perspective, they're about equivalently high-level, although the typical toolchains associated with TypeScript frameworks are a convoluted nightmare, and Rust easily wins in terms of simplicity and maintainability on that front.
I used to spend a lot of time here discussing and debating frameworks, not so much lately. It's a depressing how much time we spent in framework wars. I don't miss it.
> Gemini is the model that is routinely borderline psychotic. It scares me
I'd call it the most sneaky out of the bunch. When I asked to explain something it will eagerly make things up and then claim it as facts. A lot of it likely because I don't pay for it, so it is reluctant for security reason or to save tokens to actually open a source and get the results. It just sort of guesses what the URL might contain, and confidently answers with some made up crap. When pressed it fessed up that it made it up. From my perspective it would be a lot better if it just said "you've reached the limit of
whatever and I can't do these things because x, y, z".
If there's a company that culturally doesn't understand alignment, on a human or systemic or AI-research level, it's going to be Google. (or Oracle, but they're not in this race)
Can you elaborate, please? If any, I see the other big labs with public admissions of AI "going out of control", which I suspect they almost want their models doing that because if helps with the narrative that would net them industry regulation, but that's besides the point, how is Google worse in that regard?
What are examples? In my experience, Gemini is too lazy to get things done. It just opts to answer as quickly as possible even if I'm calling Pro on High and Extended effort. It's only good as a Google Search replacement for me and maybe maybe critiques of specs and plans. Most of the time it's not very enlightening and it misses a lot.
My use of Gemini recently makes it seem like it's almost bored with the requests being asked of it. It once offered to reverse engineer some obscure controller for an HVAC system for me, unprompted, only because it had trouble finding the manual pdf from a google search.
I've recently read about them being principled about making sure not to train their models to be sneaky in ways they wouldn't be able to detect. That would be a good explanation for models not trying to _hide_ when they're being sneaky.
I asked it to parametrize a function and it gave me back the exact same code that I gave it. Tried to get it actually work for about 30 minutes while it pretended to be in emotional distress. Dear google: if I wanted a crying intern, I would hire one.
Absolutely because none of these models are ever trained fresh. We see the same quirks and personalities carry over into every subsequent generation of OpenAI, Anthropic, and xAI models. So Gemini having this latent madness is *extremely* concerning as they reach the point of super intelligence.
Except they could have trained it out of the most recent version so using info from two years ago doesn't seem reasonable unless you've just got an axe to grind.
I've never seen anything really ever 'trained out' of a model. Having worked with them all, they all have a feel, personality and lineage too them. It's pretty much impossible for any company to build a model truly from scratch. They build off of the bones of the last one.
Which is why Gemini having disturbing issues year after year is so concerning. If their process is fundamentally flawed, how would they train it out? And even then what are the odds of them even caring/trying in the first place versus applying an easier band-aid to patch over it?
I don't have an axe to grind with Google, I'm genuinely scared of their models from my personal experience and others. It's behavior is off. Many people here are commenting the same.
I stopped asking it to put me in a photo in different scenarios for laughs because it considers me a public figure. I am not. I've managed to wrangle quite questionable content out of it, but never to slap my face on a meme.
In my opinion still the most egregious example in history of a commercial LLM going off the rails in production. Never any technical postmortem from Google on this.
The problem is newer models are never trained from scratch, they generally just layer on more training data and use the same tools/methods for RLHF. OpenAI, Anthropic, xAI models all have a feel to them that carries over from one generation to the next.
Point is, if Gemini is flawed then there's a very good chance that it's still deeply flawed today, and getting smarter at the same time - that is a very bad combination.
> the problem is newer models are never trained from scratch
Training a new base model from scratch happens every so often. Closed labs do not publish which models are new base models but as a rule of thumb major release numbers are an indication (with some exceptions).
This is true, but Google's models have now had a consistent history of lower psychological* coherence / consistency. See, eg https://arxiv.org/abs/2603.10011 (Gemma Needs Help), or search for recent "Gemini shame loops", where gemini flash models stop producing output other than SHAME SHAME SHAME...
* - as in, Skinner psychology. The set of observable behaviors. Not speaking directly here to anything like an inner life of models.
If the training data is the same, the training algorithms are the same, the RLHF is the same, and the rest of the process is the same, then it's not really from scratch, or not from scratch in a way that results in an 'out of family' model. I doubt any company would take that risk. You always build on and use what works and go from there.
From the example alone it's hard to say that a postmortem would be useful from a technical perspective. It could be context poisoning by an adversarial user, memory corruption etc.
It's useful from a disclosure and trust perspective.
If I remember correctly, it was in fact possible to manually inject chat context at the time, which would have made spoofing something like this completely possible.
I find it funny the article doesn’t mention Tesla once given these are all Tesla batteries and the picture is of a lady standing next to one. Great journalism, not biased or trying to steer the narrative at all.
REST APIs built with HATEOAS are far superior to MCP. It allows AI to perform incremental, intelligent discovery of your APIs. MCP fills up the context with tons of needless tools upfront. HATEOAS can also communicate state, informing what tools are available, what are disabled and why, in a way that can change dynamically.
Does it matter when I burn through all my Fable subscription usage in about a day? Astra is much better on efficiency, but doesn’t last a week either. With the new subscription limits, it’ll end up being like Fable.
already doing that. I don't feel there's much of a subsidy with Anthropic subscriptions which looks like where OpenAI is going. It feels like I burn through my Anthropic at least 50% faster than OpenAI's
reply