And what does that "without knowing what the sentence is even" even mean? Care to elaborate/define it?

It means generated output is based on mathematical relations of vectors that represent words or part of words. I believe pre-language cavemen are intelligent with the caveat that transfer of knowledge is severely reduced. I am even tempted to say that cats and dogs are more intelligent than LLMs.

I'm not even tempted. It's a fact.

To me it merely signals that there are certain mathematical relationships in our language that can be deduced (by neural networks). Nothing more.

Even with pay-as-you-go pricing I find the models very economical currently (e.g. Opus 5.5). I regularly check in Copilot what I just spent vs. how long it would have taken me alone. Economics do now work out in my favor mostly.

> Economics do now work out in my favor mostly.

That means, it is mostly cheaper to do it with Copilot etc. and not alone, right?

Yes

Love this! Not having spent too much time on understanding the architecture I always struggled to see how transformers get away with compressing all context in a flat vector (e.g. 768 numbers here) between attention and the MLP when computing the current token. But now I think I understand that since you often alternate between attention and MLPs it regularly mixes/queries the information of other tokens into the current computation. Probably common knowledge for everyone that learned about transformers but this made it so much quicker to see.

When we rolled out an ERP in our Brazil subsidiary the whole internal consulting team immediately agreed to leave our brains untouched by this complexity and hire a local consultant team as help. And the local consultant team in turn immediately suggested useing a middleware provider.