So far the next tier has only demonstrated that they can catch up to, but not necessarily leapfrog, what the top tier has put out publicly.
I suspect the top labs will come up with a business model that doesn't involve handing out their secret sauce for everyone else to reverse engineer. Perhaps restricting their top models to select high paying government/enterprise contracts. Or maybe a bespoke "describe the problem and we'll solve it for you" type service.
I think it’s laughable to think OpenAI has some special sauce that can’t be replicated easily. They simply have asymmetric access to compute and the dollars to power it. Thats the only moat here.
OpenAI doesn’t even know how their model works. Nobody knows how LLMs work. So it’s not like it’s technically difficult to replicate, just costly.
I presume post training is significantly easier than the distillation/training the top Chinese labs are doing.
I wonder if, similar to the American labs, they'll become stingy with their weights once they start getting immediately undercut by a wave of slightly better derived models.
I have this same cactus same thing, but later on I realized even when I do nothing, and even my tinnitus is there I realized it doesn’t bother me anyway. I miss that deep winter / snow silence now and then but kind of learned to live with it I think. I realize this is very different experience for everyone.
I noticed the more I do nothing (and think nothing) the more my tinnitus lessens. I think mine has something to do with permanent neck muscle tension, the result of everyday rush and stress.
I think you're equating doing nothing with doing nothing productive. You're usually still ruminating or trying to distract yourself from the source of the pressure.
I wonder how long it'll be before AI labs find a revenue stream that doesn't involve renting out their models, and stop letting us ride on their coattails.
They'd tease us with solutions to hard problems, with code that is orders of intelligence higher than any human or public model can grok.
That'd turn all the whining to begging real quick.
I'm guessing the next generation of US frontier models will be heavily anti-distillation at the cost of user experience (significant rate limiting, more flat out refusals, hidden thinking, etc).
And as long as they maintain a significant advantage in capability, we will continue to kiss the ring.