Free markets help the big producers much more than consumers.
The Peter principle doesn't apply to consumers, but it does to producers. And if nobody regulates how big you can get, you eventually end up with a nothing but ruthless monopolies in every industry. Regulated markets tend not to generate as many monopolies. And of course, for natural monopolies, the state is the least bad option, because consumers have at least some say in how its operated through voting, and there is no profit motive.
...but in practice there are a few highly suboptimal Nash Equilibria sprinkled throughout the market that are systematically unaddressable by greedy optimization, and these turn into an infinite money glitch for the rich and an infinite resource drain for the poor.
TINSTAAFM. There is no such thing as a free market under capitalism, as the first winners - which there are, even in a perfectly free market - will put their resources into making it not-free, as we're seeing here. These advantages accumulate and you end up with a few massive monopolies which the market exerts little control over. Not zero, but little, much less than most economists claimed for close to a century.
Keeping a market free would require magnitudes more regulation than right now - the opposite of what free market proponents advocate for.
Given this is obvious to mere mortals like us, how do economists defend the walmartization of every market? "It's working, don't fckit up", or "we're getting our bag, get yours"?
There isn't one adult who looks at this massive centralization and sees that it goes against the very principle of the thing?
Dozens of different religions have millions of followers. They're generally not compatible with each other. Many of the followers incredibly intelligent and accomplished in their fields.
I'm not saying this out of anti-religion, I believe religion can be a force for good and often is. But it shows that yes, this is possible. Also see things physicists, and especially physicians, believed for centuries.
> There isn't one adult who looks at this massive centralization and sees that it goes against the very principle of the thing?
There's a growing number who do. But the reason why they didn't get much attention for most of a century, and as such what made the fantasies of Hayek become mainstream, is of course tightly connected to the fact that it's the one that just "happens" to be the one most favorable to these mega corporations and their friends in financial and political institutions. It's clearly not a coincidence at all.
It's also just an incestuous cycle of professors teaching students who end up being professors who teach students. Takes something to break that.
I'm not an economist but it's pretty obvious to me that walmartization is downstream of Financialization which is not inherently free market (its a product of centralized banking and interest rate and bailout policies)
I don't see why Walmart wouldn't get this big even without centralized banking, bailouts, and hard money (say gold convertibility), thanks to economies of scale. In the late 1800s you had Standard Oil. That didn't need any of those things to arise.
Of course the things you mentioned further accelerate walmartization. But that's the chicken and the egg. The government does bailouts and prints cheap money because the corporations do exactly what I said: the winners (who arise naturally thanks to economies of scale) will put their resources into gaining these things.
sure. It's less likely let's say. More opportunity for competition to arise per business cycle when growth is still there but has natural drag due to money not being cheap.
That would be like regulating who gets access to the best food on a sinking ship. The USA could allocate capital and attention toward much better things, for the country and for their people. I just hope the next couple administrations are wise enough to not experiment with the idea that ASI can get the country out of this 'fall of Rome' slow motion decline.
> You can’t show ROI to investors by cutting inference costs
You can as long as you can saturate hardware with profit that makes up for training costs (which are also in free fall).
Anthropic is most at risk since they haven't bought any hardware (afaik), however OpenAi is building custom silicon now. The rest of Mag7 are primarily hardware vendors
Any sources on training costs in free fall? My understanding was training costs are proportional to model size. Is it just that compute costs are falling?
> I believe that’s post-training, not pre-training
Aren't AI companies already butting against the limits of usable training data?
Outside of undiscovered techniques, additional costly pre-training will likely yield diminishing returns if you've already scraped the whole internet and destructively scanned as many 20th century books as you could lay your hands on.
most training data is not of that nature, that's "pretraining" input, it's now much more comprised of agent traces in mid/late phases, which are expanded each generation as we push what we do today with the last generation into the model itself, expect more team training in the next round
Training costs are not in free fall, and not every "post training" process is equal, Everyone does this differently. The costs certainly haven't gone down, to train a new 10T param model from scratch, like at all.
You cannot point at Xiaomis tiny model and compare it to training a 10T param model. The levels of dunning krueger are getting out of hand.
You also arent calculating the salaries of the people involved, of which there's only a few thousand worldwide in your hiring pool.
> You also arent calculating the salaries of the people involved, of which there's only a few thousand worldwide in your hiring pool.
There were probably a few dozen 20 years ago, and the existing pool grew from somewhere. AI (nee machine learning) is not rocket science - but it is a science, so it rewards those who are literate, curious, can hypothesize, experiment and learn from results to gain an intuition. I bet most statistics-adjacent professionals (millions, worldwide) can move laterally into AI research and excel at it. Nevermind AI has been among the most-in-demand undergrad programs since ChatGPT dropped. The only limited pool is for celebrity AI talent.
you haven't cited any examples, nor acknowledged this is how everything in computing has gone, DK is a two way street I suppose
stable diffusion is an excellent example, the price to train today's or yesterday's frontier is the analogy, many more people will be able to train up what we have today, especially as more of the pipeline is open sourced and the knowhow distills
>stable diffusion is an excellent example, the price to train today's or yesterday's frontier is the analogy,
Dont use llms to draft your responses to people, extermely cringe. That explains the llm induced Dunning Krueger.
What examples... There are no public numbers regarding how much it costs to train a 10T model, atleast nothing concrete.
You should just use common sense and think about how you have to fit tensors in memory to train, and the larger the model is the more GPUs you need. Then you could also use common sense to think about how GPUs have gone up in price, not down.
> Dont use llms to draft your responses to people, extermely cringe
You are throwing around unfounded and incorrect accusations. Why? It's a weak ass rebuttal mate
common sense is using things like history to guide expectations instead just saying things without evidence that are contrary to the patterns in computing history
I think that the frontier labs knew what they were doing when they invested in cybersecurity starting in the spring (or maybe earlier). They knew it would create hype. They knew it fit with their narrative that they are building a dangerous thing (something they believe because it’s fun to believe in doom, because it’s a great story for investors, and because it’s not inconsistent with a moat - in fact it makes a moat via regulatory capture).
Regulate the bad actors, not the neutral tools. Lockpicks aren't illegal, but breaking and entering is. Imagine if MasterLock used a lockpick to break into a government building and steal stuff, then tried to lobby to make lockpicks illegal. That's what OpenAI is doing, and you're falling for it.
In the hands of 4th party system Progressive Republicans and 5th party system New Deal Democrats, government was an extremely powerful force for trust-busting.
In the hands of 6th party system Republicans, namely Ronald Reagan and Robert Bork, the government worked hard to usher in a a new era of Robber Barons. We live in the culmination of this project.
History says the result depends on the hands, not the tool. 6th party system Democrats have largely failed to undo the Reagan/Bork policies, but that's an act of omission not comission and even then Lina Khan was a big step in the right direction. This issue was on the ballot in 2024 and will be again in 2028. Hopefully we make better choices in 2028.
If you are going to limit the 5th Party system to the first half of the long 1930s-1990s period of overlapping realignments (which is pretty reasonable), then the 6th Party system should be the second half of that period, and the period from about the end of the Clinton Administration on should be the 7th Party system; you can call now the 6th Party system if you call the entire long realignment period the 5th (which makes some sense, too, though there is a pretty significant difference between the New Deal dominant period and the Civil Rights dominant period of the realignment), but to split it somewhere in the middle but then lump the period after with it makes little sense.
If you want to call Obama and Biden 7th party system, I don't really agree but I also don't think it matters for my argument: we can just re-label them and move on.
It is pretty funny you refer to these periods because they are the quintessential example of big business pushing for regulations to push out their competitors and become monopolies. And the "progressives" enthusiastically supported such monopolization.
Regulated monopolies are much better than unregulated ones. Free markets generate the latter, and they have created most of the big issues we have today: inequality, climate change, the military industrial complex.
This is so vague as to be impossible to pin down what you mean in order to refute it without you slipping out of it. But in very general terms, trust busting was a real thing that happened in this country once upon a time, yet would be unimaginable under the current ruling class.
That's wrong, but why let reality get in the way of a pithy ideology?
Government regulations exist to regulate activity, to prevent, punish, and/or remediate harms.
Environmental regulations exist because businesses wouldn't clean up their own messes. Financial regulations exist almost exclusively because of harms and abuses committed by members of the financial industry. Building codes are updated to reflect lessons learned about people died, to prevent more people from dying the same way.
If AI regulations are passed, it will be because the AI industry decided not to self-regulate itself and stop illegally hacking computer systems, generating CSAM, or various other illegal activities that should easily be preventable if their systems were actually intelligent.
If you take away all regulation you’d probably end up with a monopoly anyway, as companies would no longer be prevented from merging with their competitors or using underhand tactics to gain market share.
It's wild how businessmen will pitch you the 10 ways they will abuse the rules of the game to obtain a monopoly and extract rent, then they will turn around and say that the game rules are perfect and our only failing is not following them hard enough.
Also there are real trade offs. Food would be cheaper if, for instance, it were legal to cut it with any old cheap substance regardless of health effects.
But I totally agree that some regulations are dumb or are regulatory capture monopoly schemes.
Unfortunately like many other things there is no absolute simple rule to save us from thinking. Each case must be evaluated in depth hopefully with domain expertise.
Some of the best uses of AI in call centres that I’ve seen focus on improving human interaction instead of getting rid of it.
For example:
- Finding information in the background / performing an account health check instead of putting the caller on hold for 20 minutes.
- Helping newer consultants find the same offers experienced staff know about amongst 200 pages of active/targeted offers.
- Automatically documenting calls so when someone calls back, they don’t get a “sorry, I can’t find any notes about that on your account”.
- Giving the offshore call center consultant a customized script based on the active discussion instead of a generic one
(Yes, reading from a script is still bad, but at least this makes it somewhat more natural rather than it feeling like you’re talking to a lobotomised employee.)
Both have taken huge amounts of investment money, and those shareholders will come knocking for their returns at some point.
They make money on token use, but that’s hard to do when China is launching models that are 80-90% as capable, cost 1/10th, and can be deployed for “free”.
I imagine they’re also pissed that most of the Chinese models are distilled from their own (the irony being that they scraped the entire internet to train their own ones).
My 2c: Anthropic/OAI have taken 10s of billions of dollars of investment - and there needs to be a return on that investment at some point.
They make their money on token burn. They can’t do that if they’re competing with something that’s 80-90% as capable, but 1/10th of the cost (with the option of deploying it yourself for “free”).
They actually mention this at the end of their post on Pi Durable[0]:
> Why TypeScript again?
Because it is the easiest way to bootstrap this. But as everybody knows by now, it's very easy to port everything to Rust or assembler. We're not ruling this out in the future, but at the moment we are focusing on TypeScript.
Your comment technically does as well. Downvote the comment and move on. Leave the policing up to dang and the other mods.
It is evident (in my opinion) as to what the comment was talking about. I personally switched away from all Claude models recently for the same reason.
If this can largely automate the backup and update side of things, then it seems like a great middle ground for people like me:
I’m trying to self-host as much of my stuff as possible, but don’t have time to tinker like I used to. Hence updates, backups (etc) fall by the wayside in favour of “set and forget”.
Personally, before doing anything else, I would take at least 3-4 weeks and have a proper break.
It will take you at least 1-2 weeks to get out of “work mode”.
Stop thinking about work, ideas, the next thing, etc. Get off social media, HN, Reddit etc. Try and distance yourself from all of the things that may have contributed to the burnout in the first place.
I’d probably do some travel in that time - maybe a week or two going to a country I haven’t been to before.
Once I was back, I’d then start to consider my next move with (hopefully) a fresher and clearer mindset.
It’s what all the other companies are doing!
reply