Governments have sued DRAM companies for price fixing and forming cartels before: https://en.wikipedia.org/wiki/DRAM_industry_price_fixing. They can absolutely step in and if there are evidence of price fixing or anti-competitive behaviours, can impose fines. The choice of whether to do that though is political.
And on that page govts have tried and failed at it also. Thinking the current prices are the result of fixing and not insane demand is surely going to lose in court. It’s trivial to show massive demand, and thus production line changes, as the driving forces here.
If you look over all such lawsuits, they extremely rarely succeed.
Is there any allegations of price fixing in this case? The demand just skyrocketed. Other than legislation like the defense act in the US I don’t know of any governments that have jurisdiction over these ram makers that mandate companies produce more of a product.
We don't have enough energy production for massive AI buildouts. New energy capacity will not come online fast. National and regional grids will be stressed contributing to impacts on populations and industries. New energy capacity will be expensive and if carbon-intensive will accelerate climate breakdown. Additionally at current fossil fuel prices, energy prices (will) rise dramatically.
Currently planned locations for buildouts are suboptimal at best, horrible at worst and vehemently opposed by local populations. That could be NIMBYISM, but in this case it's probably justified: who would want a noisy, ugly-looking grey cube raising electricity prices near their house?
And that's just one angle. There are many more. Nothing to do with "AI will take our jobs", that's a pretty low-effort justification/theory.
A single box may have that much resources available, but no software will use them efficiently alone. You end up having issues with NUMA, with your pagetable growing significantly forcing you to deal with hugepages and eventually memory fragmentation, and who knows what other kind of lovecraftian horror coming from the sheer complexity of a single system with that much resources. Turns out scaling vertically also has cost. That's why eventually you still want to scale horizontally. And that's not overcomplicating things for the fun of it, it's just tradeoffs.
For sure, but scaling vertically to that extreme is also unnecessary for the vast majority of systems. You can still have over a hundred cores without needing NUMA. And most systems will never even need that much.
reply