We don't have enough energy production for massive AI buildouts. New energy capacity will not come online fast. National and regional grids will be stressed contributing to impacts on populations and industries. New energy capacity will be expensive and if carbon-intensive will accelerate climate breakdown. Additionally at current fossil fuel prices, energy prices (will) rise dramatically. Currently planned locations for buildouts are suboptimal at best, horrible at worst and vehemently opposed by local populations. That could be NIMBYISM, but in this case it's probably justified: who would want a noisy, ugly-looking grey cube raising electricity prices near their house? And that's just one angle. There are many more. Nothing to do with "AI will take our jobs", that's a pretty low-effort justification/theory.