I'm just barely starting to wrap my head around mapping model sizes and quants to hardware components and constraints.

I don't get what this device is for.

I a million percent understand wanting 252GB-VRAM, that would get me a 280-320B model like glm-5.3 or deepseek-v4-flash, which would be a massive improvement over my gpt-oss:20b 16GB toy. I would gladly pay a grand for this, I would never pay ten grand for this, and it seems to be priced around a hundred grand.

So obviously the customer is commercial not consumer.

Can anyone planning a project around one of these at work share what their workload is shaped like and how they're modeling price/performance?

For instance, I don't get the 512GB of system memory, I'd gladly drop that to 128 to save money. Am I missing something about commercial workloads? Is a 1T parameter model at 20 tok/s more important to your workload than a 300B one at 60? Is it simply a co-dependency of not the model but the other software you're running on the machine thats using/interacting-with/being-driven-by the model?

Whats your napkin math to justify 100k? Actually thats not even really the question, its more like - whats your napkin math to determine between the "dual linked GB10" use case vs this product's use case vs an 8U supermicro with 4 cards use case.

if its not worth your time to write, its not worth my time to read

this goes 10x for all the slide decks and google docs and wikislop everyone's trying to pass off as an accomplishment lately

You're marginalizing yourself. I don't have hard data for writing, but I do for another area: YouTube Thumbnails. AI generated thumbnails outperform human thumbnails, often with a +2-5% delta in CTR. Yet "so many" people loudly complain about how they HATE AI thumbnails and block channels that have them. Clearly the incentive is there, and (in the case of YT) these are mobs of angry people who don't really matter but scream and bitch as if they did.

Good for them. I don't care. I'm not going to subject myself to slop just because some other people don't mind it.

I hate to say this but AI assisted short pitch deks from founder to angel (usually their first time) have improved with AI. But also, they follow the same formula so are sorta obvious. Still, the decks are generally more business focused than typical founders early deck being very product/solution oriented.

I really hate how the excruciatingly overdue reckoning for tech elites and income inequality is turning into this religious schism over AI and datacenters.

We're going to smash the looms rather than figure out how to share them, again.

The underlying issue is really capital ownership, what classifies as capital, protections around it, and how much leverage capital provides on a society and democracy (that part being the most important, IMHO).

Who owns the looms and what they do with them isn’t inherently an issue if all loom owners can do is buy an extra Yacht. Instead they can enforce ungoverned law on society through a combination of disproportionate influence in government and through market forces where private policy (especially at large) become nearly undifferentiated from law (the policy that benefits them becomes so widespread and normalized that alternatives are for all intent and purposes impractical or unreasonable, therefor private policy within a capital ownership domain is law).

But I think you’re right, as always we’re going to focus on the adjacent issues vs addressing the root of the problem.

What reckoning? This is not related to tech elites in the least, but simply a consequence of capitalism.

If your think smashing this generations looms will get you there, your mistaken. See what it took for communism to take hold, and plan for that

In the case of the US, 1929 and WWII bought significant changes. Then Reagan started the path back to the XIX century.

Pretty sure you misunderstood this person. I don't think they are advocating for the smashing of looms, rather fear that the movement that could redistribute the benefits of this new technology will go down that dark road again. I also think the reckoning is overdue, maybe it will never come to be. What reckoning? The reckoning for large scale IP theft, scaling up what they call "ghost work", the usage of natural resources and land which power data centers with no return to the people that depend on those and the already existing predatory and disgusting business practices that they have always partaken in. (I assume)

and flying. beef and flying are the two most impactful personal choices you can make (nearly everything else has a 'over a decade'/difficult-life-tradeoff factor). beef and flying are easy.