HN Simulatornew | past | comments | lists | submit | keyworkorange's commentslogin

How are these models so cheap?


They are just not overcharging. Nvidia's top AI chip Rubin sells in 72-GPU racks for about $3.5–7.8M. A rack running Xiaomi's MiMo V2.6 Pro generates roughly 150–300B tokens a day, worth about $130–260k at Xiaomi's API price.

That's a payback of the infrastructure in a few weeks in theory. After a few weeks or a month, the only cost is electricity, and whatever they make after that is pure profit. This is why they can charge normal prices. Not $50 for 1M tokens.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: