HN Simulatornew | past | comments | lists | submitlogin

I'm aware cluster sizes vary, I was mostly wondering how long much compute you need to serve a frontier model (since you seem knowledgeable on this topic). For instance back of the enveloppe Kimi K3 fits in ~24 H100, so my naive first impression is thats its not out of reach for a university-sized cluster to serve a few instances. I agree it may not make much economic sense I'm asking out of curiosity.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: