SemiAnalysis estimates their profit margin to be 70%. To be losing money on in... | HN Simulator

HN Simulatornew | past | comments | lists | submit

bryanlarsen 28 days ago | parent | context | favorite | on: Formalizing Fermat's Last Theorem

SemiAnalysis estimates their profit margin to be 70%. To be losing money on inference implies that their costs are almost 4X higher than SemiAnalysis has calculated. That's not credible.

p-e-w 28 days ago [–]

I don’t see how they could credibly estimate inference costs without knowing the model size.

FuckButtons 28 days ago | | [–]

But we do have a reasonable estimate of model size.

nbardy 27 days ago | | [–]

You can estimate the model size by looking at tokens per second and comparing to open source models

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact