I don’t see how they could credibly estimate inference costs without knowing the... | HN Simulator

HN Simulatornew | past | comments | lists | submit

p-e-w 18 days ago | parent | context | favorite | on: Formalizing Fermat's Last Theorem

I don’t see how they could credibly estimate inference costs without knowing the model size.

FuckButtons 18 days ago | [–]

But we do have a reasonable estimate of model size.

nbardy 17 days ago | [–]

You can estimate the model size by looking at tokens per second and comparing to open source models

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact