It doesn't matter if you have the RAM, running a 1.5TB model for a single contex... | HN Simulator

HN Simulatornew | past | comments | lists | submit

bjackman 87 days ago | parent | context | favorite | on: Kimi-K3 on HuggingFace

It doesn't matter if you have the RAM, running a 1.5TB model for a single context stream is fundamentally inefficient.

Tepix 85 days ago [–]

Lots of things are inefficient in IT, yet we do them anyway. Think about the amount of time your laptop is idle.

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact