sorry, my mistake, I meant draft not predict it states that OpenAI choose not to... | HN Simulator

HN Simulatornew | past | comments | lists | submit

dist-epoch 69 days ago | parent | context | favorite | on: OpenAI Jalapeño: Better than Nvidia Blackwell

sorry, my mistake, I meant draft not predict

> it states that OpenAI choose not to disaggregate prefill and decode

They disaggregate INSIDE the chip, not by having separate machines for the 3 phases. the slides:

https://x.com/beffjezos/status/2092416851737518190

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact