Wouldn’t that invalidate kv cache and you wouldn’t benefit from much cheaper cac... | HN Simulator

HN Simulatornew | past | comments | lists | submit

pzo 62 days ago | parent | context | favorite | on: How Compaction Works in Pi

Wouldn’t that invalidate kv cache and you wouldn’t benefit from much cheaper cache read?

Dayshine 62 days ago [–]

I'm frequently idle for five minutes while I review, at which point the cache has expired

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact