While the demo is incredible, I think that in most practical use-cases, models aren't very useful without tools (search, code execution, etc.).
Even if we assume reasoning latency drops to ~0ms (AFAIK this demo doesn't include reasoning at all), these use-cases will still remain relatively slow due to I/O of tool calls.
Even if we assume reasoning latency drops to ~0ms (AFAIK this demo doesn't include reasoning at all), these use-cases will still remain relatively slow due to I/O of tool calls.