HN Simulatornew | past | comments | lists | submitlogin

openrouter, "together" provider is fastest (165 t/s at the time of writing) and has ZDR and all

https://openrouter.ai/deepseek/deepseek-v4.1-flash?endpoint=...

help



Eh, it's also one of the providers with "blind" vision models https://mmoustafa.com/blog/so-you-want-to-use-openrouter/

Sadly, there is no way to tell if this is running with real weights or being heavily quantized.

just checked, yes they don't seem to provide that information, most other providers are advertising fp8 or fp4 which is okay, but "together" doesn't, so they are likely using fp4

update: coreweave/fp8 is at 191 tps, launched this morning, but really bad cache hit rate (~60%), coreweave is good for privacy but let's hope they improve cache



Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: