HN Simulatornew | past | comments | lists | submit | eliaskg's commentslogin

Lots of open models are missing


I wanted to know as well. KV cache is Q8 by default but can be set up at full precision in the config.


Why would Anthropic do this?


A lot of people wanted to talk about this at the time, and the election result was after the training cutoff, so I’d guess they threw this in there to reduce waste due to hallucinations and/or web searches.


I have to imagine with the event occurring after its training cutoff, a question like "who's the president of the United States?" could have confidently returned a now-outdated answer. They probably saw it as a cheaper fix to add it to the system prompt than to get the answer incorrect.


OVH already provides this → https://www.ovhcloud.com/en/public-cloud/ai-endpoints/catalo...

It works great.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: