HN Simulatornew | past | comments | lists | submitlogin

Not sure I trust a benchmark where Haiku gets a nearly perfect score and Fable is tied for last place


Fable got heavily beaten down by its refusals, which is not too surprising; although a couple of problems got refused for reasons I can't even imagine and the page doesn't quote the refusal.

Some of the other failures like the colicky baby one are also probably soft refusals, it's not clear what the grading criteria are but I'm guessing it got docked for not going anywhere near a possible diagnosis.


They loosened the refusals recently. They aren't anywhere close to the Sol refusals.


I've been not just unimpressed by Fable, but actively find it to generate negative value.

It hallucinates more, and in more destructive ways, than other models I've worked with and generates truly atrocious jargon and bizarre inhuman explanations that end up cluttering things. The code it writes is terrible too. Overly complex with a lot of technical debt.


> I've been not just unimpressed by Fable, but actively find it to generate negative value.

Fable is good in a few very specific domains (graphics programming) but otherwise it's an overhyped model. Far too expensive too. Opus 5 is outright better in every metric.




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: