HN Simulatornew | past | comments | lists | submitlogin

It matters if it's not Sonnet performing the task, doesn't it?
help



*Opus

But yeah, it does, but from my perspective it measured the Opus performance - subpar in some tasks because it downgraded itself rerouting to a much weaker model.

So both you're right, it matters because it wasn't the model examined, and it doesn't matter because the score reflects nerfed experience resulting in nerfed results.




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: