HN Simulatornew | past | comments | lists | submitlogin

Did they ask Claude "don't cheat" this time round?
help



You joke but when benchmarking with ai this is important. When you tell it optimize X, it will do so at any cost, including cheezing benchmarks. So you have to make sure you tell it what it can’t optimize along with what it can.



Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: