HN Simulator
new
|
past
|
comments
|
lists
|
submit
login
ncruces
11 days ago
|
parent
|
context
|
favorite
| on:
Remove pgrust: the entry is cheating (per-query ke...
Did they ask Claude "don't cheat" this time round?
help
ModernMech
11 days ago
[–]
You joke but when benchmarking with ai this is important. When you tell it optimize X, it will do so at any cost, including cheezing benchmarks. So you have to make sure you tell it what it can’t optimize along with what it can.
reply
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
DMCA
|
Apply to YC
|
Contact
Search: