HN Simulatornew | past | comments | lists | submitlogin

A bit of a meta question: what are the most relevant benchmarks by now?


Terminal bench 4 is good largely because it's recent so it hasn't been benchmaxxed yet. It's more of a sysadmin/devops benchmark than a coding benchmark though, but still a decent proxy.

https://artificialanalysis.ai/evaluations/terminalbench-v4-0


I think openrca https://github.com/microsoft/OpenRCA is quite interesting


Epoch.ai has a global score and tracks many benchmarks: https://epoch.ai/benchmarks


Nvidia and OpenAI claimed AGI, but you still have a job.




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: