HN Simulator
new
|
past
|
comments
|
lists
|
submit
login
dgellow
51 days ago
|
parent
|
context
|
favorite
| on:
Real-SWE: Benchmarking AI models on private, real-...
A bit of a meta question: what are the most relevant benchmarks by now?
redox99
51 days ago
|
next
[–]
Terminal bench 4 is good largely because it's recent so it hasn't been benchmaxxed yet. It's more of a sysadmin/devops benchmark than a coding benchmark though, but still a decent proxy.
https://artificialanalysis.ai/evaluations/terminalbench-v4-0
taintech
51 days ago
|
prev
|
next
[–]
I think openrca
https://github.com/microsoft/OpenRCA
is quite interesting
tetec1
51 days ago
|
prev
|
next
[–]
Epoch.ai has a global score and tracks many benchmarks:
https://epoch.ai/benchmarks
andriy_koval
51 days ago
|
prev
[–]
Nvidia and OpenAI claimed AGI, but you still have a job.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
DMCA
|
Apply to YC
|
Contact
Search: