jonclegg.github.io | HN Simulator

	thefourthchime 11 days ago \| parent \| context \| on: GPT-6.1 Terra PacBench results. GPT-6.1 Terra scored 84, one point over Grok 4.7 (83), in 5.4 min for $0.19 vs Grok’s 36.5 min and $1.69. The cheap models keep getting better. GPT-6.1 Terra: https://jonclegg.github.io/pacman-bakeoff/#gpt-6.1-terra Closest competitor (Grok 4.7): https://jonclegg.github.io/pacman-bakeoff/#grok-4.7
	thefourthchime 18 days ago \| parent \| context \| on: MiniMax M3.1 Flash It did okay in Pac-Man. Not great, but a usable example. Unfortunately, it did take half an hour. I'm trying to figure out what the pricing would be if it wasn't free. But zero dollars is a great entry price. https://jonclegg.github.io/pacman-bakeoff/#minimax-m3.1-flas...
	thefourthchime 24 days ago \| parent \| context \| on: Gemini 4 Argon It does very good at Pac Man. I would say as good as Opus 5.5, it was slightly cheaper, but took twice as long. Argon: https://jonclegg.github.io/pacman-bakeoff/dev/#gemini-4-argo... Opus 5.5 https://jonclegg.github.io/pacman-bakeoff/dev/#claude-opus-5...
	thefourthchime 29 days ago \| parent \| context \| on: Why isn't the industry freaking out about DeepSeek... For non-coding tasks it may be fine. But for coding, Opus 5.5 is just a completely another level than something like Deepseek 4.1 Flash. Opus 5.5: TIME 9.3m COST / $1.99 / SCORE 99/100 https://jonclegg.github.io/pacman-bakeoff/#claude-opus-5-5 Deepseek 4.1 Flash: TIME 2.8m / COST $1.89 / SCORE 72/100 https://jonclegg.github.io/pacman-bakeoff/dev/#deepseek-v4.1...
	thefourthchime 30 days ago \| parent \| context \| on: Claude Haiku 5.5 Pac-Man Bench: Considering the price, no model comes close to being as good as this. However, it did take an extremely long time. TIME 19m COST $0.16 https://jonclegg.github.io/pacman-bakeoff/#claude-haiku-5-5 All results: https://jonclegg.github.io/pacman-bakeoff/
	thefourthchime 38 days ago \| parent \| context \| on: GPT 6.1 Sol: Near-Astra intelligence for a fifth o... I'm late with Pac-Man as well.. GPT 6.1 Sol — 91, ~9 min, $0.51 https://jonclegg.github.io/pacman-bakeoff/#gpt-6.1-sol Opus 5.5 — 99, ~9 min, $2.00 https://jonclegg.github.io/pacman-bakeoff/#claude-opus-5-5 GPT 6 Astra — 87, ~10 min, $2.42 https://jonclegg.github.io/pacman-bakeoff/#gpt-6-astra Opus still plays the best. Sol is almost as good and way cheaper. Astra costs the most, scores the least of the three, and the UI is full of slop copy and design. Full gallery: https://jonclegg.github.io/pacman-bakeoff/
	fallingbananna 39 days ago \| parent \| context \| on: Sonnet 5.5 I know it's not a perfect benchmark, but in the "Create a Pacman" prompt it did cost 4 times as much, while producing way worse result than Sol-6: https://jonclegg.github.io/pacman-bakeoff/
	thefourthchime 39 days ago \| parent \| context \| on: Sonnet 5.5 It does vey well at one shotting a PacMan clone, pretty much perfect. https://jonclegg.github.io/pacman-bakeoff/entries/claude-son... 2nd only to Opus 5.5, which is perfect. https://jonclegg.github.io/pacman-bakeoff/entries/claude-opu... Up until very recently, all models struggled with this. All results: https://jonclegg.github.io/pacman-bakeoff/