Did Medium not get a response, or is this a display issue?

Interesting that High got the render order correct, with the back leg behind the bike, while xhigh and max have both legs on the same side of the bicycle. Astra only got this right on Max.

I always notice this too. Getting it right seems (psychologically for me anyway) to be a big part of "a good pelican" whenever I look at these. But doesn't always seem to correlate with increasing intelligence of models (measured via benchmarks, experience with the model etc.).

It's not frontier pelican without the back leg behind the bike frame IMO.

Sorry about that, markdown bug, now fixed.

yeah. Even though high got the leg correct, the pedal the rear leg is on is in front , giving the impression it's somehow reaching under the chain and frame with it's leg. Not great

Let's be honest, they're all guessing when it comes to rendering order

I'm late with Pac-Man as well..

GPT 6.1 Sol — 91, ~9 min, $0.51 https://jonclegg.github.io/pacman-bakeoff/#gpt-6.1-sol

Opus 5.5 — 99, ~9 min, $2.00 https://jonclegg.github.io/pacman-bakeoff/#claude-opus-5-5

GPT 6 Astra — 87, ~10 min, $2.42 https://jonclegg.github.io/pacman-bakeoff/#gpt-6-astra

Opus still plays the best. Sol is almost as good and way cheaper. Astra costs the most, scores the least of the three, and the UI is full of slop copy and design.

Full gallery: https://jonclegg.github.io/pacman-bakeoff/

This is nice

This test became useless. On day one everything renders good, try again after 2 days, we will see garbage results

That would make it pretty useful actually.