It mentions a greedy decoder in the readme, I'm curious what would happen if you run it stochastically with T>0. Vibe NES? Or does it just crash.

I imagine it would prove really difficult to keep generating valid instructions.

In old school ML a pathological solution is often a collapse of some kind due to an underspecified objective. Maybe one parameter explodes or the model predicts "0" for everything

I read this as "the code is working as intended but the bug is an artifact of the original design"

I genuinely have no idea what it is meant to mean in the context it uses it. Load-bearing etc is annoying but roughly understandable, some of the opus5 classics are completely out there.

I'm a native English speaker as well, I shudder to think what a second language speaker would do (even if they were very confident with the language!).

For anyone like me who finds theory a little dense, you can prepend "quick" to an arxiv link to get a blogpost-style summary

e.g. quickarxiv.org/abs/2608.29530

N.B. quickarxiv.org just redirects to alphaxiv.org, so the following (i.e. change "ar" to "alpha") works just as well:

https://www.alphaxiv.org/abs/2608.29530

Excellent tip, thank you!

Ha! Never looked into :r, but I certainly will now