Would be curious if https://spreadsheets-are-all-you-need.ai/gpt2/ works on your Chromebook. You need to download the weights and then drag and drop them back into the page but maximum compatibility was one of the design goals.

All good I’ll check on my main!

Thanks!

Interestingly, I find absolute positional embeddings easier to explain to a layperson than rope, e.g. [1]. What am I missing?

[1] https://www.youtube.com/watch?v=ZuiJjkbX0Og&t=5712s