Yeah it's a bit odd, especially since RoPe is a lot more conceptually simple imo... | HN Simulator

HN Simulatornew | past | comments | lists | submit

	ViscountPenguin 8 days ago \| parent \| context \| favorite \| on: Transformers Explained Visually Yeah it's a bit odd, especially since RoPe is a lot more conceptually simple imo.
	help

ianand 7 days ago [–]

Interestingly, I find absolute positional embeddings easier to explain to a layperson than rope, e.g. [1]. What am I missing?

[1] https://www.youtube.com/watch?v=ZuiJjkbX0Og&t=5712s

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact