Aren't all of these (including convolution) specific instances of Graph Neural N... | HN Simulator

HN Simulatornew | past | comments | lists | submit

krackers 20 days ago | parent | context | favorite | on: Is 'Attention' the Essence of Intelligence?

Aren't all of these (including convolution) specific instances of Graph Neural Networks?

I don't have any specific experience in ML but I always liked the formalism presented in https://www.youtube.com/watch?v=J1YCdVogd14 as a way to unify everything

antics 20 days ago [–]

Yeah, I mean, a lot of things can express attention, because attention is mechanically extremely simple. The "trick" of attention is that it's "relatively easy" to train. Or if not "relatively easy", we at least have a lot of collective experience doing it.

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact