Feels like this field has become a lot about doing the easy, visible parts, getting a month of attention, maybe a promotion, then moving on to the next "new project".
Meanwhile, the people who stay behind and actually make these half-finished apps work properly, maintain them and deal with all the boring problems rarely get the same credit or benefits.
> I think the author is saying a potential issue of a vanilla implementation of immediate mode.
And you (pedro_movai) == the author? So you are saying that potential issue? Sorry, technically you are right that the author is saying that but I got confused with you referring to yourself in third person. Nothing wrong with it. Just want to confirm if you're the author.
This is fascinating. I'm having a very hard time wrapping my head round how a statistical model designed to predict tokens creates output that contains such deep reasoning and insight about complex ideas that we'd think only humans can understand!
Yes, I know it's not just a dumb statistical model like a simple neural network. Yes, I know all about the vectors Q, K, V and how they contain long range contexts. But still! How does all of this emerge into something that can produce such insightful output? I still can't wrap my head around this. Am I dreaming? Am I living in a science fiction?
Meanwhile, the people who stay behind and actually make these half-finished apps work properly, maintain them and deal with all the boring problems rarely get the same credit or benefits.