It's like its simulation model is confined to the renderable area. At the cost of increased computation, it would not be hard to generalize the technique to rendering a sphere centered around the POV to keep some of those artifacts at bay; however, the fundamental limitation of "object permanence" remains if objects can evolve chaotically as soon as they are blocked from view by another object. For that to be made stable, you really need a whole 3D model of the scene, and the cost increase there might be huge.
> While it can maintain coherent environments over short sessions, visual details and object permanence can still shift or drift over time—especially as a simulation runs longer, after multiple complex prompt edits, or when navigating throughout the scene. Complex physical interactions, real-time audio accuracy, rendering legible text, spatial accuracy, and long-term consistency are active areas of ongoing research.
If it was actually not hard, they would have made their demo with it. I don't know the technical details, but I expect a product reveal like this to show the thing at its absolute best.
People seem to be leaping to the conclusion that this is "product" as opposed to, fundamentally, research work, posted on a lab blog post, showing off a capability they expect to be increasing interesting over time.
Just because they happen to be throwing in the option to sign up to to play with the Genie 4 into an Ultra plan, doesn't mean that this is a material part of the value prop for Gemini.
Presumably, they can learn something from how niche Ultra users interested in tech demos engage with it. If that's an upside, it's really unclear it why it would make sense for "a reveal" to promise something too expensive to deliver to such Ultra users. (None of which means that the suggestion that you are responding to is technically reasonable or possible--just that it is unclear that one should dismiss the idea because one views this through the lens of a consumer "product reveal"
Just because OpenAI had to crawl back from Sora to focus resources, and Anthropic proudly proclaims in their filing that they have been avoiding promising creative opportunities for the same reason, doesn't mean that Google can't continue to do lab/research stuff.
didn't they show off an interactive demo with genie3 where you could paint on a blackboard and go out through the window and come back and the same was still written on the blackboard?
> While it can maintain coherent environments over short sessions, visual details and object permanence can still shift or drift over time—especially as a simulation runs longer, after multiple complex prompt edits, or when navigating throughout the scene. Complex physical interactions, real-time audio accuracy, rendering legible text, spatial accuracy, and long-term consistency are active areas of ongoing research.