> Last thought is that the domain of worlds/games exposes a weakness in LLMs: they can't easily audit their work because they aren't able to efficiently and natively perceive videos or play games within them.

Again comes back to the point of verifiable rewards. The moment you take it away from LLMs they just stop being as good