🔥 DreamX-World 1.0: A General-Purpose Interactive World Model

💡 DreamX-World 1.0 is a general-purpose interactive text-to-video model that generates long-horizon content with camera control and scene persistence. The problem addressed by this model is the need for a controllable and interactive world model that can generate high-quality video content. To solve this problem, the authors introduced several new methods, including a lightweight variant of projective positional encoding called E-PRoPE, which retains projective camera geometry while applying camera-aware attention to spatially reduced tokens.

The authors also converted a bidirectional video generator into a few-step autoregressive world model using causal forcing, DMD-style distillation, and long-rollout training. This training process exposes the model to its own generated history, reducing style and color drift that accumulates across autoregressive chunks. Additionally, the authors introduced Memory-Conditioned Scene Persistence, which retrieves earlier views through camera-geometry-based retrieval, and residual recycling, which makes the conditioning path less sensitive to imperfect memory latents.

The model also includes Event Instruction Tuning, which adds composable event control, and reinforcement learning alignment, which recovers camera control and visual quality after distillation. To improve efficiency, the authors used mixed-precision DiT execution, residual reuse, 75%-pruned VAE decoding, and asynchronous pipeline parallelism, allowing the model to reach up to 16 FPS on eight RTX 5090 GPUs.

The results show that DreamX-World 1.0 achieves a camera-control score of 73.75 and an overall score of 84.76, outperforming HY-WorldPlay 1.5 and LingBot-World in overall score. The model's ability to generate high-quality video content with camera control and scene persistence makes it a significant contribution to the field of interactive world models. Overall, DreamX-World 1.0 is a powerful tool for generating interactive and controllable video content, with potential applications in a variety of fields, including gaming, simulation, and education.

📅 Published on Jun 15

🔗 Links:
• GitHub: https://github.com/huggingface
• Project Page: https://huggingface.co/papers?q=projective%20positional%20encoding
• arXiv: https://arxiv.org/abs/2606.16993
• PDF: https://arxiv.org/pdf/2606.16993

🤖 Models citing this paper:
• https://huggingface.co/GD-ML/DreamX-World-5B

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#TextToVideoSynthesis #InteractiveWorldModels #VideoContentGeneration #ScenePersistence #CameraControlMechanisms

🔥 AlayaWorld: Long-Horizon and Playable Video World Generation

💡 The paper presents AlayaWorld, an open source framework for creating interactive generative worlds that can be used in real time. Traditionally, video game worlds are built using labor intensive production pipelines, which are costly to develop, difficult to customize, and expensive to modify after deployment. Recent advances in video world models offer a new approach, where models can synthesize future observations conditioned on the current world state and user interactions, allowing playable worlds to be generated online.

The AlayaWorld framework addresses this problem by providing a modular architecture that enables real time user interaction and supports diverse actions. The framework is trained on both gameplay recordings and real world videos, which allows it to capture diverse visual appearances and physical dynamics. This enables the creation of interactive applications beyond gaming, including embodied intelligence.

The AlayaWorld framework provides a full stack solution, including data preparation, model architecture, model training, inference acceleration, and deployment. The framework is modular and extensible, allowing users to easily customize and extend it. The authors also release reproducible pipelines, reference implementations, evaluation tools, and comprehensive documentation, making it easier for others to use and build upon the framework.

The contributions of the paper include the development of the AlayaWorld framework, which enables open ended real time interaction and allows users to freely navigate and perform diverse actions. The framework also provides a practical foundation for future research and real time applications of generative world models. Overall, the paper presents a significant contribution to the field of video world generation, enabling the creation of interactive and dynamic worlds that can be used in a variety of applications.

📅 Published on Jul 7

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.06291
• PDF: https://arxiv.org/pdf/2607.06291
• Project Page: https://alaya-lab.github.io/AlayaWorld/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#GenerativeWorlds #VideoWorldGeneration #InteractiveWorldModels #RealTimeWorldSynthesis #PlayableWorldCreation

🔥 ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

💡 The paper presents ABot-World-0, a system for real-time, long-horizon, closed-loop interaction in a virtual world. The system is trained on a large dataset of videos, games, and simulation engines to learn controllable world dynamics. The authors propose a multi-source data infrastructure to collect and process data, and a unified pipeline to apply quality checks, assessment, and synchronization of actions and text annotations.

The system uses a teacher-forcing approach to train an action-conditioned video world model, which is then distilled into a causal student model through a process of teacher forcing and ODE distillation. The authors also introduce Long Forcing, a method to align long student self-rollouts with an extended-horizon teacher, mitigating accumulated distribution shift and autoregressive drift.

The system provides a unified control interface for scene roaming and third-person character interaction, and uses reference-character memory to provide persistent appearance cues for identity consistency during third-person rollouts. The authors also co-design a streaming inference stack with a lightweight VAE decoder, efficient attention, memory-aware scheduling, and low-bit DIT inference.

The results show that ABot-World-0 can stream 720p video at up to 16 frames per second on a single NVIDIA RTX 5090 desktop GPU, with 1.2 seconds action-to-first-frame latency and approximately 19 GB peak VRAM. Experiments on World Roam Benchmark and extended interactive rollouts demonstrate competitive controllability and coherent long-horizon world evolution. Overall, the paper presents a novel approach to real-time, long-horizon, closed-loop interaction in virtual worlds, with potential applications in fields such as robotics, gaming, and simulation.

📅 Published on Jul 21

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.19191
• PDF: https://arxiv.org/pdf/2607.19191
• Project Page: https://abot-world.amap.com/

🤖 Models citing this paper:
• https://huggingface.co/acvlab/ABot-World-0-5B-LF

🚀 Spaces citing this paper:
• https://huggingface.co/spaces/acvlab/abot-world-interactive

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#VirtualWorldSimulation #InteractiveWorldModels #RealTimeWorldDynamics #ClosedLoopInteraction #ArtificialIntelligenceForGames