💡 The paper presents JoyAI-Image, a unified multimodal foundation model that integrates visual understanding, text-to-image generation, and instruction-guided image editing. The model combines a spatially enhanced Multimodal Large Language Model with a Multimodal Diffusion Transformer, allowing for a shared multimodal interface between perception and generation. The authors propose a scalable training recipe that incorporates unified instruction tuning, long-text rendering supervision, spatially grounded data, and general and spatial editing signals. This design enables the model to achieve broad multimodal capabilities while strengthening geometry-aware reasoning and controllable visual synthesis. The experiments demonstrate that JoyAI-Image achieves state-of-the-art or highly competitive performance across various benchmarks, including understanding, generation, long-text rendering, and editing tasks. The model's bidirectional loop between enhanced understanding, controllable spatial editing, and novel-view-assisted reasoning enables it to move beyond general visual competence toward stronger spatial intelligence. The results suggest a promising path for unified visual models in downstream applications such as vision-language-action systems and world models. Overall, the paper contributes to the development of a unified multimodal model that can effectively understand and generate visual content with enhanced spatial intelligence.

💡 The paper introduces SenseNova-U1, a unified multimodal model that integrates understanding and generation into a single process, overcoming the traditional divide between these two tasks. Current large vision-language models treat understanding and generation as separate problems, leading to fragmented architectures and misaligned representation spaces. The authors argue that this divide hinders the emergence of native multimodal intelligence and propose a new paradigm, NEO-unify, which views understanding and generation as synergistic aspects of a single process.

The authors present two variants of SenseNova-U1, built on dense and mixture-of-experts understanding baselines, and demonstrate their performance across various tasks, including text understanding, vision-language perception, knowledge reasoning, agentic decision-making, and spatial intelligence. The models also excel in image synthesis, infographic generation, and interleaved vision-language generation, showing strong semantic consistency and visual fidelity.

The paper provides detailed information on model design, data preprocessing, pre- and post-training, and inference strategies, supporting community research. The results show that SenseNova-U1 models perform strongly in vision-language-action and world model scenarios, indicating a broader roadmap where models can think and act across modalities in a native manner. The authors conclude that multimodal AI should focus on building a unified system, rather than connecting separate systems, allowing necessary capabilities to emerge from within. Overall, the paper contributes to the development of unified multimodal models that can integrate understanding and generation, paving the way for more advanced and native multimodal intelligence.

💡 The paper introduces AlphaGRPO, a novel framework that enhances multimodal generation capabilities in unified multimodal models. The problem addressed is the need for improved multimodal generation without requiring an additional cold-start stage. To solve this, the authors apply Group Relative Policy Optimization to AR-Diffusion Unified Multimodal Models, enabling self-reflective refinement and decompositional verifiable reward mechanisms.

The method involves using Decompositional Verifiable Reward, which decomposes complex user requests into atomic, verifiable semantic and quality questions. These questions are then evaluated by a general multimodal language model to provide reliable and interpretable feedback. This approach allows the model to perform advanced reasoning tasks, including reasoning text-to-image generation and self-reflective refinement.

The results show that AlphaGRPO yields robust improvements across multimodal generation benchmarks, including GenEval, TIIF-Bench, DPG-Bench, and WISE. The framework also achieves significant gains in editing tasks on GEdit without training on editing tasks. The experiments demonstrate that the self-reflective reinforcement approach effectively leverages inherent understanding to guide high-fidelity generation, validating the effectiveness of AlphaGRPO. Overall, the paper contributes to the development of more advanced and reliable multimodal generation models.

💡 The paper introduces Cosmos 3, an omnimodal world model that can process and generate multiple data types, including language, image, video, audio, and action sequences, through a unified mixture-of-transformers architecture. This model is designed to jointly process and generate different modalities, effectively combining vision-language models, video generators, world simulators, and world-action models into a single framework. The Cosmos 3 model achieves state-of-the-art performance in various understanding and generation tasks, demonstrating its ability to serve as a scalable and general-purpose backbone for embodied agents.

The key contribution of the paper is the development of a unified architecture that can handle multiple input-output configurations, allowing for seamless integration of different modalities. The model is evaluated on a diverse suite of tasks, including text-to-image and image-to-video generation, and policy modeling, and achieves superior performance compared to existing models. The authors also make their code, model checkpoints, curated synthetic datasets, and evaluation benchmark available under an open-source license to accelerate research and deployment in Physical AI.

The results show that the Cosmos 3 model establishes a new state-of-the-art in various tasks, and its post-trained models were ranked as the best open-source models in text-to-image and image-to-video generation, as well as policy modeling. The availability of the code and model checkpoints is expected to facilitate further research and development in Physical AI, and the Cosmos 3 model has the potential to become a widely-used backbone for embodied agents. Overall, the paper presents a significant contribution to the field of Physical AI, demonstrating the effectiveness of omnimodal world models in achieving state-of-the-art performance in a wide range of tasks.

💡 The paper introduces a unified multimodal model that formulates computer vision tasks as generation problems using natural language and visual prompts. This approach allows for a single model to perform a wide range of vision tasks without requiring task-specific architectures. The model, called SenseNova-Vision, uses natural-language instructions and optional visual prompts to specify tasks and generates responses as text, images, or mixed text-and-image outputs. To support large-scale training, the authors created the SenseNova-Vision Corpus, a computer-vision instruction-response corpus that spans text, image, and mixed targets. The model is trained on this corpus, along with auxiliary multimodal data, and achieves performance comparable to specialized systems across diverse vision tasks, including detection, OCR, keypoint estimation, segmentation, and camera pose estimation. The results demonstrate that a single unified model can match leading task-specialized systems, suggesting that unified multimodal generation is a scalable route for integrating computer vision capabilities into general-purpose foundation models. The model and corpus are publicly available, providing a valuable resource for the research community. Overall, the paper presents a significant contribution to the field of computer vision, offering a unified and flexible approach to tackling a wide range of vision tasks.