✨Robot Learning from a Physical World Model

📝 Summary:
PhysWorld enables robots to learn accurate manipulation from AI-generated videos by integrating video generation with physical world modeling. This approach grounds visual guidance into physically executable actions, eliminating the need for real robot data.

🔹 Publication Date: Published on Nov 10

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2511.07416
• PDF: https://arxiv.org/pdf/2511.07416
• Project Page: https://pointscoder.github.io/PhysWorld_Web/
• Github: https://github.com/PointsCoder/OpenReal2Sim

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#RobotLearning #Robotics #AI #PhysicalModeling #MachineLearning

✨IVRA: Improving Visual-Token Relations for Robot Action Policy with Training-Free Hint-Based Guidance

📝 Summary:
IVRA improves spatial understanding in VLA models by training-free injection of vision encoder affinity signals into language model layers at inference time. This enhances geometric structure and robot action policies. It shows consistent performance gains across diverse 2D and 3D manipulation ta...

🔹 Publication Date: Published on Jan 22

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2601.16207
• PDF: https://arxiv.org/pdf/2601.16207
• Github: https://jongwoopark7978.github.io/IVRA

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#Robotics #VisionLanguageModels #SpatialAI #RobotLearning #DeepLearning

✨RoboCurate: Harnessing Diversity with Action-Verified Neural Trajectory for Robot Learning

📝 Summary:
RoboCurate enhances synthetic robot learning data by evaluating action quality through simulator replay consistency. It also augments observation diversity via image editing and video transfer techniques. This leads to substantial improvements in robot task success rates compared to using real da...

🔹 Publication Date: Published on Feb 21

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2602.18742
• PDF: https://arxiv.org/pdf/2602.18742
• Project Page: https://seungkukim.github.io/robocurate/

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#RobotLearning #Robotics #SyntheticData #DataAugmentation #AI

🔥 World Model for Robot Learning: A Comprehensive Survey

💡 The paper provides a comprehensive survey of world models for robot learning, which are predictive representations of environmental dynamics that support policy learning, planning, and simulation. The authors note that the literature on world models is fragmented across different architectures, functional roles, and application domains, making it difficult to understand the current state of the field. To address this gap, the authors present a systematic review of world models from a robot learning perspective, examining how they are coupled with robot policies, used as learned simulators for reinforcement learning and evaluation, and have progressed in terms of robotic video world models. The survey covers the progression of world models from imagination-based generation to controllable, structured, and foundation-scale formulations, and connects these ideas to navigation and autonomous driving. The authors also summarize representative datasets, benchmarks, and evaluation protocols, and highlight major challenges and future directions for predictive modeling in embodied agents. The paper aims to clarify key paradigms and applications of world models, and to facilitate continued access to newly emerging works, benchmarks, and resources, the authors will maintain and regularly update a GitHub repository accompanying the survey. Overall, the paper provides a thorough overview of the rapidly growing literature on world models for robot learning, and identifies key areas for future research and development.

📅 Published on Apr 30

🔗 Links:
• arXiv: https://arxiv.org/abs/2605.00080
• PDF: https://arxiv.org/pdf/2605.00080
• Project Page: https://ntumars.github.io/wm-robot-survey/
• GitHub: https://github.com/NTUMARS/Awesome-World-Model-for-Robotics-Policy ⭐ 317

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RobotLearning #WorldModels #PredictiveRepresentations #ReinforcementLearning #RobotPolicies

🔥 Kairos: A Native World Model Stack for Physical AI

💡 The paper introduces Kairos, a native world model framework designed to support physical AI applications. The problem addressed is that current world models are limited in their ability to learn from diverse experiences, maintain persistent states over time, and deploy efficiently in real-world scenarios. To address this, Kairos pioneers a native pre-training paradigm that learns from open-world videos, human behavioral data, and robot interactions, organized into a progressive developmental pathway.

The method involves a native unified architecture equipped with hybrid linear temporal attention, which captures local dynamics, mid-range dependencies, and maintains persistent global memory. This architecture is designed to limit error accumulation and guarantee state propagation across extended horizons. Additionally, Kairos incorporates a deployment-aware system co-design to support low-latency rollout generation on various hardware platforms.

The results show that Kairos achieves top-level performance on embodied world-model, long-horizon, and action-policy benchmarks, while offering a strong efficiency-capability trade-off. The experiments demonstrate that Kairos can learn from diverse experiences, maintain persistent states, and deploy efficiently in real-world scenarios. Overall, the paper positions Kairos as a cohesive operational foundation for future self-evolving physical intelligence, providing a native world model stack that can support a wide range of physical AI applications.

📅 Published on Jun 16

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2606.16533
• PDF: https://arxiv.org/pdf/2606.16533

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#PhysicalAI #WorldModeling #NativePreTraining #RobotLearning #TemporalAttention

🔥 Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models

💡 The paper presents Qwen-RobotManip, a generalizable Vision-Language-Action foundation model for robotic manipulation that achieves strong generalization through unified alignment across representation, motion, and behavior dimensions. The problem addressed is that robotic manipulation data is heterogeneous, expensive to collect, and narrow in diversity, making it challenging to achieve alignment and scale in training. The authors propose a unified alignment framework that enables large-scale multi-source training, allowing the model to absorb manipulation data at a scale that prior training regimes could not sustain.

The method involves a human-to-robot synthesis pipeline that converts egocentric hand demonstrations into robot trajectories across 15 platforms, and a rigorous curation pipeline that harmonizes heterogeneous datasets. The model is trained on a large pretraining corpus of approximately 38,100 hours, constructed using only open-source datasets and human videos without proprietary data collection.

The results show that Qwen-RobotManip exhibits emergent generalization capabilities, including zero-shot instruction following, robustness to perturbations, reactive error recovery, and cross-embodiment transfer. The model substantially outperforms prior state-of-the-art models, including π0.5, across all out-of-distribution settings, and ranks 1st in RoboChallenge with a 20% relative improvement. The model is also validated on real-robot platforms, including AgileX ALOHA, Franka, UR, and ARX. The paper concludes that Qwen-RobotManip achieves genuine generalization in robotic manipulation, demonstrating the effectiveness of the unified alignment framework and large-scale training approach.

📅 Published on Jun 17

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2606.17846
• PDF: https://arxiv.org/pdf/2606.17846
• Project Page: https://qwen.ai/blog?id=qwen-robotmanip

📊 Datasets citing this paper:
• https://huggingface.co/datasets/cy0307/awesome-egocentric-atlas

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RobotLearning #FoundationModels #RoboticManipulation #VisionLanguageAction #MultiSourceTraining

🔥 GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluation

💡 The paper addresses the challenge of evaluating robotic policies, which is a critical bottleneck in the development of embodied robot foundation models. Unlike large language models, robotic policies require real-world rollouts that are slow and costly, limited by hardware and human supervision. To overcome this, the authors propose the use of world models as surrogate policy evaluators. However, the key properties that make a world model reliable for policy assessment are not well understood.

To study this, the authors introduce WMBench, a benchmark constructed from real-robot teleoperation data and matched policy rollouts covering diverse manipulation tasks. They use WMBench to analyze seven video world models, four action representation schemes, and over 324,000 simulated policy rollouts paired with real robot executions. The analysis is further enriched with large-scale community submissions, curated synthetic trajectories, and a large dataset of training videos.

The experiments reveal three core insights: first, evaluator quality is dominated by long-horizon, action-faithful rollout consistency rather than short-term visual realism; second, pretraining gains come not only from data scale but also from balancing general world knowledge with robot-specific controllability; and third, architectural choices such as action encoding, memory design, and evaluator-focused post-training strongly determine alignment with real-world robot behavior.

Based on these results, the authors derive a practical design roadmap and realize it in GigaWorld-1, a world model specially optimized for policy evaluation. The authors fully release their code, models, datasets, and toolkits to advance scalable evaluation research for embodied foundation models. The contributions of the paper include a systematic study of world models for robotic policy evaluation, the introduction of WMBench as a benchmark, and the development of GigaWorld-1 as a reliable world model for policy assessment. Overall, the paper provides a comprehensive framework for evaluating robotic policies and advancing the development of embodied robot foundation models.

📅 Published on Jul 2

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.02642
• PDF: https://arxiv.org/pdf/2607.02642
• Project Page: https://open-gigaai.github.io/giga-world-1/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RobotPolicyEvaluation #WorldModelsForRobots #EmbodiedAI #RobotLearning #SurrogateModeling

🔥 From Foundation to Application: Improving VLA Models in Practice

💡 The paper presents LingBot-VLA 2.0, an improved version of the VLA foundation model, which aims to bridge the gap between laboratory conditions and real-world applications. The main problem addressed is the disparity between the two environments, which hinders the practical implementation of VLA models. To solve this, the authors propose three main improvements.

First, they enhance generalization across tasks and embodiments by expanding the data preprocessing pipeline and training the model on a large dataset of around 60,000 hours of data, including 50,000 hours of robot trajectories from 20 robot configurations and 10,000 hours of human videos.

Second, they extend the action space to include whole-body degrees of freedom, allowing the robots to perform more complex tasks. This is achieved by accommodating degrees of freedom for the heads, waists, mobile bases, and dexterous hands, in addition to dual-arm hardware platforms.

Third, they incorporate predictive dynamics modeling for improved temporal reasoning. This is done by formulating future prediction as a proxy task, using a video representation model for semantic priors and a depth estimation model for geometric cues.

The results show that these modifications have a beneficial impact, as evaluated on the GM-100 benchmark in a generalist setting. Additionally, the expanded pretraining data enables LingBot-VLA 2.0 to demonstrate strong cross-embodiment long-horizon mobile manipulation capability across two robotic platforms. Overall, the paper presents significant improvements to the VLA foundation model, making it more suitable for real-world applications.

📅 Published on Jul 7

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.06403
• PDF: https://arxiv.org/pdf/2607.06403
• Project Page: https://technology.robbyant.com/lingbot-vla-v2

📊 Datasets citing this paper:
• https://huggingface.co/datasets/cy0307/awesome-egocentric-atlas

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#VisualLearningAgents #FoundationModels #RobotLearning #EmbodiedAI #VLAmodels

🔥 Data Pyramid for Embodied Manipulation

💡 The paper proposes a data pyramid framework for embodied manipulation, which organizes data sources into five complementary categories: real-robot data, UMl-style data, egocentric and exocentric data, simulation data, and general vision-language data. The framework is designed to address the challenges of embodied agents, which require data that couples observations with physical states and actions. The authors analyze recent embodied foundation models through the lens of their data recipes, examining how different sources are selected, aligned, and mixed during training. They relate data composition to capabilities in perception, reasoning, planning, action generation, and world prediction. The paper also discusses six open challenges, including building large-scale tactile datasets, collecting failure and recovery data, developing scalable data-collection pipelines, aligning actions across embodiments, leveraging egocentric data for dexterous manipulation, and designing principled data recipes for robot learning. The proposed data pyramid framework provides a foundation for the design of next-generation embodied systems, which can learn to perceive, reason, and act in complex environments. The authors hope that this work will pave the way for the development of more advanced embodied agents that can learn from diverse data sources and improve their performance in various tasks.

📅 Published on Jul 27

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.24744
• PDF: https://arxiv.org/pdf/2607.24744
• Project Page: https://jasper-aaa.github.io/embodied-data-pyramid/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#EmbodiedManipulation #RobotLearning #MultimodalData #EmbodiedAI #FoundationModels