✨EmbodMocap: In-the-Wild 4D Human-Scene Reconstruction for Embodied Agents

📝 Summary:
EmbodMocap is a dual-iPhone system for in-the-wild 4D human-scene reconstruction. It unifies human and scene data in a metric world frame, improving accuracy. This supports embodied AI tasks like animation and robot control.

🔹 Publication Date: Published on Feb 26

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2602.23205
• PDF: https://arxiv.org/pdf/2602.23205
• Project Page: https://wenjiawang0312.github.io/projects/embodmocap/
• Github: https://github.com/WenjiaWang0312/EmbodMocap

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#EmbodiedAI #4DReconstruction #ComputerVision #Robotics #Animation

✨HomeSafe-Bench: Evaluating Vision-Language Models on Unsafe Action Detection for Embodied Agents in Household Scenarios

📝 Summary:
HomeSafe-Bench presents a benchmark for vision-language models to detect unsafe actions by embodied agents in household settings. It also introduces HD-Guard, a hierarchical dual-brain architecture balancing real-time safety monitoring with detection accuracy.

🔹 Publication Date: Published on Mar 12

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.11975
• PDF: https://arxiv.org/pdf/2603.11975
• Project Page: https://pujiayue.github.io/homesafe-bench.github.io/
• Github: https://github.com/pujiayue/HomeSafe-Bench

✨ Spaces citing this paper:
• https://huggingface.co/spaces/pujiayue/HomeSafe-Bench-Leaderboard

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#VisionLanguageModels #EmbodiedAI #AISafety #Robotics #Benchmark

✨Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation

📝 Summary:
Kinema4D is a 4D generative robotic simulator for precise robot-world interactions. It combines kinematic robot control with spatiotemporal environmental reaction synthesis. This enables physically plausible, embodiment-agnostic simulations with zero-shot transfer capability.

🔹 Publication Date: Published on Mar 17

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.16669
• PDF: https://arxiv.org/pdf/2603.16669
• Project Page: https://mutianxu.github.io/Kinema4D-project-page/
• Github: https://github.com/mutianxu/Kinema4D

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#Robotics #Simulation #GenerativeAI #Kinematics #EmbodiedAI

✨RoboAlign: Learning Test-Time Reasoning for Language-Action Alignment in Vision-Language-Action Models

📝 Summary:
RoboAlign is a training framework that improves embodied reasoning in vision-language-action models. It combines zero-shot natural language reasoning with reinforcement learning to boost action accuracy and bridge the language-action gap, yielding significant performance gains.

🔹 Publication Date: Published on Mar 22

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.21341
• PDF: https://arxiv.org/pdf/2603.21341

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#RoboAlign #EmbodiedAI #ReinforcementLearning #VLA #AIResearch

✨StreamingClaw Technical Report

📝 Summary:
StreamingClaw is a unified framework for real-time streaming video understanding and embodied intelligence. It integrates real-time reasoning, multimodal long-term memory, and proactive interaction, enabling direct control of the physical world.

🔹 Publication Date: Published on Mar 23

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.22120
• PDF: https://arxiv.org/pdf/2603.22120

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#EmbodiedAI #VideoUnderstanding #RealTimeAI #Robotics #MultimodalAI

✨3D-VCD: Hallucination Mitigation in 3D-LLM Embodied Agents through Visual Contrastive Decoding

📝 Summary:
3D-VCD is a new inference-time framework that reduces hallucinations in 3D embodied agents. It constructs distorted 3D scene graphs and contrasts predictions to suppress ungrounded tokens. This improves reasoning on 3D benchmarks without retraining.

🔹 Publication Date: Published on Apr 9

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.08645
• PDF: https://arxiv.org/pdf/2604.08645
• Project Page: https://plan-lab.github.io/projects/3d-vcd

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#3DLLM #EmbodiedAI #HallucinationMitigation #ComputerVision #AIResearch

🔥 MolmoAct2: Action Reasoning Models for Real-world Deployment

💡 The paper presents MolmoAct2, an open action reasoning model for robotics that improves upon previous systems in several ways. Current vision-language-action models aim to provide a single generalist controller for robots, but they have limitations, such as being closed, requiring expensive hardware, or having high latency. MolmoAct2 addresses these issues by introducing several new components, including a specialized vision-language-model backbone called MolmoER, which is trained on a large corpus of data and is designed for spatial and embodied reasoning. The model also includes three new datasets, including the largest open bimanual dataset to date, and an open-weight action tokenizer called OpenFAST. The architecture of the model has been redesigned to include a continuous-action expert and an adaptive-depth reasoning variant called MolmoThink, which reduces latency by only re-predicting depth tokens for scene regions that change between timesteps. The results of the paper show that MolmoAct2 outperforms strong baselines in several simulation and real-world benchmarks, and the model weights, training code, and training data are released for use by others. Overall, MolmoAct2 is a fully open action reasoning model that is designed for practical deployment and advances the state of the art in robotics.

📅 Published on May 4

🔗 Links:
• arXiv: https://arxiv.org/abs/2605.02881
• PDF: https://arxiv.org/pdf/2605.02881
• Project Page: https://allenai.org/blog/molmoact2
• GitHub: https://github.com/allenai/molmoact2 ⭐ 90

🤖 Models citing this paper:
• https://huggingface.co/allenai/MolmoAct2
• https://huggingface.co/allenai/MolmoAct2-SO100_101
• https://huggingface.co/allenai/Molmo2-ER

📊 Datasets citing this paper:
• https://huggingface.co/datasets/allenai/13122025-tool-04
• https://huggingface.co/datasets/allenai/13122025-cut-10
• https://huggingface.co/datasets/allenai/28112025-yam-01

🚀 Spaces citing this paper:
• https://huggingface.co/spaces/allenai/dataset-stats
• https://huggingface.co/spaces/allenai/lerobot-visualizer-v3

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RoboticsActionReasoning #VisionLanguageModels #EmbodiedAI #BimanualRobotics #SpatialReasoning

🔥 PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World

💡 The paper introduces PhysForge, a system for generating interactive 3D assets that combines visual-language modeling with a physics-grounded diffusion model. The problem addressed is the lack of functional properties in existing methods for generating 3D assets, which focus on static geometry and overlook the need for interactive virtual worlds and embodied AI. To solve this, PhysForge uses a two-stage framework, first using a visual-language model to plan a hierarchical physical blueprint that defines material, functional, and kinematic constraints. Then, a physics-grounded diffusion model synthesizes high-fidelity geometry and precise kinematic parameters using a novel injection mechanism called KineVoxel Injection. The system is supported by PhysDB, a large-scale dataset of 150,000 assets with physical annotations. The results show that PhysForge produces functionally plausible and simulation-ready assets, providing a robust data engine for interactive 3D content and embodied agents. Overall, PhysForge contributes a new approach to generating physics-grounded 3D assets that can be used in interactive virtual worlds and embodied AI applications.

📅 Published on May 6

🔗 Links:
• arXiv: https://arxiv.org/abs/2605.05163
• PDF: https://arxiv.org/pdf/2605.05163
• Project Page: https://hku-mmlab.github.io/PhysForge/
• GitHub: https://github.com/HKU-MMLab/PhysForge ⭐ 41

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#PhysicsGroundedModeling #InteractiveVirtualWorlds #3DAssetGeneration #EmbodiedAI #PhysicsBasedRendering

🔥 World Action Models: The Next Frontier in Embodied AI

💡 The paper World Action Models The Next Frontier in Embodied AI presents a comprehensive survey of the emerging field of World Action Models, which aims to unify predictive state modeling with action generation for embodied policy learning. The problem addressed is that current AI models, such as Vision-Language-Action models, learn reactive observation-to-action mappings without explicitly modeling how the physical world evolves under intervention. To address this limitation, the authors introduce the concept of World Action Models, which targets a joint distribution over future states and actions rather than actions alone.

The method involves integrating world models, predictive models of environment dynamics, into the action generation pipeline. The authors formally define World Action Models and disambiguate them from related concepts, and provide a structured taxonomy of existing methods, including Cascaded and Joint World Action Models. They also analyze the data ecosystem fueling World Action Models development, including robot teleoperation, human demonstrations, simulation, and internet-scale egocentric video.

The results of the survey provide a systematic account of the World Action Models landscape, clarifying key architectural paradigms and their trade-offs. The authors identify open challenges and future opportunities for this rapidly evolving field, including the need for unified conceptual frameworks, evaluation protocols, and further research on the integration of world models and action generation. Overall, the paper contributes to the development of a cohesive framework for understanding environment dynamics and action prediction, and provides a foundation for future research in embodied AI.

📅 Published on May 12

🔗 Links:
• arXiv: https://arxiv.org/abs/2605.12090
• PDF: https://arxiv.org/pdf/2605.12090
• Project Page: https://openmoss.github.io/Awesome-WAM/
• GitHub: https://github.com/OpenMOSS/Awesome-WAM ⭐ 135

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#EmbodiedAI #WorldActionModels #PredictiveStateModeling #EmbodiedPolicyLearning #ActionGenerationModels

🔥 PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation

💡 The paper proposes PhysisForcing, a framework for enhancing the physical consistency of embodied video generation models for robotic manipulation. The problem with existing video generation models is that they can produce physically implausible manipulations, such as discontinuous motion trajectories and inconsistent robot-object interactions. This is mainly due to the deformation of moving objects and implausible spatio-temporal correlations among interacting entities, particularly during contact.

To address this issue, PhysisForcing uses a scalable training framework that focuses supervision on physics-informative regions through joint optimization of pixel-level and semantic-level features. The framework consists of two losses: a pixel-level trajectory alignment loss that supervises features using reference point trajectories, and a semantic-level relational alignment loss that aligns features with inter-region relations extracted from a frozen video understanding encoder.

The method is evaluated on several benchmarks, including R-Bench, PAI-Bench, and EZS-Bench, and the results show that PhysisForcing consistently improves embodied video generation over strong baselines. Specifically, it improves the Wan2.2-I2V-A14B and Cosmos3-Nano base models on R-Bench by 22.3% and 9.2%, respectively, with the Cosmos3-Nano variant attaining the best overall score.

Furthermore, the paper demonstrates that PhysisForcing can be used as a world model under the WorldArena action-planner protocol, which raises the closed-loop success rate from 16.0% to 24.0% and further improves downstream policy success. This indicates that physically aligned video models yield stronger representations for robotic manipulation. Overall, the paper contributes a novel framework for enhancing the physical consistency of embodied video generation models, which has the potential to improve the reliability and performance of robotic manipulation systems.

📅 Published on Jun 26

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2606.28128
• PDF: https://arxiv.org/pdf/2606.28128
• Project Page: https://dagroup-pku.github.io/PhysisForcing.github.io/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RoboticsAndComputerVision #PhysicsInformedMachineLearning #RoboticManipulation #EmbodiedAI #ComputerVisionForRobotics

🔥 Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots

💡 The paper introduces Embodied.cpp, a portable C++ runtime that enables efficient deployment of embodied AI models across heterogeneous edge devices. The problem addressed is the fragmentation of embodied AI model deployment, which is currently limited by model-specific Python stacks, backend assumptions, and robot-side glue code. This makes it difficult to deploy these models on various devices, especially on heterogeneous edge devices.

The authors propose Embodied.cpp as a solution, which is based on an architectural analysis of representative vision-language-action and world-action models. The runtime is organized into five layers: input adapters, sequence builders, backbone execution, head plugins, and deployment adapters. This modular design provides multi-rate execution, latency-first fused inference, and extensible operator and I/O support, allowing for deployment across diverse devices, robots, and simulators through a single backend abstraction.

The results show that Embodied.cpp achieves successful closed-loop execution with high task success rates on two vision-language-action models, and reduces block memory usage on a preliminary world-action model benchmark. Specifically, the VLA deployments achieve 100.0% and 91.0% task success rates, while the WAM benchmark reduces block memory from 312.2 MiB to 88.1 MiB. These results demonstrate that Embodied.cpp improves deployment efficiency while preserving high accuracy across diverse embodied model architectures. Overall, the paper contributes a portable and efficient runtime for embodied AI models, enabling their deployment on a wide range of devices and robots.

📅 Published on Jul 2

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.02501
• PDF: https://arxiv.org/pdf/2607.02501

🤖 Models citing this paper:
• https://huggingface.co/SEU-PAISys/Embodied.cpp

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#EmbodiedAI #HeterogeneousRobots #EdgeAI #RoboticsEngineering #AIModelDeployment

🔥 GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluation

💡 The paper addresses the challenge of evaluating robotic policies, which is a critical bottleneck in the development of embodied robot foundation models. Unlike large language models, robotic policies require real-world rollouts that are slow and costly, limited by hardware and human supervision. To overcome this, the authors propose the use of world models as surrogate policy evaluators. However, the key properties that make a world model reliable for policy assessment are not well understood.

To study this, the authors introduce WMBench, a benchmark constructed from real-robot teleoperation data and matched policy rollouts covering diverse manipulation tasks. They use WMBench to analyze seven video world models, four action representation schemes, and over 324,000 simulated policy rollouts paired with real robot executions. The analysis is further enriched with large-scale community submissions, curated synthetic trajectories, and a large dataset of training videos.

The experiments reveal three core insights: first, evaluator quality is dominated by long-horizon, action-faithful rollout consistency rather than short-term visual realism; second, pretraining gains come not only from data scale but also from balancing general world knowledge with robot-specific controllability; and third, architectural choices such as action encoding, memory design, and evaluator-focused post-training strongly determine alignment with real-world robot behavior.

Based on these results, the authors derive a practical design roadmap and realize it in GigaWorld-1, a world model specially optimized for policy evaluation. The authors fully release their code, models, datasets, and toolkits to advance scalable evaluation research for embodied foundation models. The contributions of the paper include a systematic study of world models for robotic policy evaluation, the introduction of WMBench as a benchmark, and the development of GigaWorld-1 as a reliable world model for policy assessment. Overall, the paper provides a comprehensive framework for evaluating robotic policies and advancing the development of embodied robot foundation models.

📅 Published on Jul 2

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.02642
• PDF: https://arxiv.org/pdf/2607.02642
• Project Page: https://open-gigaai.github.io/giga-world-1/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RobotPolicyEvaluation #WorldModelsForRobots #EmbodiedAI #RobotLearning #SurrogateModeling

🔥 From Foundation to Application: Improving VLA Models in Practice

💡 The paper presents LingBot-VLA 2.0, an improved version of the VLA foundation model, which aims to bridge the gap between laboratory conditions and real-world applications. The main problem addressed is the disparity between the two environments, which hinders the practical implementation of VLA models. To solve this, the authors propose three main improvements.

First, they enhance generalization across tasks and embodiments by expanding the data preprocessing pipeline and training the model on a large dataset of around 60,000 hours of data, including 50,000 hours of robot trajectories from 20 robot configurations and 10,000 hours of human videos.

Second, they extend the action space to include whole-body degrees of freedom, allowing the robots to perform more complex tasks. This is achieved by accommodating degrees of freedom for the heads, waists, mobile bases, and dexterous hands, in addition to dual-arm hardware platforms.

Third, they incorporate predictive dynamics modeling for improved temporal reasoning. This is done by formulating future prediction as a proxy task, using a video representation model for semantic priors and a depth estimation model for geometric cues.

The results show that these modifications have a beneficial impact, as evaluated on the GM-100 benchmark in a generalist setting. Additionally, the expanded pretraining data enables LingBot-VLA 2.0 to demonstrate strong cross-embodiment long-horizon mobile manipulation capability across two robotic platforms. Overall, the paper presents significant improvements to the VLA foundation model, making it more suitable for real-world applications.

📅 Published on Jul 7

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.06403
• PDF: https://arxiv.org/pdf/2607.06403
• Project Page: https://technology.robbyant.com/lingbot-vla-v2

📊 Datasets citing this paper:
• https://huggingface.co/datasets/cy0307/awesome-egocentric-atlas

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#VisualLearningAgents #FoundationModels #RobotLearning #EmbodiedAI #VLAmodels

🔥 Data Pyramid for Embodied Manipulation

💡 The paper proposes a data pyramid framework for embodied manipulation, which organizes data sources into five complementary categories: real-robot data, UMl-style data, egocentric and exocentric data, simulation data, and general vision-language data. The framework is designed to address the challenges of embodied agents, which require data that couples observations with physical states and actions. The authors analyze recent embodied foundation models through the lens of their data recipes, examining how different sources are selected, aligned, and mixed during training. They relate data composition to capabilities in perception, reasoning, planning, action generation, and world prediction. The paper also discusses six open challenges, including building large-scale tactile datasets, collecting failure and recovery data, developing scalable data-collection pipelines, aligning actions across embodiments, leveraging egocentric data for dexterous manipulation, and designing principled data recipes for robot learning. The proposed data pyramid framework provides a foundation for the design of next-generation embodied systems, which can learn to perceive, reason, and act in complex environments. The authors hope that this work will pave the way for the development of more advanced embodied agents that can learn from diverse data sources and improve their performance in various tasks.

📅 Published on Jul 27

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.24744
• PDF: https://arxiv.org/pdf/2607.24744
• Project Page: https://jasper-aaa.github.io/embodied-data-pyramid/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#EmbodiedManipulation #RobotLearning #MultimodalData #EmbodiedAI #FoundationModels

🔥 Zetta ζ: An Efficient Closed-Loop Embodied Harness for Self-Evolving Physical Intelligence

💡 The paper addresses the gap between current embodied agents and the need for truly closed‑loop learning during physical robot execution. Existing harnesses for embodied agents are largely open‑loop: they execute a fixed set of skills during a rollout and only reflect on performance after the episode ends. This post‑hoc reflection cannot influence the robot’s actions in real time, yet physical interaction requires decisions that track rapidly changing robot‑environment states at the frequency of each action. The authors argue that large end‑to‑end policy models are too slow to provide the necessary per‑step governance, and that a new approach is needed to evolve corrective behavior while the robot is acting.

Zetta pronounced “Zetta” is introduced as a closed‑loop embodied harness that keeps the base policy frozen but continuously evolves “runtime critics” and recovery skills online. The system operates on three separated time scales: 1 an action‑frequency loop that evaluates each action with a lightweight critic and can intervene immediately, 2 a rollout‑level loop that proposes new critic or recovery code after a full episode, and 3 a validation‑gated loop that tests proposed updates on a held‑out set before committing them to the harness. By generating code‑based critics and recovery modules, Zetta can modify behavior without retraining the underlying policy network. The authors also provide Z‑Infra, an infrastructure that separates the agent’s decision logic from heterogeneous execution resources, allowing the fast critic code to run on low‑latency hardware while the heavy policy runs elsewhere.

In experiments on two challenging robot benchmarks—LIBERO‑Pro and RoboCasa—Zetta achieves state‑of‑the‑art success rates of 90.8 % and 93.6 % respectively, using the same rollout budget as prior methods. The approach yields an 11.1‑times speedup in inference time because the per‑step critic is far cheaper to compute than a full policy forward pass. Success continues to improve as the system accumulates self‑exploration experience, and the learned recovery skills transfer zero‑shot to new tasks. The authors also report clear “Aha moments” where the robot discovers concise recovery strategies that were not present in the original skill set. Overall, the work demonstrates that a closed‑loop harness that self‑evolves code‑based critics and recovery skills can dramatically improve reliability and scalability of embodied physical intelligence.

📅 Published on Aug 17

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2608.16590
• PDF: https://arxiv.org/pdf/2608.16590
• Project Page: https://air-embodied-brain.github.io/zetta/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#ClosedLoopLearning #EmbodiedAI #AdaptiveRobotics #SelfEvolvingIntelligence #RealTimeControl