✨EmbodMocap: In-the-Wild 4D Human-Scene Reconstruction for Embodied Agents

📝 Summary:
EmbodMocap is a dual-iPhone system for in-the-wild 4D human-scene reconstruction. It unifies human and scene data in a metric world frame, improving accuracy. This supports embodied AI tasks like animation and robot control.

🔹 Publication Date: Published on Feb 26

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2602.23205
• PDF: https://arxiv.org/pdf/2602.23205
• Project Page: https://wenjiawang0312.github.io/projects/embodmocap/
• Github: https://github.com/WenjiaWang0312/EmbodMocap

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#EmbodiedAI #4DReconstruction #ComputerVision #Robotics #Animation

✨HomeSafe-Bench: Evaluating Vision-Language Models on Unsafe Action Detection for Embodied Agents in Household Scenarios

📝 Summary:
HomeSafe-Bench presents a benchmark for vision-language models to detect unsafe actions by embodied agents in household settings. It also introduces HD-Guard, a hierarchical dual-brain architecture balancing real-time safety monitoring with detection accuracy.

🔹 Publication Date: Published on Mar 12

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.11975
• PDF: https://arxiv.org/pdf/2603.11975
• Project Page: https://pujiayue.github.io/homesafe-bench.github.io/
• Github: https://github.com/pujiayue/HomeSafe-Bench

✨ Spaces citing this paper:
• https://huggingface.co/spaces/pujiayue/HomeSafe-Bench-Leaderboard

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#VisionLanguageModels #EmbodiedAI #AISafety #Robotics #Benchmark

✨Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation

📝 Summary:
Kinema4D is a 4D generative robotic simulator for precise robot-world interactions. It combines kinematic robot control with spatiotemporal environmental reaction synthesis. This enables physically plausible, embodiment-agnostic simulations with zero-shot transfer capability.

🔹 Publication Date: Published on Mar 17

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.16669
• PDF: https://arxiv.org/pdf/2603.16669
• Project Page: https://mutianxu.github.io/Kinema4D-project-page/
• Github: https://github.com/mutianxu/Kinema4D

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#Robotics #Simulation #GenerativeAI #Kinematics #EmbodiedAI

✨RoboAlign: Learning Test-Time Reasoning for Language-Action Alignment in Vision-Language-Action Models

📝 Summary:
RoboAlign is a training framework that improves embodied reasoning in vision-language-action models. It combines zero-shot natural language reasoning with reinforcement learning to boost action accuracy and bridge the language-action gap, yielding significant performance gains.

🔹 Publication Date: Published on Mar 22

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.21341
• PDF: https://arxiv.org/pdf/2603.21341

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#RoboAlign #EmbodiedAI #ReinforcementLearning #VLA #AIResearch

✨StreamingClaw Technical Report

📝 Summary:
StreamingClaw is a unified framework for real-time streaming video understanding and embodied intelligence. It integrates real-time reasoning, multimodal long-term memory, and proactive interaction, enabling direct control of the physical world.

🔹 Publication Date: Published on Mar 23

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.22120
• PDF: https://arxiv.org/pdf/2603.22120

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#EmbodiedAI #VideoUnderstanding #RealTimeAI #Robotics #MultimodalAI

✨3D-VCD: Hallucination Mitigation in 3D-LLM Embodied Agents through Visual Contrastive Decoding

📝 Summary:
3D-VCD is a new inference-time framework that reduces hallucinations in 3D embodied agents. It constructs distorted 3D scene graphs and contrasts predictions to suppress ungrounded tokens. This improves reasoning on 3D benchmarks without retraining.

🔹 Publication Date: Published on Apr 9

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.08645
• PDF: https://arxiv.org/pdf/2604.08645
• Project Page: https://plan-lab.github.io/projects/3d-vcd

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#3DLLM #EmbodiedAI #HallucinationMitigation #ComputerVision #AIResearch

🔥 MolmoAct2: Action Reasoning Models for Real-world Deployment

💡 The paper presents MolmoAct2, an open action reasoning model for robotics that improves upon previous systems in several ways. Current vision-language-action models aim to provide a single generalist controller for robots, but they have limitations, such as being closed, requiring expensive hardware, or having high latency. MolmoAct2 addresses these issues by introducing several new components, including a specialized vision-language-model backbone called MolmoER, which is trained on a large corpus of data and is designed for spatial and embodied reasoning. The model also includes three new datasets, including the largest open bimanual dataset to date, and an open-weight action tokenizer called OpenFAST. The architecture of the model has been redesigned to include a continuous-action expert and an adaptive-depth reasoning variant called MolmoThink, which reduces latency by only re-predicting depth tokens for scene regions that change between timesteps. The results of the paper show that MolmoAct2 outperforms strong baselines in several simulation and real-world benchmarks, and the model weights, training code, and training data are released for use by others. Overall, MolmoAct2 is a fully open action reasoning model that is designed for practical deployment and advances the state of the art in robotics.

📅 Published on May 4

🔗 Links:
• arXiv: https://arxiv.org/abs/2605.02881
• PDF: https://arxiv.org/pdf/2605.02881
• Project Page: https://allenai.org/blog/molmoact2
• GitHub: https://github.com/allenai/molmoact2 ⭐ 90

🤖 Models citing this paper:
• https://huggingface.co/allenai/MolmoAct2
• https://huggingface.co/allenai/MolmoAct2-SO100_101
• https://huggingface.co/allenai/Molmo2-ER

📊 Datasets citing this paper:
• https://huggingface.co/datasets/allenai/13122025-tool-04
• https://huggingface.co/datasets/allenai/13122025-cut-10
• https://huggingface.co/datasets/allenai/28112025-yam-01

🚀 Spaces citing this paper:
• https://huggingface.co/spaces/allenai/dataset-stats
• https://huggingface.co/spaces/allenai/lerobot-visualizer-v3

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RoboticsActionReasoning #VisionLanguageModels #EmbodiedAI #BimanualRobotics #SpatialReasoning

🔥 PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World

💡 The paper introduces PhysForge, a system for generating interactive 3D assets that combines visual-language modeling with a physics-grounded diffusion model. The problem addressed is the lack of functional properties in existing methods for generating 3D assets, which focus on static geometry and overlook the need for interactive virtual worlds and embodied AI. To solve this, PhysForge uses a two-stage framework, first using a visual-language model to plan a hierarchical physical blueprint that defines material, functional, and kinematic constraints. Then, a physics-grounded diffusion model synthesizes high-fidelity geometry and precise kinematic parameters using a novel injection mechanism called KineVoxel Injection. The system is supported by PhysDB, a large-scale dataset of 150,000 assets with physical annotations. The results show that PhysForge produces functionally plausible and simulation-ready assets, providing a robust data engine for interactive 3D content and embodied agents. Overall, PhysForge contributes a new approach to generating physics-grounded 3D assets that can be used in interactive virtual worlds and embodied AI applications.

📅 Published on May 6

🔗 Links:
• arXiv: https://arxiv.org/abs/2605.05163
• PDF: https://arxiv.org/pdf/2605.05163
• Project Page: https://hku-mmlab.github.io/PhysForge/
• GitHub: https://github.com/HKU-MMLab/PhysForge ⭐ 41

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#PhysicsGroundedModeling #InteractiveVirtualWorlds #3DAssetGeneration #EmbodiedAI #PhysicsBasedRendering

🔥 World Action Models: The Next Frontier in Embodied AI

💡 The paper World Action Models The Next Frontier in Embodied AI presents a comprehensive survey of the emerging field of World Action Models, which aims to unify predictive state modeling with action generation for embodied policy learning. The problem addressed is that current AI models, such as Vision-Language-Action models, learn reactive observation-to-action mappings without explicitly modeling how the physical world evolves under intervention. To address this limitation, the authors introduce the concept of World Action Models, which targets a joint distribution over future states and actions rather than actions alone.

The method involves integrating world models, predictive models of environment dynamics, into the action generation pipeline. The authors formally define World Action Models and disambiguate them from related concepts, and provide a structured taxonomy of existing methods, including Cascaded and Joint World Action Models. They also analyze the data ecosystem fueling World Action Models development, including robot teleoperation, human demonstrations, simulation, and internet-scale egocentric video.

The results of the survey provide a systematic account of the World Action Models landscape, clarifying key architectural paradigms and their trade-offs. The authors identify open challenges and future opportunities for this rapidly evolving field, including the need for unified conceptual frameworks, evaluation protocols, and further research on the integration of world models and action generation. Overall, the paper contributes to the development of a cohesive framework for understanding environment dynamics and action prediction, and provides a foundation for future research in embodied AI.

📅 Published on May 12

🔗 Links:
• arXiv: https://arxiv.org/abs/2605.12090
• PDF: https://arxiv.org/pdf/2605.12090
• Project Page: https://openmoss.github.io/Awesome-WAM/
• GitHub: https://github.com/OpenMOSS/Awesome-WAM ⭐ 135

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#EmbodiedAI #WorldActionModels #PredictiveStateModeling #EmbodiedPolicyLearning #ActionGenerationModels

🔥 PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation

💡 The paper proposes PhysisForcing, a framework for enhancing the physical consistency of embodied video generation models for robotic manipulation. The problem with existing video generation models is that they can produce physically implausible manipulations, such as discontinuous motion trajectories and inconsistent robot-object interactions. This is mainly due to the deformation of moving objects and implausible spatio-temporal correlations among interacting entities, particularly during contact.

To address this issue, PhysisForcing uses a scalable training framework that focuses supervision on physics-informative regions through joint optimization of pixel-level and semantic-level features. The framework consists of two losses: a pixel-level trajectory alignment loss that supervises features using reference point trajectories, and a semantic-level relational alignment loss that aligns features with inter-region relations extracted from a frozen video understanding encoder.

The method is evaluated on several benchmarks, including R-Bench, PAI-Bench, and EZS-Bench, and the results show that PhysisForcing consistently improves embodied video generation over strong baselines. Specifically, it improves the Wan2.2-I2V-A14B and Cosmos3-Nano base models on R-Bench by 22.3% and 9.2%, respectively, with the Cosmos3-Nano variant attaining the best overall score.

Furthermore, the paper demonstrates that PhysisForcing can be used as a world model under the WorldArena action-planner protocol, which raises the closed-loop success rate from 16.0% to 24.0% and further improves downstream policy success. This indicates that physically aligned video models yield stronger representations for robotic manipulation. Overall, the paper contributes a novel framework for enhancing the physical consistency of embodied video generation models, which has the potential to improve the reliability and performance of robotic manipulation systems.

📅 Published on Jun 26

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2606.28128
• PDF: https://arxiv.org/pdf/2606.28128
• Project Page: https://dagroup-pku.github.io/PhysisForcing.github.io/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RoboticsAndComputerVision #PhysicsInformedMachineLearning #RoboticManipulation #EmbodiedAI #ComputerVisionForRobotics