🔥 Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models

💡 The paper presents Qwen-RobotManip, a generalizable Vision-Language-Action foundation model for robotic manipulation that achieves strong generalization through unified alignment across representation, motion, and behavior dimensions. The problem addressed is that robotic manipulation data is heterogeneous, expensive to collect, and narrow in diversity, making it challenging to achieve alignment and scale in training. The authors propose a unified alignment framework that enables large-scale multi-source training, allowing the model to absorb manipulation data at a scale that prior training regimes could not sustain.

The method involves a human-to-robot synthesis pipeline that converts egocentric hand demonstrations into robot trajectories across 15 platforms, and a rigorous curation pipeline that harmonizes heterogeneous datasets. The model is trained on a large pretraining corpus of approximately 38,100 hours, constructed using only open-source datasets and human videos without proprietary data collection.

The results show that Qwen-RobotManip exhibits emergent generalization capabilities, including zero-shot instruction following, robustness to perturbations, reactive error recovery, and cross-embodiment transfer. The model substantially outperforms prior state-of-the-art models, including π0.5, across all out-of-distribution settings, and ranks 1st in RoboChallenge with a 20% relative improvement. The model is also validated on real-robot platforms, including AgileX ALOHA, Franka, UR, and ARX. The paper concludes that Qwen-RobotManip achieves genuine generalization in robotic manipulation, demonstrating the effectiveness of the unified alignment framework and large-scale training approach.

📅 Published on Jun 17

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2606.17846
• PDF: https://arxiv.org/pdf/2606.17846
• Project Page: https://qwen.ai/blog?id=qwen-robotmanip

📊 Datasets citing this paper:
• https://huggingface.co/datasets/cy0307/awesome-egocentric-atlas

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#RobotLearning #FoundationModels #RoboticManipulation #VisionLanguageAction #MultiSourceTraining