AI & ML Papers
Photo
π₯ Terrain Diffusion: A Diffusion-Based Successor to Perlin Noise in Infinite, Real-Time Terrain Generation
π Published on Dec 9, 2025
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2512.08309
β’ PDF: https://arxiv.org/pdf/2512.08309
β’ Project Page: https://xandergos.github.io/terrain-diffusion/
π€ Models citing this paper:
β’ https://huggingface.co/xandergos/terrain-diffusion-30m
β’ https://huggingface.co/xandergos/terrain-diffusion-90m
β’ https://huggingface.co/xandergos/TerrainDiffusion-Consistency-Base-192x3
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#ProceduralTerrainGeneration #InfiniteWorlds #DiffusionModels #RealTimeTerrainSynthesis #PerlinNoiseAlternatives
π‘ The paper introduces Terrain Diffusion, a new method for generating realistic and infinite procedural worlds in real-time. The current method, Perlin noise, is fast and infinite but lacks realism and large-scale coherence. Terrain Diffusion uses diffusion models and a novel algorithm called InfiniteDiffusion to address these limitations. The InfiniteDiffusion algorithm enables seamless and real-time synthesis of boundless landscapes by coupling planetary context with local detail through a hierarchical stack of diffusion models. The method also uses a compact Laplacian encoding to stabilize outputs across large dynamic ranges and an open-source infinite-tensor framework to support constant-memory manipulation of unbounded tensors. Additionally, few-step consistency distillation enables efficient generation. The results show that Terrain Diffusion can synthesize entire planets coherently, controllably, and without limits, making it a practical foundation for procedural world generation. The method provides constant-time random access, seamless infinite extent, and seed-consistency, making it a suitable successor to Perlin noise. Overall, the paper presents a significant contribution to the field of procedural world generation, enabling the creation of realistic and infinite worlds in real-time.
π Published on Dec 9, 2025
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2512.08309
β’ PDF: https://arxiv.org/pdf/2512.08309
β’ Project Page: https://xandergos.github.io/terrain-diffusion/
π€ Models citing this paper:
β’ https://huggingface.co/xandergos/terrain-diffusion-30m
β’ https://huggingface.co/xandergos/terrain-diffusion-90m
β’ https://huggingface.co/xandergos/TerrainDiffusion-Consistency-Base-192x3
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#ProceduralTerrainGeneration #InfiniteWorlds #DiffusionModels #RealTimeTerrainSynthesis #PerlinNoiseAlternatives
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.
β€1
π₯ Hallucination in World Models is Predictable and Preventable
π Published on Jun 25
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2606.27326
β’ PDF: https://arxiv.org/pdf/2606.27326
β’ Project Page: https://www.nicklashansen.com/mmbench2
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#HallucinationInAI #WorldModelingTechniques #PredictiveModelingForRobotics #DataCentricSignalProcessing #VisualWorldModeling
π‘ The paper addresses the issue of hallucination in world models, which occurs when the model generates unrealistic futures despite appearing visually fluent. The authors hypothesize that hallucination happens in low-data regions of the state-action space and can be detected and mitigated using data-centric signals and coverage-aware sampling techniques.
To test this hypothesis, the authors created a large dataset called MMBench2, consisting of 427 hours of data and 210 tasks for visual world modeling, with ground-truth actions and rewards. They trained a 350M-parameter world model on this dataset and identified three distinct modes of hallucination: perceptual, action-marginalized, and scene-diverging.
The authors developed three signals that can accurately predict where the model will fail and used these signals to develop a coverage-aware sampling technique to close coverage gaps during training. They also used the hallucination predictors as curiosity rewards for targeted data collection to adapt the pretrained world model to new environments with as few as 50 real environment trajectories.
The results show that hallucination in world models is indeed a data coverage issue and that the same signals used to detect it can also be used for mitigation. The authors provide a data-efficient finetuning recipe that can adapt the pretrained world model to entirely unseen environments, demonstrating the effectiveness of their approach. Overall, the paper contributes to a better understanding of hallucination in world models and provides a practical solution to prevent and mitigate it.
π Published on Jun 25
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2606.27326
β’ PDF: https://arxiv.org/pdf/2606.27326
β’ Project Page: https://www.nicklashansen.com/mmbench2
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#HallucinationInAI #WorldModelingTechniques #PredictiveModelingForRobotics #DataCentricSignalProcessing #VisualWorldModeling
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.
AI & ML Papers
Photo
π₯ Geometric Context Transformer for Streaming 3D Reconstruction
π Published on Apr 15
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2604.14141
β’ PDF: https://arxiv.org/pdf/2604.14141
β’ Project Page: https://technology.robbyant.com/lingbot-map
π€ Models citing this paper:
β’ https://huggingface.co/robbyant/lingbot-map
β’ https://huggingface.co/agramoi/lingbot-map
β’ https://huggingface.co/maujim/lingbot-map-long-only
π Spaces citing this paper:
β’ https://huggingface.co/spaces/limonsyrah/lingbot-3d
β’ https://huggingface.co/spaces/mohan007/lingbot-3d
β’ https://huggingface.co/spaces/Fifthoply/lingbot-3d-ZERO
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#GeometricDeepLearning #3DReconstructionAlgorithms #StreamingComputerVision #TransformerArchitectures #PointCloudProcessing
π‘ The paper presents a new approach to streaming 3D reconstruction, which involves recovering 3D information such as camera poses and point clouds from a video stream. This task requires geometric accuracy, temporal consistency, and computational efficiency. To address this problem, the authors introduce LingBot-Map, a feed-forward 3D foundation model that uses a geometric context transformer architecture. The key component of this architecture is a specialized attention mechanism that integrates three main elements: an anchor context, a pose-reference window, and a trajectory memory. These elements work together to address coordinate grounding, dense geometric cues, and long-range drift correction, allowing the model to maintain a compact streaming state while retaining rich geometric context. The result is a model that can perform stable and efficient inference at around 20 frames per second on high-resolution inputs, even over long sequences exceeding 10,000 frames. The authors evaluate their approach on various benchmarks and demonstrate that it outperforms both existing streaming and iterative optimization-based methods, achieving superior performance in terms of geometric accuracy and temporal consistency. Overall, the paper contributes a novel and effective approach to streaming 3D reconstruction, with potential applications in areas such as robotics, computer vision, and virtual reality.
π Published on Apr 15
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2604.14141
β’ PDF: https://arxiv.org/pdf/2604.14141
β’ Project Page: https://technology.robbyant.com/lingbot-map
π€ Models citing this paper:
β’ https://huggingface.co/robbyant/lingbot-map
β’ https://huggingface.co/agramoi/lingbot-map
β’ https://huggingface.co/maujim/lingbot-map-long-only
π Spaces citing this paper:
β’ https://huggingface.co/spaces/limonsyrah/lingbot-3d
β’ https://huggingface.co/spaces/mohan007/lingbot-3d
β’ https://huggingface.co/spaces/Fifthoply/lingbot-3d-ZERO
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#GeometricDeepLearning #3DReconstructionAlgorithms #StreamingComputerVision #TransformerArchitectures #PointCloudProcessing
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.
AI & ML Papers
Photo
π₯ The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learning
π Published on Nov 30, 2024
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2412.00568
β’ PDF: https://arxiv.org/pdf/2412.00568
π Datasets citing this paper:
β’ https://huggingface.co/datasets/polymathic-ai/acoustic_scattering_inclusions
β’ https://huggingface.co/datasets/polymathic-ai/rayleigh_benard
β’ https://huggingface.co/datasets/polymathic-ai/planetswe
π Spaces citing this paper:
β’ https://huggingface.co/spaces/polymathic-ai/TheWell
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#PhysicsSimulations #MachineLearningModels #PhysicalSystemsSimulation #NumericalSimulations #SpatiotemporalData
π‘ The paper introduces a large scale dataset collection called The Well which provides diverse numerical simulations for machine learning models in physical systems simulation. The problem addressed is that standard datasets in this space often cover small classes of physical behavior making it difficult to evaluate the efficacy of new approaches. To address this gap the authors created The Well which is a collection of datasets containing numerical simulations of a wide variety of spatiotemporal physical systems. The dataset draws from domain experts and numerical software developers and provides 15 terabytes of data across 16 datasets covering diverse domains such as biological systems fluid dynamics acoustic scattering and magneto hydrodynamic simulations. The authors also provide a unified PyTorch interface for training and evaluating models to facilitate usage of The Well. The dataset and code are available for use and the authors demonstrate the function of the library by introducing example baselines that highlight the new challenges posed by the complex dynamics of The Well. The main contribution of the paper is the creation of a large scale diverse dataset that can be used to benchmark machine learning models in physical systems simulation and provide a more comprehensive evaluation of their efficacy.
π Published on Nov 30, 2024
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2412.00568
β’ PDF: https://arxiv.org/pdf/2412.00568
π Datasets citing this paper:
β’ https://huggingface.co/datasets/polymathic-ai/acoustic_scattering_inclusions
β’ https://huggingface.co/datasets/polymathic-ai/rayleigh_benard
β’ https://huggingface.co/datasets/polymathic-ai/planetswe
π Spaces citing this paper:
β’ https://huggingface.co/spaces/polymathic-ai/TheWell
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#PhysicsSimulations #MachineLearningModels #PhysicalSystemsSimulation #NumericalSimulations #SpatiotemporalData
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.
β€1
AI & ML Papers
Photo
π₯ olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models
π Published on Feb 25, 2025
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2502.18443
β’ PDF: https://arxiv.org/pdf/2502.18443
β’ Project Page: https://olmocr.allenai.org/
π Datasets citing this paper:
β’ https://huggingface.co/datasets/allenai/olmOCR-bench
β’ https://huggingface.co/datasets/shhdwi/olmocr-pre-rendered
β’ https://huggingface.co/datasets/Voxel51/olmOCR_bench
π Spaces citing this paper:
β’ https://huggingface.co/spaces/davanstrien/benchmark-race
β’ https://huggingface.co/spaces/OpenEvals/every-leaderboards
β’ https://huggingface.co/spaces/OpenEvals/leaderboard-watcher
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#VisionLanguageModels #PDFTextExtraction #DocumentLayoutAnalysis #OCRTechniques #NaturalLanguageProcessing
π‘ The paper presents olmOCR, an open source toolkit that uses a fine tuned vision language model to extract clean text from PDF documents while preserving their structure. The problem addressed is that PDFs come in diverse formats and visual layouts, making it challenging to extract and represent their content for language model use. The method involves using a 7 billion parameter vision language model trained on a sample of 260,000 pages from over 100,000 crawled PDFs with diverse properties. The model is fine tuned to process PDFs into clean linearized plain text in natural reading order, preserving structured content such as sections, tables, lists, and equations. The results show that olmOCR is optimized for large scale batch processing, able to scale flexibly to different hardware setups, and can convert a million PDF pages for a relatively low cost of 190 USD. The toolkit is released as open source, including the vision language model weights, data, training code, and inference code, making it accessible for use in training language models with the trillions of tokens available in PDF documents. Overall, the paper contributes a scalable and cost effective solution for unlocking the content of PDF documents, which can be used to train high quality language models.
π Published on Feb 25, 2025
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2502.18443
β’ PDF: https://arxiv.org/pdf/2502.18443
β’ Project Page: https://olmocr.allenai.org/
π Datasets citing this paper:
β’ https://huggingface.co/datasets/allenai/olmOCR-bench
β’ https://huggingface.co/datasets/shhdwi/olmocr-pre-rendered
β’ https://huggingface.co/datasets/Voxel51/olmOCR_bench
π Spaces citing this paper:
β’ https://huggingface.co/spaces/davanstrien/benchmark-race
β’ https://huggingface.co/spaces/OpenEvals/every-leaderboards
β’ https://huggingface.co/spaces/OpenEvals/leaderboard-watcher
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#VisionLanguageModels #PDFTextExtraction #DocumentLayoutAnalysis #OCRTechniques #NaturalLanguageProcessing
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.
β€3
π οΈ Build Faster, Spend Less. Your All-in-One API Proxy Endpoint.
www.afford-ai.cn is designed for developers who need scale without the crazy costs.
πΉ 1:2 Value Ratio: Stretch your budget further. For every $1 you fund, we credit your account with $2 in tokens.
πΉ Benchmark Crushers: Direct, high-speed access to the models taking the dev world by stormβDeepSeek-V3/R1 and Qwen. Perfect for complex coding, reasoning, and automation tasks.
πΉ Seamless Integration: Standard OpenAI API format. No new SDKs to learn.
Secure your endpoint, manage your token distribution, and cut your AI costs in half.π
π www.afford-ai.cn
www.afford-ai.cn is designed for developers who need scale without the crazy costs.
Secure your endpoint, manage your token distribution, and cut your AI costs in half.
Please open Telegram to view this post
VIEW IN TELEGRAM
β€3
AI & ML Papers
Photo
π₯ Training Video Foundation Models with NVIDIA NeMo
π Published on Mar 17, 2025
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2503.12964
β’ PDF: https://arxiv.org/pdf/2503.12964
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#VideoFoundationModels #NVIDIANeMo #VideoDatasetCuration #MultimodalLearning #VideoDiffusionModels
π‘ The paper addresses the challenges of training large scale high quality video foundation models that can generate high quality videos. Video foundation models have been used to simulate the real world and develop creative visual experiences but training them is difficult due to the complexity and size of video datasets. To overcome this the authors present a scalable open source pipeline using NVIDIA NeMo for training and inference of video foundation models. The pipeline provides accelerated video dataset curation multimodal data loading and parallelized video diffusion model training and inference. The authors also provide a comprehensive performance analysis highlighting best practices for efficient video foundation model training and inference. The pipeline is designed to address the challenges of training large scale video foundation models and provides a scalable and efficient solution for generating high quality videos. The results of the paper demonstrate the effectiveness of the pipeline in training video foundation models and provide insights into the best practices for efficient training and inference. Overall the paper contributes to the development of video foundation models by providing a scalable and efficient pipeline for training and inference.
π Published on Mar 17, 2025
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2503.12964
β’ PDF: https://arxiv.org/pdf/2503.12964
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#VideoFoundationModels #NVIDIANeMo #VideoDatasetCuration #MultimodalLearning #VideoDiffusionModels
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.
β€1
π₯ #Cisco Certification Journey Starts Here!
Want to become a certified Network Engineer and boost your IT career in 2026? π
Whether you're preparing for #CCNA #CCNP or even #CCIE, this is your chance to get premium Cisco learning resources & insider study support!
π₯ What Youβll Get:
π Cisco Training Roadmaps
π Networking Lab Guides
π Command Cheat Sheets
π Cisco Official eBooks
π Real Practice Questions
π Exam Preparation Tips
π FREE Starter Resources Available:
πβ CCNA Beginner Notes:https://reurl.cc/j6bqey
πβ CCNP Study Checklist:https://reurl.cc/npWnbn
π© To receive all FREE Cisco materials directly in your inbox:
wa.link/8i0msc
π Connect us and Leave your email to get instant access!
π‘ Bonus for subscribers:
https://chat.whatsapp.com/FLth69u2WswIlZ6bta2SJf
β Exclusive study group invitations
β Latest Cisco exam changes
β Fast-track learning strategies
β Priority access to upcoming training sessions
β‘ Thousands of IT learners are already preparing smarter.
Donβt miss your chance to level up your networking career in 2026! π
Want to become a certified Network Engineer and boost your IT career in 2026? π
Whether you're preparing for #CCNA #CCNP or even #CCIE, this is your chance to get premium Cisco learning resources & insider study support!
π₯ What Youβll Get:
π Cisco Training Roadmaps
π Networking Lab Guides
π Command Cheat Sheets
π Cisco Official eBooks
π Real Practice Questions
π Exam Preparation Tips
π FREE Starter Resources Available:
πβ CCNA Beginner Notes:https://reurl.cc/j6bqey
πβ CCNP Study Checklist:https://reurl.cc/npWnbn
π© To receive all FREE Cisco materials directly in your inbox:
wa.link/8i0msc
π Connect us and Leave your email to get instant access!
π‘ Bonus for subscribers:
https://chat.whatsapp.com/FLth69u2WswIlZ6bta2SJf
β Exclusive study group invitations
β Latest Cisco exam changes
β Fast-track learning strategies
β Priority access to upcoming training sessions
β‘ Thousands of IT learners are already preparing smarter.
Donβt miss your chance to level up your networking career in 2026! π
reurl.cc
Cisco CCNA Course-SPOTOLearning.com
SPOTO offers the latest CCNA Training courses to get your Cisco certifications & more. Get Started Now!
β€1
AI & ML Papers
Photo
π₯ Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent
π Published on Jun 29
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2606.30616
β’ PDF: https://arxiv.org/pdf/2606.30616
β’ Project Page: https://internscience.github.io/Agents-A1/
π€ Models citing this paper:
β’ https://huggingface.co/InternScience/Agents-A1
β’ https://huggingface.co/InternScience/Agents-A1-FP8-dynamic
β’ https://huggingface.co/Abiray/Agents-A1-Q4_K_M-GGUF
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#MixtureOfExperts #AgenticModels #LongHorizonTasks #LargeLanguageModels #ParameterEfficientTraining
π‘ The paper introduces Agents-A1, a 35 billion parameter Mixture-of-Experts Agentic Model that achieves performance comparable to trillion-parameter models by scaling the agent horizon instead of the parameters. The problem addressed is how to improve the performance of large language models on long-horizon tasks without increasing the number of parameters. The method used is a three-stage training approach, which includes supervised fine-tuning, domain-level teacher models, and multi-teacher distillation. The model is trained on a long-horizon knowledge-action infrastructure that connects external knowledge, actions, observations, and verifier outcomes, producing agentic trajectories with an average length of 45,000 tokens. The results show that Agents-A1 achieves strong and broad performance on long-horizon agent benchmarks, outperforming or matching the results of 1 trillion parameter models on several tasks, including SEAL-0, IFBench, HiPhO, FrontierScience-Olympiad, and MolBench-Bind. The paper provides a practical path for scaling the horizon using a smaller model that can reach or match the performance of larger models on long-horizon tasks.
π Published on Jun 29
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2606.30616
β’ PDF: https://arxiv.org/pdf/2606.30616
β’ Project Page: https://internscience.github.io/Agents-A1/
π€ Models citing this paper:
β’ https://huggingface.co/InternScience/Agents-A1
β’ https://huggingface.co/InternScience/Agents-A1-FP8-dynamic
β’ https://huggingface.co/Abiray/Agents-A1-Q4_K_M-GGUF
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#MixtureOfExperts #AgenticModels #LongHorizonTasks #LargeLanguageModels #ParameterEfficientTraining
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.
π₯ LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing
π Published on Jun 25
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2606.26740
β’ PDF: https://arxiv.org/pdf/2606.26740
β’ Project Page: https://arxiv.org/abs/2606.26740
π Spaces citing this paper:
β’ https://huggingface.co/spaces/multimodalart/LiveEdit
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#VideoEditingTechniques #RealTimeStreaming #DiffusionBasedEditing #StreamingVideoGeneration #LowLatencyEditing
π‘ The paper introduces a novel streaming video editing framework called LiveEdit that enables real-time editing of videos with stable backgrounds and non-edited regions over time. The main challenge in streaming video editing is maintaining stable backgrounds and non-edited regions while achieving low latency for real-time interactive scenarios. Existing streaming video generation methods are not suitable for editing due to the strict preservation requirement and region-specific control.
To address this issue, the authors propose a three-stage distillation pipeline that transfers editing capability from a powerful bidirectional foundation model to an efficient unidirectional streaming editor. This pipeline enables stable long-horizon edits without sacrificing visual fidelity. Additionally, the authors introduce an AR-oriented mask cache that reuses region-related computation across frames, reducing redundant processing and accelerating inference.
The results show that the proposed method achieves state-of-the-art visual quality among streaming baselines and drastically boosts inference speed to 12.66 frames per second. This makes it suitable for interactive and augmented reality applications. The authors also establish a dedicated benchmark for streaming video editing to evaluate their method. Overall, the paper presents a significant contribution to the field of streaming video editing by providing a real-time and stable editing framework.
π Published on Jun 25
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2606.26740
β’ PDF: https://arxiv.org/pdf/2606.26740
β’ Project Page: https://arxiv.org/abs/2606.26740
π Spaces citing this paper:
β’ https://huggingface.co/spaces/multimodalart/LiveEdit
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#VideoEditingTechniques #RealTimeStreaming #DiffusionBasedEditing #StreamingVideoGeneration #LowLatencyEditing
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.
AI & ML Papers
Photo
π₯ Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models
π Published on Jun 17
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2606.17846
β’ PDF: https://arxiv.org/pdf/2606.17846
β’ Project Page: https://qwen.ai/blog?id=qwen-robotmanip
π Datasets citing this paper:
β’ https://huggingface.co/datasets/cy0307/awesome-egocentric-atlas
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#RobotLearning #FoundationModels #RoboticManipulation #VisionLanguageAction #MultiSourceTraining
π‘ The paper presents Qwen-RobotManip, a generalizable Vision-Language-Action foundation model for robotic manipulation that achieves strong generalization through unified alignment across representation, motion, and behavior dimensions. The problem addressed is that robotic manipulation data is heterogeneous, expensive to collect, and narrow in diversity, making it challenging to achieve alignment and scale in training. The authors propose a unified alignment framework that enables large-scale multi-source training, allowing the model to absorb manipulation data at a scale that prior training regimes could not sustain.
The method involves a human-to-robot synthesis pipeline that converts egocentric hand demonstrations into robot trajectories across 15 platforms, and a rigorous curation pipeline that harmonizes heterogeneous datasets. The model is trained on a large pretraining corpus of approximately 38,100 hours, constructed using only open-source datasets and human videos without proprietary data collection.
The results show that Qwen-RobotManip exhibits emergent generalization capabilities, including zero-shot instruction following, robustness to perturbations, reactive error recovery, and cross-embodiment transfer. The model substantially outperforms prior state-of-the-art models, including Ο0.5, across all out-of-distribution settings, and ranks 1st in RoboChallenge with a 20% relative improvement. The model is also validated on real-robot platforms, including AgileX ALOHA, Franka, UR, and ARX. The paper concludes that Qwen-RobotManip achieves genuine generalization in robotic manipulation, demonstrating the effectiveness of the unified alignment framework and large-scale training approach.
π Published on Jun 17
π Links:
β’ GitHub: https://github.com/huggingface
β’ arXiv: https://arxiv.org/abs/2606.17846
β’ PDF: https://arxiv.org/pdf/2606.17846
β’ Project Page: https://qwen.ai/blog?id=qwen-robotmanip
π Datasets citing this paper:
β’ https://huggingface.co/datasets/cy0307/awesome-egocentric-atlas
ββββββββββββββββββββββββ
π’ By: https://xn--r1a.website/PaperNexus
#RobotLearning #FoundationModels #RoboticManipulation #VisionLanguageAction #MultiSourceTraining
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.