🔥 SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Models

💡 The paper introduces SCOPE, a method for simulating cross game operations in playable environments for first person shooter games. The problem addressed is that existing methods for interactive world models in FPS games struggle to handle high frequency overlapping control signals without disrupting unaffected regions. This is because they inject actions globally and are trained on single game titles, which fails under dense FPS inputs.

The proposed method conditions transformer blocks in video diffusion models to separate in scope from out of scope visual effects without requiring segmentation labels. This is achieved by inserting a conditioning module into each transformer block of a pre trained video diffusion model, which reshapes features into per pixel temporal sequences. This allows each position to compute its action response from local visual content, effectively separating in scope effects from out of scope generation.

The authors also introduce CrossFPS, a multi game FPS dataset with frame aligned action telemetry, comprising 69K clips from 7 titles with 10 degree of freedom controller signals. This dataset is curated to remove gameplay bias, allowing the model to learn general visual to action mappings rather than game specific patterns.

The results show that the SCOPE method enables strong action responsiveness, precise scope separation, and effective cross game generalization. The model is able to learn general visual to action mappings, which enables zero shot transfer to unseen scenes. This means that the model can be applied to new games without requiring additional training data, making it a significant contribution to the field of interactive world models for FPS games.

📅 Published on May 22

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.23345
• PDF: https://arxiv.org/pdf/2605.23345
• Project Page: https://z2tong.github.io/SCOPE/

🤖 Models citing this paper:
• https://huggingface.co/zizhaotong/SCOPE

📊 Datasets citing this paper:
• https://huggingface.co/datasets/zizhaotong/CrossFPS-train
• https://huggingface.co/datasets/zizhaotong/CrossFPS-val

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#FirstPersonShooterGames #CrossGameOperations #PlayableEnvironments #VideoDiffusionModels #TransformerBlocks

🔥 More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models

💡 This paper explores the concept of reasoning in Vision Language Models and identifies a dual nature of multimodal reasoning. While reasoning enhances logical inference and improves performance on complex tasks, it can also impair perceptual grounding, leading to recognition failures on basic visual questions. The authors attribute this phenomenon to visual forgetting, where prolonged reasoning causes the model to disregard visual input. To address this issue, the authors propose Vision Anchored Policy Optimization, a method that steers the reasoning process toward visually grounded trajectories. The resulting model, VAPO Thinker 7B, significantly strengthens the model's reliance on visual information and achieves state of the art results on a range of benchmarks. The key contribution of this paper is the identification of the dual nature of multimodal reasoning and the development of a method to balance reasoning and visual grounding, leading to improved performance on visual tasks.

📅 Published on Sep 30, 2025

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2509.25848
• PDF: https://arxiv.org/pdf/2509.25848
• Project Page: https://xytian1008.github.io/VAPO/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#VisionLanguageModels #MultimodalReasoning #VisualForgetting #VisionAnchoredPolicyOptimization #PerceptualGrounding

🔥 TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction

💡 The paper presents TriSplat, a feed-forward 3D reconstruction network that generates simulation-ready meshes from single images. The problem addressed is that existing methods for 3D reconstruction require expensive post-processing steps to extract a usable mesh for simulation or physics reasoning. Most existing methods use Gaussian primitives and do not directly expose surfaces, making it difficult to obtain a simulation-ready mesh.

The method proposed in the paper uses oriented triangle primitives to represent scenes and directly exports simulation-ready mesh scenes from a single forward pass. The network predicts local 3D point maps, triangle attributes, camera poses, and optional intrinsics from input images. The approach constructs geometry normals from the predicted point maps, refines them with an image-conditioned normal head, and converts them into stable local frames for triangle parameterization.

The results show that the proposed representation produces more geometry-faithful reconstructions than Gaussian feed-forward baselines while maintaining competitive novel-view rendering quality. The output of the network can be directly ingested by physics engines, collision detectors, and standard rendering pipelines without any conversion, making it a practical simulation-ready solution for feed-forward 3D scene reconstruction. The experiments were conducted on RealEstate10K and DL3DV datasets and demonstrate the effectiveness of the proposed approach. Overall, the paper contributes a novel method for 3D scene reconstruction that bypasses expensive post-processing steps and directly generates simulation-ready meshes from single images.

📅 Published on May 25

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.26115
• PDF: https://arxiv.org/pdf/2605.26115
• Project Page: https://lhmd.top/trisplat/#interactive

🤖 Models citing this paper:
• https://huggingface.co/lhmd/TriSplat

📊 Datasets citing this paper:
• https://huggingface.co/datasets/lhmd/re10k_torch

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#3DSceneReconstruction #SimulationReadyMeshes #FeedForwardNetworks #TrianglePrimitives #ComputerVision

🔥 WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation

💡 The paper introduces WBench, a comprehensive benchmark for evaluating interactive world models. The problem addressed is that existing benchmarks for interactive world models are limited and do not provide a unified standard for evaluation. To fill this gap, the authors created WBench, which evaluates models across five dimensions: video quality, setting adherence, interaction adherence, consistency, and physics compliance.

The method used to create WBench involves 289 test cases and 1058 interaction turns, covering diverse scenarios and interaction types, including navigation, subject action, event editing, and perspective switching. The benchmark unifies different input interfaces, such as text, 6-DoF pose, and discrete-action control, allowing for the evaluation of models with different native input interfaces. The evaluation uses 22 automatic sub-metrics that combine specialist vision models with large multimodal models, and all metrics are validated against human judgments.

The results show that no single model performs strongly across all dimensions. The authors evaluated 20 state-of-the-art models using WBench and found that each model has characteristic strengths, weaknesses, and open challenges. The paper provides detailed diagnostic insights into the performance of each model, highlighting areas for improvement. The code and data for WBench are made available, allowing other researchers to use the benchmark to evaluate and improve their own interactive world models. Overall, the paper contributes to the development of interactive world models by providing a comprehensive and unified benchmark for evaluation.

📅 Published on May 25

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.25874
• PDF: https://arxiv.org/pdf/2605.25874
• Project Page: https://meituan-longcat.github.io/WBench/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#WorldModelEvaluation #InteractiveVideoBenchmarking #MultiturnDialogueSystems #VideoQualityAssessment #ArtificialIntelligenceForVideoAnalysis

🔥 ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning

💡 The paper introduces ParaVT, a multi-agent reinforcement learning framework for parallel video tool calling, which enables the use of multiple video-processing tools simultaneously. This approach addresses the limitations of existing sequential methods, where a single incorrect tool call can propagate errors and corrupt context. The authors identify a key challenge in applying standard reinforcement learning to ParaVT, known as the Tool Prior Paradox, where pretrained tool priors enable tool exploration but also destabilize the model's structural format and create a shortcut for skipping tools.

To address this issue, the authors propose PARA-GRPO, a modified reinforcement learning algorithm that incorporates two complementary mechanisms: a targeted format reward and a per-prompt frame-budget randomization. The targeted format reward helps to stabilize the model's structural format, while the frame-budget randomization encourages the model to use tools in a way that yields a measurable reward signal.

The authors evaluate ParaVT with PARA-GRPO on six long-video understanding benchmarks and achieve an average improvement of 7.9% over the baseline Qwen3-VL model. Additionally, PARA-GRPO lifts training-time format compliance from 0.13 to 0.64, demonstrating the effectiveness of the proposed approach. The paper's contributions include a new framework for parallel video tool calling, a modified reinforcement learning algorithm, and a set of experimental results that demonstrate the benefits of the proposed approach. Overall, the paper provides a general recipe for agentic reinforcement learning that can be applied to a wide range of applications where tool capabilities are internalized in large multimodal models.

📅 Published on May 19

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.20342
• PDF: https://arxiv.org/pdf/2605.20342
• Project Page: https://evolvinglmms-lab.github.io/ParaVT/

🤖 Models citing this paper:
• https://huggingface.co/ParaVT/ParaVT-8B

📊 Datasets citing this paper:
• https://huggingface.co/datasets/ParaVT/ParaVT-Source
• https://huggingface.co/datasets/ParaVT/ParaVT-Parquet

🚀 Spaces citing this paper:
• https://huggingface.co/spaces/ParaVT/ParaVT

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#AgenticVideoReinforcementLearning #ParallelToolUse #MultiAgentReinforcementLearning #VideoToolCalling #ToolPriorParadox

🔥 MiniCPM4: Ultra-Efficient LLMs on End Devices

💡 The paper introduces MiniCPM4, a highly efficient large language model designed for end-side devices. The goal is to achieve superior performance while being efficient, which is a challenge for large language models due to their computational requirements. To address this, the authors propose innovations in four key areas: model architecture, training data, training algorithms, and inference systems.

In terms of model architecture, the authors propose InfLLM v2, a trainable sparse attention mechanism that accelerates both prefilling and decoding phases for long-context processing. For training data, they propose UltraClean, an efficient and accurate pre-training data filtering and generation strategy, and UltraChat v2, a comprehensive supervised fine-tuning dataset. These datasets enable satisfactory model performance to be achieved using just 8 trillion training tokens.

The authors also propose ModelTunnel v2 for efficient pre-training strategy search and improve existing post-training methods by introducing chunk-wise rollout for load-balanced reinforcement learning and data-efficient ternary LLM, BitCPM. For inference systems, they propose CPM.cu, which integrates sparse attention, model quantization, and speculative sampling to achieve efficient prefilling and decoding.

The MiniCPM4 model is available in two versions, with 0.5B and 8B parameters, respectively. The evaluation results show that MiniCPM4 outperforms open-source models of similar size across multiple benchmarks, highlighting both its efficiency and effectiveness. Notably, MiniCPM4-8B demonstrates significant speed improvements over Qwen3-8B when processing long sequences.

The results also show that MiniCPM4 can be adapted to power diverse applications, including trustworthy survey generation and tool use with model context protocol, clearly showcasing its broad usability. Overall, the paper presents a highly efficient large language model that achieves superior performance on end-side devices, making it a significant contribution to the field of natural language processing.

📅 Published on Jun 9, 2025

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2506.07900
• PDF: https://arxiv.org/pdf/2506.07900
• Project Page: https://huggingface.co/collections/openbmb/minicpm4-6841ab29d180257e940baa9b

🤖 Models citing this paper:
• https://huggingface.co/openbmb/MiniCPM4.1-8B
• https://huggingface.co/openbmb/MiniCPM5-1B
• https://huggingface.co/openbmb/MiniCPM4-8B

📊 Datasets citing this paper:
• https://huggingface.co/datasets/openbmb/Ultra-FineWeb

🚀 Spaces citing this paper:
• https://huggingface.co/spaces/openbmb/MiniCPM5-1B-Demo
• https://huggingface.co/spaces/openbmb/Ultra-FineWeb-L2-Selector
• https://huggingface.co/spaces/openbmb/MiniCPM4.1-8B-Demo

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#EfficientLLMs #LargeLanguageModels #SparseAttentionMechanisms #EndDeviceComputing #LowResourceNLP

🔥 Toward Native Multimodal Modeling: A Roadmap

💡 The paper presents a roadmap for native multimodal modeling, which integrates different modalities within a unified transformer framework, enabling seamless understanding and generation across diverse input-output configurations. Traditional approaches rely on late-fusion, where encoders and language backbones are assembled with output heads, but recent efforts have shifted towards native multimodal modeling for superior performance. However, the design space of native architectures remains poorly defined.

To address this, the authors formally define architectural nativity, distinguishing mid-fusion and early-fusion from non-native paradigms. They categorize existing native models into three categories: Multi-to-Text for cross-modal comprehension with text-only output, Multi-to-Target for scenario-oriented generation such as image, audio, and video generation, and Multi-to-Multi for unified modeling with symmetric input-output.

The authors provide a comprehensive investigation into the transition towards a definitive native multimodal modeling framework, where understanding and generation coexist within a unified transformer paradigm. They systematically examine the end-to-end pipeline, including architectural coordination, massive data curation, full-stack training recipes, inference and deployment, and comprehensive evaluation for truly native modeling.

The paper's contributions include a formalized roadmap for native multimodal modeling, a categorization of existing native models, and a comprehensive investigation into the transition towards a unified transformer framework. The results provide a foundation for the development of native multimodal models that can seamlessly understand and generate across diverse input-output configurations, representing a significant step towards world modeling and modality-agnostic reasoning.

📅 Published on May 25

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.25343
• PDF: https://arxiv.org/pdf/2605.25343
• Project Page: https://nmm-roadmap.github.io/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#NativeMultimodalModeling #MultimodalTransformerArchitectures #EarlyFusionTechniques #MidFusionApproaches #UnifiedTransformerFrameworks

🔥 Reinforcing Few-step Generators via Reward-Tilted Distribution Matching

💡 The paper proposes a new framework called Reward-Tilted Distribution Matching Distillation, or RTDMD, to improve the alignment of few-step image generation models with human preferences. The problem addressed is that current few-step diffusion distillation methods can generate images efficiently but struggle to align with human preferences. RTDMD is a two-stage approach that combines distribution matching distillation with reward-guided reinforcement learning.

In the first stage, the authors introduce Ambient-Consistent Distribution Matching Distillation, which performs distribution matching and uses a consistency regularizer to help the model track the generator distribution.

In the second stage, the authors jointly optimize two terms: a distribution matching term and a reward maximization term. They derive a hybrid policy gradient that combines a gradient-based estimator with direct reward backpropagation to reduce variance.

The authors also introduce step-subset GRPO to further reduce variance. The experiments demonstrate that RTDMD achieves state-of-the-art results across preference, aesthetic, and compositional metrics with only 4 inference steps, outperforming previous few-step text-to-image generation methods.

The RTDMD framework is tested on several datasets, including SD3, SD3.5, and FLUX.2, and the results show that it can generate high-quality images that align with human preferences. The code and models are made available for further research and development. Overall, the paper contributes a new framework for few-step image generation that can efficiently generate high-quality images that align with human preferences.

📅 Published on May 25

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.26108
• PDF: https://arxiv.org/pdf/2605.26108

🤖 Models citing this paper:
• https://huggingface.co/Harahan/FLUX2-4B-RTDMD
• https://huggingface.co/Harahan/SD35M-RTDMD

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#FewStepGenerators #RewardTiltedDistributionMatching #ImageGenerationModels #DiffusionDistillationMethods #ReinforcementLearningForGenerativeModels

🔥 Coloring the Noise: Adversarial Sobolev Alignment for Faithful Image Super Resolution

💡 The paper addresses the issue of spectral misalignment in image super resolution, which occurs when the generated images do not accurately represent the original image structure and details. This is often due to the limitations of generative models that prioritize isotropic objectives over the natural image manifold. The authors propose a new framework called Adversarial Sobolev Alignment for image Super Resolution, or ASASR, which leverages Riemannian geometry and adversarial training to improve the structural fidelity of the generated images.

The method involves recasting the generative flow into a Sobolev-induced Riemannian geometry, which allows the model to capture the natural spectral decay of images. This is achieved by explicitly coloring the noise transition kernel to mirror the natural spectral decay. The authors also integrate a parametric adversary that synthesizes targeted negative samples to direct optimization along the tangent space of plausible structural failures.

The results of the paper demonstrate that ASASR outperforms leading generative baselines in preserving spectral consistency and structural fidelity, and effectively mitigates artifacts. The evaluations show that ASASR is a robust solution that can accurately restore high-frequency details and maintain the natural image structure. Overall, the paper contributes a new framework for image super resolution that addresses the limitations of existing generative models and provides a more faithful restoration of images.

📅 Published on May 22

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.23264
• PDF: https://arxiv.org/pdf/2605.23264

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#AdversarialTraining #ImageSuperResolution #SobolevAlignment #RiemannianGeometry #FaithfulImageGeneration

🔥 SpatialBench: Is Your Spatial Foundation Model an All-Round Player?

💡 The paper introduces SpatialBench, a comprehensive benchmark for evaluating spatial foundation models across various domains and tasks. The goal is to assess whether these models can generalize robustly across different tasks, viewpoints, scene domains, input densities, and hardware constraints. Current models are mainly evaluated on specific domains they were designed for, which limits their assessment. SpatialBench addresses this gap by featuring 19 datasets and 546 scenes across 5 diverse spatial domains, evaluating 41 models across 6 paradigms on 5 task suites under 4 different input density settings.

The evaluation reveals that current models are not all-round players, and the authors identify key insights for future advancement. They find that full-context attention maximizes accuracy, while bounded-memory strategies enable long-sequence scalability. The authors also demonstrate that domain alignment and data quality are more critical to performance than dataset size. To address the largest data gap, they introduce a large-scale dataset, DA-Next-5M, and a strong baseline model, DA-Next, to advance spatial representation learning.

The paper's contributions include a holistic assessment of spatial foundation models, a comprehensive benchmark with unprecedented scale and rigorous design, and the introduction of a new dataset and model to push the boundaries of spatial representation learning. The results provide valuable insights for the development of more robust and generalizable spatial foundation models. Overall, the paper highlights the limitations of current models and provides a foundation for future research to create more all-round players in the field of spatial representation learning.

📅 Published on May 26

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.27367
• PDF: https://arxiv.org/pdf/2605.27367
• Project Page: https://ropedia.github.io/SpatialBench/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#SpatialFoundationModels #SpatialBench #GeospatialArtificialIntelligence #ComputerVisionBenchmarks #SpatialModelEvaluation

🔥 A Very Big Video Reasoning Suite

💡 The paper introduces a large scale video reasoning dataset and benchmark to study video intelligence capabilities beyond visual quality. The problem addressed is that current video models have focused on visual quality and their reasoning capabilities have been underexplored. Video reasoning involves understanding spatiotemporal structure such as continuity, interaction, and causality, which is essential for intelligent systems. However, the lack of large scale training data has hindered systematic study of video reasoning.

To address this gap, the authors introduce the Very Big Video Reasoning Dataset, which is an unprecedentedly large scale resource consisting of 200 curated reasoning tasks and over one million video clips. This dataset is approximately three orders of magnitude larger than existing datasets. The authors also present VBVR-Bench, a verifiable evaluation framework that incorporates rule-based, human-aligned scorers to enable reproducible and interpretable diagnosis of video reasoning capabilities.

The results of the study show early signs of emergent generalization to unseen reasoning tasks, indicating that the proposed dataset and benchmark can be used to develop more generalizable video reasoning models. The dataset, benchmark toolkit, and models are publicly available, laying a foundation for the next stage of research in generalizable video reasoning. The contributions of the paper are the introduction of a large scale video reasoning dataset and benchmark, and the demonstration of their effectiveness in studying video reasoning capabilities and enabling the development of more generalizable models.

📅 Published on Feb 23

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2602.20159
• PDF: https://arxiv.org/pdf/2602.20159
• Project Page: https://video-reason.com/

🤖 Models citing this paper:
• https://huggingface.co/Video-Reason/VBVR-Wan2.2
• https://huggingface.co/Video-Reason/VBVR-LTX2.3-diffsynth
• https://huggingface.co/Video-Reason/VBVR-Wan2.1-diffsynth

📊 Datasets citing this paper:
• https://huggingface.co/datasets/Video-Reason/VBVR-Dataset
• https://huggingface.co/datasets/Video-Reason/VBVR-Bench-Data
• https://huggingface.co/datasets/Video-Reason/video-mcp

🚀 Spaces citing this paper:
• https://huggingface.co/spaces/Video-Reason/VBVR-Bench-Leaderboard

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#VideoIntelligence #VideoReasoning #SpatiotemporalAnalysis #CausalityInAI #ComputerVision