AI & ML Papers
33.2K subscribers
7.14K photos
547 videos
24 files
7.83K links
Advancing research in Machine Learning – practical insights, tools, and techniques for researchers.

Admin: @HusseinSheikho || @Hussein_Sheikho
Download Telegram
AI & ML Papers
Photo
🔥 HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agents

💡 The paper introduces HyperEyes, a parallel multimodal search agent designed to optimize inference efficiency through dual-grained reinforcement learning. Existing multimodal search agents process target entities sequentially, which can lead to redundant interaction rounds and decreased efficiency. HyperEyes addresses this issue by fusing visual grounding and retrieval into a single atomic action, enabling concurrent search across multiple entities.

The HyperEyes system is trained in two stages. The first stage involves a Parallel-Amenable Data Synthesis Pipeline that generates efficiency-oriented trajectories via Progressive Rejection Sampling. The second stage utilizes a Dual-Grained Efficiency-Aware Reinforcement Learning framework, which operates at two levels. At the macro level, the framework uses a trajectory-level reward called TRACE, which is designed to suppress superfluous tool calls without restricting genuine multi-hop search. At the micro level, the framework adapts On-Policy Distillation to inject dense token-level corrective signals from an external teacher on failed rollouts, mitigating the credit-assignment deficiency of sparse outcome rewards.

The paper also introduces a new benchmark called IMEB, which jointly evaluates search capability and efficiency. The results show that HyperEyes surpasses the strongest comparable open-source agent by 9.9% in accuracy, while using 5.3x fewer tool-call rounds on average. The HyperEyes system demonstrates the effectiveness of dual-grained reinforcement learning in optimizing inference efficiency and achieving better search results. Overall, the paper contributes to the development of more efficient and effective multimodal search agents.


📅 Published on May 8

🔗 Links:
• arXiv: https://arxiv.org/abs/2605.07177
• PDF: https://arxiv.org/pdf/2605.07177
• GitHub: https://github.com/DeepExperience/HyperEyes 34

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#MultimodalSearchAgents #ReinforcementLearning #ParallelSearchAlgorithms #EfficiencyAwareSystems #DualGrainedLearning