AI & ML Papers
33K subscribers
7.11K photos
532 videos
24 files
7.78K links
Advancing research in Machine Learning – practical insights, tools, and techniques for researchers.

Admin: @HusseinSheikho || @Hussein_Sheikho
Download Telegram
AI & ML Papers
Photo
🔥 Harness-1: Reinforcement Learning for Search Agents with State-Externalizing Harnesses

💡 The paper introduces Harness-1, a 20 billion parameter search agent trained with reinforcement learning to improve retrieval performance across multiple domains. The problem with traditional search agents is that they are trained as policies that must decide how to search while also remembering what they have seen, which can lead to inefficient state management. To address this, the authors propose separating semantic decision-making from environmental bookkeeping by using a stateful search harness that maintains environment-side working memory. This harness includes features such as a candidate pool, importance-tagged curated set, compact evidence links, verification records, and budget-aware context rendering. The policy is then responsible for making semantic decisions, such as what to search, which documents to keep or discard, and when to stop. The results show that Harness-1 achieves an average curated recall of 0.730 across eight retrieval benchmarks, outperforming the next strongest open search subagent by 11.4 points. The gains are especially strong on held-out transfer benchmarks, suggesting that the approach can produce retrieval behaviors that generalize beyond the training domains. Overall, the paper demonstrates that using a stateful search harness to separate state management from semantic decision-making can lead to improved retrieval performance and more generalizable search behaviors.


📅 Published on Jun 1

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2606.02373
• PDF: https://arxiv.org/pdf/2606.02373

🤖 Models citing this paper:
https://huggingface.co/pat-jj/harness-1

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#ReinforcementLearning #SearchAgents #StateExternalizing #ReinforcementLearningAlgorithms #DeepLearningForSearch