AI & ML Papers
Photo
🔥 Harness-1: Reinforcement Learning for Search Agents with State-Externalizing Harnesses
📅 Published on Jun 1
🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2606.02373
• PDF: https://arxiv.org/pdf/2606.02373
🤖 Models citing this paper:
• https://huggingface.co/pat-jj/harness-1
━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus
#ReinforcementLearning #SearchAgents #StateExternalizing #ReinforcementLearningAlgorithms #DeepLearningForSearch
💡 The paper introduces Harness-1, a 20 billion parameter search agent trained with reinforcement learning to improve retrieval performance across multiple domains. The problem with traditional search agents is that they are trained as policies that must decide how to search while also remembering what they have seen, which can lead to inefficient state management. To address this, the authors propose separating semantic decision-making from environmental bookkeeping by using a stateful search harness that maintains environment-side working memory. This harness includes features such as a candidate pool, importance-tagged curated set, compact evidence links, verification records, and budget-aware context rendering. The policy is then responsible for making semantic decisions, such as what to search, which documents to keep or discard, and when to stop. The results show that Harness-1 achieves an average curated recall of 0.730 across eight retrieval benchmarks, outperforming the next strongest open search subagent by 11.4 points. The gains are especially strong on held-out transfer benchmarks, suggesting that the approach can produce retrieval behaviors that generalize beyond the training domains. Overall, the paper demonstrates that using a stateful search harness to separate state management from semantic decision-making can lead to improved retrieval performance and more generalizable search behaviors.
📅 Published on Jun 1
🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2606.02373
• PDF: https://arxiv.org/pdf/2606.02373
🤖 Models citing this paper:
• https://huggingface.co/pat-jj/harness-1
━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus
#ReinforcementLearning #SearchAgents #StateExternalizing #ReinforcementLearningAlgorithms #DeepLearningForSearch
GitHub
Hugging Face
The AI community building the future. Hugging Face has 443 repositories available. Follow their code on GitHub.