AI & ML Papers
34K subscribers
7.37K photos
593 videos
24 files
8.11K links
Advancing research in Machine Learning – practical insights, tools, and techniques for researchers.

Admin: @HusseinSheikho || @Hussein_Sheikho
Download Telegram
AI & ML Papers
Photo
🔥 RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM

💡 The paper introduces RAGU, a multi-step graph retrieval-augmented generation engine that enhances large language models with structured knowledge. Existing systems construct knowledge graphs in a single extraction pass, producing noisy entities and brittle retrieval. RAGU addresses this by separating extraction from consolidation, using a two-stage typed extraction process, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection.

A key insight is that the skills an in-pipeline LLM needs, such as comprehension, extraction, and reasoning over context, are language skills that grow only weakly with model size, unlike factual world knowledge. Therefore, the authors train MENO-LITE-0.1, a 7B model optimized for language skills, which outperforms Qwen 2.5-32B on knowledge-graph construction and matches it on English GraphRAG tasks.

The results show that RAGU retrieves the most complete context at every factoid level, with evidence recall up to 0.84, and overtakes HippoRAG 2 on synthesis tasks. On multi-hop factoid QA, the apparent HippoRAG 2 advantage is shown to be largely an answer-format artifact. RAGU is installable via pip install graphragu, runs on a single GPU, and is released under MIT. The source code and MENO-LITE-0.1 model are publicly available. Overall, RAGU provides a more effective and efficient approach to graph retrieval-augmented generation, with significant improvements in knowledge-graph construction and question answering tasks.


📅 Published on Jul 13

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.11683
• PDF: https://arxiv.org/pdf/2607.11683

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#GraphRetrievalAugmentedGeneration #DomainAdaptedLLM #MultiStepGraphEngine #KnowledgeGraphConstruction #RetrievalAugmentedGenerationModels