Перейти к содержимому

Building Auditable Deep-Research Agents: GraphRAG, Multi-Hop Reasoning & Source Attribution

BIBIN PRATHAP

0:00 / 0:00

Building Auditable Deep-Research Agents: GraphRAG, Multi-Hop Reasoning & Source Attribution

38 просмотров · 4 дня назад
BIBIN PRATHAP
9 подписчиков
38 просмотров · 4 дня назад
"Most of you have used a deep-research tool in the last month. How many of you actually opened the citations?" The primary failure mode of modern deep-research agents isn't "wrong facts" — it’s unfalsifiable claims: fluent, plausible prose with citations that no reviewer has time to audit. In this session recorded live at MBZUAI for Abu Dhabi Machine Learning (ADML Season 7, Episode 1), Bibin Prathap (Microsoft MVP, IEEE Senior Member, and AI Strategy Leader) breaks down why baseline vector RAG fails multi-hop synthesis, and how GraphRAG provides the deterministic error-correction substrate required for true autonomous research. Using the open-source VeritasGraph framework, Bibin walks through how to link chunks directly to knowledge graph edges, assemble multi-hop evidence chains across siloed documents, and enforce 6 concrete engineering patterns that turn a confident guesser into an agent that reliably knows when to abstain. 📦 Open-Source Code: https://github.com/bibinprathap/VeritasGraph 🌐 Speaker Website: https://bibinprathap.com/ 💼 Speaker LinkedIn: https://www.linkedin.com/in/bibin-prathap-... 🏛️ Hosted by: Abu Dhabi Machine Learning (ADML) at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) 📌 Context Note: This video covers the topic of my selected session for Abu Dhabi Machine Learning, Season 7 Episode 1, scheduled for September 21, 2026, at MBZUAI. I was unable to attend in person and recorded this presentation separately. Organizer’s programme: https://www.meetup.com/adml-abu-dhabi-mach... --- ⏱️ TIMESTAMPS 00:00 - The Citation Problem: Unfalsifiable Facts 00:45 - The Premise: Evidence You Can Defend 03:00 - Session Outcomes & Vendor-Neutral Architecture 04:00 - Deep Research vs. AutoResearch: Attribution as an Error Substrate 06:00 - Why Baseline Vector RAG Breaks on Multi-Hop Queries 09:00 - Ingestion to Answer: Assembling Evidence Across 3 Hops 11:30 - Reasoning Traceability: Attribution is a Data Model, Not a Prompt 13:30 - 6 Engineering Patterns to Eliminate Hallucination 15:30 - Reproducibility: Pinning Corpus, Graph, and Traversal 17:00 - Enterprise Reference Architecture (ACLs, Boundaries, Logs) 18:00 - LIVE DEMO: VeritasGraph Knowledge Graph Explorer 19:30 - LIVE DEMO: Clicking Citations & Inspecting Reasoning Paths 20:30 - LIVE DEMO: PII Masking & Jailbreak Guardrails 21:30 - Don't Demo the Happy Path: 4 Failure Scenarios Handled 23:00 - Honest Trade-offs: The Actual Costs of GraphRAG 24:30 - Toward AutoResearch: Requirements Before Agents Run Experiments 26:00 - The "Dependable Agent" Pre-Flight Checklist 27:00 - Closing: Evidence First, Autonomy Second & Live Q&A --- 🔑 KEY ARCHITECTURAL TAKEAWAYS 1. Chunk boundaries sever relationships: Top-k vector similarity is a heuristic, not a reasoning plan. It cannot resolve queries where premise A, mediator B, and conclusion C live in distinct documents. 2. Attribution is a write-time data model: If provenance isn't stored when the edge is created, read-time prompting will only hallucinate plausible citations. A bibliography is not traceability. 3. Deterministic Traversal: LLM synthesis is stochastic, but graph traversal is deterministic. Separating the retrieval trace from prose generation makes answers auditable and reproducible. 4. Abstention as a safety valve: A research agent must explicitly return "insufficient evidence" and identify the missing graph edge rather than confabulating bridge data. --- 👤 ABOUT THE SPEAKER Bibin Prathap is an AI Strategy Leader, Microsoft MVP (Azure AI), and IEEE Senior Member based in Abu Dhabi. He is the creator of the open-source VeritasGraph framework. Over the past decade, he has focused on enterprise-grade, explainable, and trustworthy AI implementations for heavily regulated environments and sovereign entities. #MachineLearning #GraphRAG #AIAgents #RAG #VeritasGraph #DeepResearch #LLMOps #MBZUAI #ADML #ArtificialIntelligence