Enhance LLMs’ Explainability and Trustworthiness With Knowledge Graphs

QCon San Francisco 2024

Session Knowledge Graphs

Enhance LLMs’ Explainability and Trustworthiness With Knowledge Graphs

Monday Nov 18 / 10:35AM PST, Ballroom BC

Abstract

Graphs, especially knowledge graphs, are powerful tools for structuring data into interconnected networks. The structured format of knowledge graphs enhances the performance of LLM-based systems by improving information retrieval and ensuring the use of reliable sources. By integrating knowledge graphs in LLM-based applications, we can reduce reliance on purely vector-based methods, which may not consistently generate accurate outputs. This integration can lead to more reliable and trustworthy results. In this talk, we will demonstrate how knowledge graphs enhance factual accuracy in responses and how their relationship-driven features enable LLM-based systems to generate more contextually-aware outputs. We will present real-life examples with side-by-side comparisons to illustrate these benefits.

Main Takeaways:
  1. Richer Contexts for Better Answers: Knowledge graphs link data in ways that provide LLMs with deeper context. This helps LLMs find and generate more relevant responses.

  2. Transparent Information Paths: Using both vector search and knowledge graphs in LLMs not only increases the precision of answers but also lets users see where information comes from, building trust in the system.

  3. Broad Use Cases: Knowledge graphs, as organized data structures, are widely applicable across many fields, including healthcare, e-commerce, HR, etc. These graphs organize and provide access to a vast amount of structured data, effectively mapping relationships between data points. This allows for a nuanced understanding and navigation of complex information. When integrated with LLMs, knowledge graphs enable them to leverage this structure to generate human-like responses that are both accurate and contextually relevant. This integration not only improves the effectiveness of data retrieval but also enhances the quality of interactions and decision-making across various applications.

Topics

Knowledge Graphs LLMs Generative AI RAG
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Monday 18 November

10:35 Ballroom BC Session Knowledge Graphs Enhance LLMs’ Explainability and Trustworthiness With Knowledge Graphs Leann Chen AI Developer Advocate @Diffbot, Creator of AI and Knowledge Graph Content on YouTube, Passionate About Knowledge Graphs & Generative AI 11:45 Ballroom BC Session Scale Out Batch Inference with Ray Cody Yu Staff Software Engineer and Tech Lead @Anyscale, Ex-Amazonian, vLLM Committer, Apache TVM PMC 13:35 Ballroom BC Session AI/ML Recommender and Search Ranking Systems in Large Scale Real World Applications Moumita Bhattacharya Senior Research Scientist @Netflix, Previously @Etsy, Specialized in Machine Learning, Deep Learning, Big Data, Scala, Tensorflow, and Python 14:45 Ballroom BC Session AI/ML Why Most Machine Learning Projects Fail to Reach Production and How to Beat the Odds Wenjie Zi Senior Machine Learning Engineer and Tech Lead @Grammarly, Specializing in Natural Language Processing, 10+ Years of Industrial Experience in Artificial Intelligence Applications 15:55 Seacliff D Unconference Unconference: AI and ML for Software Engineers 17:05 Ballroom BC Session AI/ML Reinforcement Learning for User Retention in Large-Scale Recommendation Systems Saurabh Gupta, Gaurav Chakravorty