Speaker
Abstract
Graphs, especially knowledge graphs, are powerful tools for structuring data into interconnected networks. The structured format of knowledge graphs enhances the performance of LLM-based systems by improving information retrieval and ensuring the use of reliable sources. By integrating knowledge graphs in LLM-based applications, we can reduce reliance on purely vector-based methods, which may not consistently generate accurate outputs. This integration can lead to more reliable and trustworthy results. In this talk, we will demonstrate how knowledge graphs enhance factual accuracy in responses and how their relationship-driven features enable LLM-based systems to generate more contextually-aware outputs. We will present real-life examples with side-by-side comparisons to illustrate these benefits.
Main Takeaways:
Richer Contexts for Better Answers: Knowledge graphs link data in ways that provide LLMs with deeper context. This helps LLMs find and generate more relevant responses.
Transparent Information Paths: Using both vector search and knowledge graphs in LLMs not only increases the precision of answers but also lets users see where information comes from, building trust in the system.
Broad Use Cases: Knowledge graphs, as organized data structures, are widely applicable across many fields, including healthcare, e-commerce, HR, etc. These graphs organize and provide access to a vast amount of structured data, effectively mapping relationships between data points. This allows for a nuanced understanding and navigation of complex information. When integrated with LLMs, knowledge graphs enable them to leverage this structure to generate human-like responses that are both accurate and contextually relevant. This integration not only improves the effectiveness of data retrieval but also enhances the quality of interactions and decision-making across various applications.
Topics
QCon San Francisco 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
AI and ML for Software Engineers: Foundational Insights Hosted by Susan Shu Chang Principal Data Scientist @Elastic, Author of "Machine Learning Interviews"From the same track
Monday 18 November
10:35 Ballroom BC Session Knowledge Graphs Enhance LLMs’ Explainability and Trustworthiness With Knowledge Graphs Leann Chen AI Developer Advocate @Diffbot, Creator of AI and Knowledge Graph Content on YouTube, Passionate About Knowledge Graphs & Generative AI Graphs, especially knowledge graphs, are powerful tools for structuring data into interconnected networks. The structured format of knowledge graphs enhances the performance of LLM-based systems by improving information retrieval and ensuring the use of reliable sources. 11:45 Ballroom BC Session Scale Out Batch Inference with Ray Cody Yu Staff Software Engineer and Tech Lead @Anyscale, Ex-Amazonian, vLLM Committer, Apache TVM PMC As AI technologies continue to evolve, the demand for processing both structured and unstructured data across diverse industries is rapidly growing. 13:35 Ballroom BC Session AI/ML Recommender and Search Ranking Systems in Large Scale Real World Applications Moumita Bhattacharya Senior Research Scientist @Netflix, Previously @Etsy, Specialized in Machine Learning, Deep Learning, Big Data, Scala, Tensorflow, and Python Recommendation and search systems are two of the key applications of machine learning models in industry. Current state of the art approaches have evolved from tree based ensembles models to large deep learning models within the last few years. 14:45 Ballroom BC Session AI/ML Why Most Machine Learning Projects Fail to Reach Production and How to Beat the Odds Wenjie Zi Senior Machine Learning Engineer and Tech Lead @Grammarly, Specializing in Natural Language Processing, 10+ Years of Industrial Experience in Artificial Intelligence Applications Despite the hype around AI, many ML projects fail, with only 15% of businesses' ML projects succeeding, according to McKinsey. Particularly with the significant investments in large language models and generative AI, only a small portion of companies have managed to realize their true value. 15:55 Seacliff D Unconference Unconference: AI and ML for Software Engineers 17:05 Ballroom BC Session AI/ML Reinforcement Learning for User Retention in Large-Scale Recommendation Systems Saurabh Gupta, Gaurav Chakravorty This talk explores the application of reinforcement learning (RL) in large-scale recommendation systems to optimize user retention at scale - the true north star of effective recommendation engines.