Speaker
Abstract
Uber has an in-house search engine called Search In Action (SIA). As the backbone behind the feed and search capabilities of Uber's Delivery business, SIA plays a crucial role in expanding selection seamlessly for customers which is a strategic advantage to the business.
SIA has continually evolved to enable customers to find their favorite stores, even if they're not conveniently located for pickup. Join us as we delve into the real-world challenges faced in handling millions of merchants with dynamic traffic patterns, all while striking a balance between backend architecture performance and incremental order volume.
In this session, we'll dive into the heart of the matter- the optimization problem of the query layer with a dive deep into how internals of SIA works, challenges faced and how we built a solution which is scalable for multiple similar use cases.
Learn firsthand how we tackled this challenge by devising a novel index layout specifically tailored for range queries. The result is an impressive 40% reduction in latency without impacting the business's bottom line.
Gain invaluable insights into building cost-effective in-house solutions in today's cloud-dominated landscape as we share essential tips on avoiding pitfalls while working on large scale systems and achieving incremental optimization wins.
Topics
QCon San Francisco 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Architectures You've Always Wondered About Hosted by Thomas Betts Senior Laureate Software Architect @BlackbaudFrom the same track
Monday 18 November
10:35 Ballroom A Session MLOps Supporting Diverse ML Systems at Netflix David Berg, Romain Cledat Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications. 11:45 Ballroom A Session Architecture Optimizing Search at Uber Eats Janani Narayanan, Karthik Ramasamy Uber has an in-house search engine called Search In Action (SIA). As the backbone behind the feed and search capabilities of Uber's Delivery business, SIA plays a crucial role in expanding selection seamlessly for customers which is a strategic advantage to the business. 13:35 Ballroom A Session Architecture Changing the Model: Why and How We Re-Architected Slack Ian Hoffman Staff Software Engineer @Slack, Previously @Chairish Over time, the architectural assumptions underpinning a software application may diverge further and further from that application's product requirements. 14:45 Seacliff D Unconference Unconference: Architectures You've Always Wondered About 15:55 Ballroom A Session HTTP How GitHub Copilot Serves 400 Million Completion Requests a Day David Cheney Lead, Copilot Proxy @GitHub, Open Source Contributor and Project Member for Go Programming Language, Previously @VMware GitHub Copilot is the largest LLM powered Code Completion service in the world, serving hundreds of millions of requests per day with an average response time of under 200ms. This is the story of the architecture which powers this product. 17:05 Ballroom A Session Legacy Modernization: Architecting Real-Time Systems Around a Mainframe Jason Roberts, Sonia Mathew Designing systems that take advantage of modern platforms, tools, and techniques is critical for building scalable, evolvable applications that underpin businesses of all stripes. Leveraging those when your data is captured in a mainframe, which does not scale well, is challenging.