When Every Bit Counts: How Valkey Rebuilt Its Hashtable for Modern Hardware

QCon San Francisco 2025

Session Performance

When Every Bit Counts: How Valkey Rebuilt Its Hashtable for Modern Hardware

Wednesday Nov 19 / 01:35PM PST, Pacific DEKJ at Hyatt Regency, San Francisco

Abstract

Ever wondered what happens when a bunch of performance-obsessed developers decide their blazing-fast database isn't quite blazing-fast enough? Join me for a deep-dive into how we threw out the beating heart of Valkey, a hashtable that was designed over 15 years ago, and replace it with something faster and more memory efficient. We'll dive into how careful attention to cache-line alignment, memory access patterns, and SIMD operations led to significant improvements in both memory efficiency and performance. Whether you're working on high-performance systems or just curious about modern hardware optimization, you'll come away with concrete insights into how subtle architectural choices can have outsized impacts on real-world performance.

Topics

Performance Valkey Cache System Design C
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2025 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Wednesday 19 November

10:35 Pacific DEKJ Session Rust The Rust High Performance Talk You Did Not Expect Ruth Linehan Software Engineer @Momento, Previously APIs/Webhooks @GitHub and @Puppet 11:45 Pacific DEKJ Session Instrumentation at Scale: Having Your Performance Cake and Eating It Too Brian Martin Co-founder and Software Engineer @IOP Systems, Focused on High-Performance Software and Systems, Previously @Twitter 13:35 Pacific DEKJ Session Performance When Every Bit Counts: How Valkey Rebuilt Its Hashtable for Modern Hardware Madelyn Olson Principal Engineer @AWS, Maintainer of the Open-Source Valkey Project 14:45 Pacific DEKJ Session Performance Accelerating Performance by Incrementally Integrating Rust Into Existing Codebase Lily Mara Staff Engineer @Discord, Author of "Refactoring to Rust", Previously Engineering Manager @OneSignal 15:55 Pacific DEKJ Session Python Python, Numba, and Algorithm Design: Building Efficient Models in Financial Services Chad Schuster Principal @Milliman Focusing on Risk Management, Modeling, and Technology Consulting Services