From ms to µs: OSS Valkey Architecture Patterns for Modern AI

Abstract

As AI applications demand faster and more intelligent data access, traditional caching strategies are hitting performance and reliability limits. 

This talk presents architecture patterns that shift from milliseconds to microseconds using Valkey Cluster, an open-source, Redis-compatible, in-memory datastore. Learn when to use proxy-based versus direct-access caching, how to avoid hidden reliability issues in sharded systems, and how to optimize for high price-performance at scale. Backed by the Linux Foundation, Valkey offers rich data structures and community-driven innovation. 

Whether you’re building GenAI services or scaling existing platforms, this session delivers actionable patterns to improve speed, resilience, and efficiency.


Speaker

Dumanshu Goyal

Software Engineer @Airbnb - Leading Online Data Priorities, Previously @Google and @AWS

Dumanshu Goyal is an expert in building large-scale, highly available distributed storage systems and holds 20 patents in the field. He currently leads Online Data Priorities at Airbnb as the uber technical lead, with a focus on TiDB. Previously, he led in-memory caching for Google Cloud Databases, driving 10x improvements in scale and price-performance for Memorystore. Before that, he spent 10 years at AWS, where he was the founding engineer of AWS Timestream, a serverless time-series database, and delivered key durability and availability features for DynamoDB.

Read more

From the same track

Session

How Netflix Shapes our Fleet for Efficiency and Reliability

Netflix runs on a complex multi-layer cloud architecture made up of thousands of services, caches, and databases. As hardware options, workload patterns, cost dynamics and the Netflix products evolve, the cost-optimal hardware and configuration for running our services is constantly changing.

Speaker image - Joseph Lynch

Joseph Lynch

Principal Software Engineer @Netflix Building Highly-Reliable and High-Leverage Infrastructure Across Stateless and Stateful Services

Speaker image - Argha C

Argha C

Staff Software Engineer @Netflix Building Highly Available, High Throughput Systems

Session

Realtime and Batch Processing of GPU Workloads

SS&C Technologies runs 47 trillion dollars of assets on our global private cloud. We have the primitives for infrastructure as well as platforms as a service like Kubernetes, Kafka, NiFi, Databases, etc.

Speaker image - Joseph Stein

Joseph Stein

Principal Architect of Research & Development @SS&C Technologies, Previous Apache Kafka Committer and PMC Member