Amazon DynamoDB: Evolution of a Hyper-Scale Cloud Database Service

Amazon DynamoDB is a cloud database service that provides consistent performance at any scale. Hundreds of thousands of customers rely on DynamoDB for its fundamental properties: consistent performance, availability, durability, and a fully managed serverless experience. In 2022, during the Amazon Prime Day shopping event, Amazon systems -- including Alexa, the Amazon.com sites, and Amazon fulfillment centers -- made trillions of API calls to DynamoDB, peaking at 105.2 million requests per second, while experiencing high availability with single-digit millisecond performance. Reliability is essential, as even the slightest disruption can significantly impact customers. 

Since the launch of DynamoDB in 2012, its design and implementation have evolved in response to our experiences operating it. The system has successfully dealt with issues related to fairness, traffic imbalance across partitions, monitoring, and automated system operations without impacting availability or performance. This talk presents our experience operating DynamoDB at massive scale and how the architecture continues to evolve to meet the ever-increasing demands of customer workloads.


Speaker

Akshat Vig

Principal Engineer NoSQL databases @awscloud

Akshat Vig is a Principal Engineer at AWS. Akshat has been working on DynamoDB since its inception. He is one of the primary authors on the DynamoDB paper published at USENIX. DynamoDB is one of the largest and most mission critical distributed systems in the world, and underpins much of AWS, Amazon, and the internet ecosystem today. As a Principal engineer, Akshat solves some of the most difficult distributed systems problems at Amazon across multiple services. He has filed close to 100 patents, served on IEEE program committees, and has given keynotes around the world. He is excited to solve the next big challenge in distributed systems. 

Read more

Date

Wednesday Oct 26 / 10:35AM PDT ( 50 minutes )

Location

Ballroom A

Topics

Architecture Cloud Database Service Serverless Performance Availability Durability Traffic Imbalance Monitoring Automated System Operations

Share

From the same track

Session Architecture

Azure Cosmos DB: Low Latency and High Availability at Planet Scale

Wednesday Oct 26 / 01:40PM PDT

Azure Cosmos DB is a fully-managed, multi-tenant, distributed, shared-nothing, horizontally scalable database that provides planet-scale capabilities and multi-model APIs for Apache Cassandra, MongoDB, Gremlin, Tables, and the Core (SQL) APIs.

Speaker image - Mei-Chin Tsai

Mei-Chin Tsai

Partner Director of Software Eng Manager @Microsoft, one of the original developers on .NET

Speaker image - Vinod Sridharan

Vinod Sridharan

Principal Software Engineering Architect @Microsoft

Session Architecture

Honeycomb: How We Used Serverless to Speed Up Our Servers

Wednesday Oct 26 / 11:50AM PDT

Honeycomb is the state of the art in observability: customers send us lots of data and then compose complex, ad-hoc queries. Most are simple, some are not. Some are REALLY not; this load is both complex, spontaneous, and urgent.

Speaker image - Jessica Kerr

Jessica Kerr

Principal Developer Evangelist @honeycombio

Session Architecture

From Zero to A Hundred Billion: Building Scalable Real Time Event Processing At DoorDash

Wednesday Oct 26 / 02:55PM PDT

At DoorDash, real time events are an important data source to gain insight into our business but building a system capable of handling billions of real time events is challenging.

Speaker image - Allen Wang

Allen Wang

Software Engineer @DoorDash, previously Lead for real-time data infrastructure team @Netflix

Session Architecture

Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System

Wednesday Oct 26 / 04:10PM PDT

Magic Pocket is used to store all of Dropbox’s data.

Speaker image - Facundo Agriel

Facundo Agriel

Software Engineer / Tech Lead @Dropbox, previously @Amazon