Abstract
AWS Lambda is a serverless compute service running at a massive scale! Supporting packages of up to 10GiB while allowing over 15K new containers per second (for a single customer) and serving millions of TPS across millions of unique workflows is a challenging problem. Delivering all this with low startup times (sub-50ms) required innovative storage, caching, and chunk loading techniques. This talk will cover how Lambda is built and how we had to modify the architecture to support 10GiB payloads. You will walk away with insights on how to think about your own cloud based architecture and some key internals about Lambda to help you make the most out of it.
Topics
QCon San Francisco 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Architectures You've Always Wondered About Hosted by Wes Reisz Technical Principal @Thoughtworks, 16-Time QCon Chair, & Creator of The InfoQ PodcastFrom the same track
Monday 2 October
10:35 Ballroom BC Session Serverless AWS Lambda Under the Hood Mike Danilov Senior Principal Engineer @AWS Lambda AWS Lambda is a serverless compute service running at a massive scale! Supporting packages of up to 10GiB while allowing over 15K new containers per second (for a single customer) and serving millions of TPS across millions of unique workflows is a challenging problem. 11:45 Ballroom BC Session Database Relational Data at the Edge Justin Kwan, Vignesh Ravichandran Data storage and access at the edge delivers massive performance gains by reducing location-sensitive latency. 13:35 Ballroom BC Session K8s NIST 800-207A: Implementing Zero Trust Architecture Zack Butcher Founding Engineer @Tetrateio & NIST co-author on security, prev core services @GoogleCloud Zero Trust is all about replacing implicit trust based on perimeter security and network access with explicit trust based on identity and runtime authorization. 14:45 Ballroom BC Session Distributed Systems Managing 238M Memberships at Netflix Surabhi Diwan Senior Software Engineer @Netflix Have you ever wondered what goes on behind the scenes when you sit back, relax and watch Netflix? How does Netflix own and operate their system of record for all members making sure they continue to be in good standing and get the best experience possible? 15:55 Seacliff D Unconference Unconference: Architectures You've Always Wondered About What is an unconference? An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions. 17:05 Ballroom BC Session Recommender Systems Unpacking how Ads Ranking Works @Pinterest Aayush Mudgal Senior Machine Learning Engineer @Pinterest, Focusing on Privacy Safe Recommender Systems, IIT Kanpur Alumnus In this session, we delve into the dynamic world of social media advertising. Facebook, Snap, Pinterest, Twitter, and many others generate the majority of their revenue from targeted ads.