Architecting for High Availability in the Cloud with Cellular Architecture

QCon San Francisco 2023

Session Cellular Architecture

Architecting for High Availability in the Cloud with Cellular Architecture

Wednesday Oct 4 / 03:55PM PDT, Ballroom BC

Abstract

With the explosion in the usage of cloud computing and microservices, blast radius underpins highly availability systems. At AWS, all new services are embracing a cellular architecture - which gets them to reduce the blast radius, scale gracefully, and deliver the highest availability to its customers. We dive into the merits of cellular architecture, design options with cellularization, and how to effectively isolate at the level of the AWS account. We also cover Infrastructure-As-Code patterns to quickly bring up cells, how to securely connect each cell with foundational services like metrics across VPCs, and how to manage the multitude of AWS accounts you end up with. 

Interview

I’ve recently transitioned from working on the backend, architecture, and infrastructure components of Momento’s serverless cache to lead our developer ecosystem. That means that my current day job is providing clean, simple libraries that allow Momento users to start caching with as little friction as humanly possible, in whatever environment they are already building things in. Nowadays, instead of building out our infrastructure, I’m focused on helping users remove things from theirs :)

Having witnessed several different strategies for managing and scaling server-side infrastructure at my previous jobs, I have seen first-hand what a huge difference it makes for a software company (and more importantly, for their customers) to invest a little upfront to build a solid foundation for a cellular architecture. Over time, the relatively small upfront investment pays off in so many ways: protecting customers from outages, allowing the business to react more quickly to changing demands, dramatically reducing operational overhead and improving developer productivity; the list goes on. I’m excited to share some of these learnings in hopes that the audience can adapt them to their own infrastructure.

This talk is intended for engineering folks who are building and operating multi-regional cloud applications and services. We’ll primarily focus on AWS solutions to cellular architecture problems, so some familiarity with AWS account and permissions management will be useful, but the principles can be applied to any major cloud environment.

Attendees will hear about some of the very tangible benefits that can be achieved by building automation for deploying and managing cellular infrastructure for your service or application. We’ll also give some concrete examples of specific technologies such as AWS SSO, AWS Organizations, and AWS CodePipelines that can be used to realize a scalable cellular solution. I hope to convince you that a small engineering investment upfront will pay for itself many, many times over by improving your customer experience and increasing your engineering velocity.

Topics

Cellular Architecture Cloud Infrastructure Architecture Scalability
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Wednesday 4 October

10:35 Ballroom BC Session Serverless Lessons from Leading the Serverless First Journey at CapitalOne George Mao Senior Distinguished Engineer @Capital One Leading All Things Serverless, Ex-AWS WW Serverless Tech Lead 11:45 Ballroom BC Session Cloud Million Dollar Lines of Code: An Engineering Perspective on Cloud Cost Optimization Erik Peterson CTO & Founder @CloudZero, Engineering-Led Cloud Cost Optimization Pioneer & 23-Year Software Startup Veteran 13:35 Ballroom BC Session Architecture Durable Execution for Control Planes: Building Temporal Cloud on Temporal Sergey Bykov SDE @Temporal Technologies 14:45 Ballroom BC Session Architecture Understanding Architectures for Multi-Region Data Residency Alex Strachan Staff Software Engineer, Performance & Architecture @Rippling 15:55 Ballroom BC Session Cellular Architecture Architecting for High Availability in the Cloud with Cellular Architecture Chris Price Software Engineer @Momento, Previously Launched New Video Streaming Services @AWS, 10+ Years in Engineering Leadership at Software Startups