Speaker
Abstract
A great SAAS service requires a robust Control Plane as its brain. The Control Plane automates infrastructure provisioning, deployments, configuration, monitoring, fleet management, capacity allocation to customers, and so forth. Building a control plane is daunting and error prone. There are myriad long lived API calls on shared resources, and they occasionally fail. Reliable orchestration of these APIs is a crucial part of a healthy control plane. In this talk, we introduce the concept of Durable Execution, with a real world example of how we use it to build the Control Plane for Temporal Cloud.
Interview
My focus is on the architecture of Temporal Cloud as a means of making Durable Execution available to every organization without the need to run their own infrastructure, with the highest availability and scalability.
Durable Execution fits control plane patterns like hand and glove, with asynchronous operations that take time and occasionally fail. This made DE popular among people building SaaS services. Temporal Cloud was no exception.
The immediate persona that comes to mind is a developer/architect building a control plane or otherwise automating the management of infrastructure. The broader audience is developers who can see through this use case a broader applicability of Durable Execution for automating all kinds of business processes, without the need for most error handing, retry, and backoff logic.
The immediate takeaway is the pattern for building SaaS control planes or other infrastructure management automation that is proven, easy to apply and to evolve. The more forward-looking takeaway is the value of Durable Execution which liberates developers from a whole host of concerns when building systems.
Topics
QCon San Francisco 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Architecting for the Cloud Hosted by Khawaja Shams Co-Founder & CEO @Momento, previously @NASA and @AmazonFrom the same track
Wednesday 4 October
10:35 Ballroom BC Session Serverless Lessons from Leading the Serverless First Journey at CapitalOne George Mao Senior Distinguished Engineer @Capital One Leading All Things Serverless, Ex-AWS WW Serverless Tech Lead Going serverless? Worried about challenges with performance, cost, and scale? At CapitalOne, we embraced a serverless first mentality across thousands of applications live today. This talk covers our journey into serverless, the best practices we picked up, and the lessons learned along the way. 11:45 Ballroom BC Session Cloud Million Dollar Lines of Code: An Engineering Perspective on Cloud Cost Optimization Erik Peterson CTO & Founder @CloudZero, Engineering-Led Cloud Cost Optimization Pioneer & 23-Year Software Startup Veteran A single line of code can shape an organization's financial future. Drawing inspiration from five real examples of million-dollar lines of code, we will challenge conventional views on engineering's pivotal role in cloud cost optimization. 13:35 Ballroom BC Session Architecture Durable Execution for Control Planes: Building Temporal Cloud on Temporal Sergey Bykov SDE @Temporal Technologies A great SAAS service requires a robust Control Plane as its brain. The Control Plane automates infrastructure provisioning, deployments, configuration, monitoring, fleet management, capacity allocation to customers, and so forth. 14:45 Ballroom BC Session Architecture Understanding Architectures for Multi-Region Data Residency Alex Strachan Staff Software Engineer, Performance & Architecture @Rippling Making your app multi-cell/multi-region can have a number of benefits in compliance, scaling and even marketability. There are a number of challenges, from cross-region access and trust to defining sources of truth across the globe. We’ll focus on: 15:55 Ballroom BC Session Cellular Architecture Architecting for High Availability in the Cloud with Cellular Architecture Chris Price Software Engineer @Momento, Previously Launched New Video Streaming Services @AWS, 10+ Years in Engineering Leadership at Software Startups With the explosion in the usage of cloud computing and microservices, blast radius underpins highly availability systems.