Building a Supercluster: What We Learned When We Hit Cloud Provider Limits

QCon San Francisco 2025

Sponsored session

Building a Supercluster: What We Learned When We Hit Cloud Provider Limits

Tuesday Nov 18 / 10:35AM PST, Pacific LM at Hyatt Regency, San Francisco

Abstract

We hit the ceiling of what major cloud providers could offer—hard limits, quota caps, and regional restrictions that no amount of budget could fix. So, we built our own supercluster.

This talk walks through the challenges that forced that decision, the architectural tradeoffs we made, and the lessons learned from running it under real, production-scale workloads. If you’ve ever wondered what happens when your infrastructure outgrows the cloud, this session will take you there

Sponsored session

Session Sponsored By

Lightweight, petabyte-scale observability

76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2025 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Tuesday 18 November

10:35 Pacific LM Sponsored Building a Supercluster: What We Learned When We Hit Cloud Provider Limits Prabhat Sharma Founder @OpenObserve 11:45 Pacific LM Sponsored Vibes Won't Cut It: Agentic Engineering in Production Chris Kelly Product @ Augment | Developer productivity & AI 13:35 Pacific LM Sponsored Building Agentic Workflows with MCP (AI Engineering that Delivers) Sterling Chin Developer Advocate @Postman 14:45 Pacific LM Sponsored A Day in the Life of a Senior Engineer: Navigating Context with AI Vinay Perneti, Anand Kumar Sankaran 15:55 Pacific LM Sponsored Uncovering the Coding Personalities of Leading LLMs Anirban Chatterjee Senior Director, Product & Solutions Marketing @Sonar 17:05 Pacific LM Sponsored Make Mechanical Advantage YOUR Advantage: How to Modernize and Futureproof Your Code with OpenRewrite Mark Heckler Senior Director of Field Engineering @Moderne