Inflection Points in Engineering Productivity as Amazon Grew 30x

QCon San Francisco 2024

Session Engineering productivity

Inflection Points in Engineering Productivity as Amazon Grew 30x

Tuesday Nov 19 / 11:45AM PST, Seacliff ABC

Abstract

I joined Amazon in 2009, when we were a 3000-engineer company, and got to experience its fast growth from 3k to 90k engineers over a 15-yr period. During that time, our engineering productivity needs had a number of interesting inflection points. A little toil here and there was a minor annoyance when we were 3k engineers but it became a much larger bottleneck when we were 10k, and things that didn’t matter with 10k engineers mattered greatly with 90k engineers. We had to continuously evolve the way we thought about our development practices as the company grew.

Having worked at Google as well exposed me to how some fundamentally different architectural decisions these companies made shaped the way they test and release software in significantly distinct ways. For example, Google chose to maintain a single shared monorepo where more than a hundred thousand engineers work with no branches, whereas Amazon chose an architecture with tens of thousands of independent microrepos. Both systems work at scale but require very different investments in engineering productivity, such as how test environments fit in the picture, and what kind of testing happens before and after submit.

Join me and learn about my journey as I saw Amazon grow by 30x!

Topics

Engineering productivity Continuous Integration Continuous Delivery Developer Infrastructure Software Testing
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Tuesday 19 November

10:35 Seacliff ABC Session Productivity Productivity Lessons in Moving from Big Tech to Scaling a Startup Rachel Potvin SVP Eng @Sanity.io with 25 Years in Tech, Previously @Google and @GitHub, Engineering Leader Focused on Building Productive Happy Teams 11:45 Seacliff ABC Session Engineering productivity Inflection Points in Engineering Productivity as Amazon Grew 30x Carlos Arguelles Senior Principal Engineer @Amazon, 27 Years Experience in Developer Productivity Engineering, Previously @Google and @Microsoft 13:35 Seacliff ABC Session Security or Convenience - Why Not Both? Dorota Parad CEO @Authress, Product and Team Builder, Test Enthusiast 14:45 Ballroom BC Session Research Supporting Engineering Productivity for All Emerson Murphy-Hill Research Scientist at the Intersection of Software Engineering and Human-Computer Interaction, Former Googler and Professor 15:55 Ballroom BC Session Engineering Efficiency Shifting Left for Better Engineering Efficiency Ying Dai Principal Software Engineer @Roblox, Working on Improving Engineering Efficiency. Previously @Google & @LinkedIn 17:05 Ballroom A Session AI/LLMs Slack's AI-Powered, Hybrid Approach for Large-Scale Migration from Enzyme to React Testing Library Sergii Gorbachov Staff Software Engineer @Slack, Specializing in AI-Driven Tools for Automating Code Migrations and Test Authorship