Track: Architectures You've Always Wondered About

Location: Ballroom A

Day of week: Monday

How do they do it? In QCon's marquee Architectures track, we learn what it takes to operate at large scale from well-known names in our industry. You will take away hard-earned architectural lessons on scalability, reliability, throughput, and performance.

Track Host: Randy Shoup

VP Engineering @WeWork, Previously @StitchFix @Google & @Ebay

Randy is a 30-year veteran of Silicon Valley, and has worked as a senior technology leader and executive at companies ranging from small startups, to mid-sized places, to eBay and Google. Randy is currently VP Engineering at WeWork in San Francisco. He is particularly passionate about the nexus of culture, technology, and organization.

10:35am - 11:25am

Scaling Patterns for Netflix's Edge

In 2008 Netflix had less than a million streaming members. Today we have over 150 million. That explosive growth in membership has led to a similar growth in the number of microservices, in the amount of cloud resources, and our overall architectural complexity. Eventually, that sheer number of computation resources becomes hard to manage and sacrifices our reliability. At Netflix, we’ve found a few techniques that have helped keep our computation growth manageable and reliable.

There are the obvious tasks of performance tuning, reducing features, or reducing data. Going beyond just “tightening the belt” tactics, we had to rethink how we handle every request. At our scale, we can no longer call a customer database on every request, we can no longer fan out to a cascade of mid-tier requests on every request, and we can no longer log every request, so we don’t. This session will introduce the architectural patterns we’ve adopted to accomplish skipping those steps, which would normally be considered required for a functioning system.

I will also be sharing successes we’ve had from unintuitively partitioning computation into multiple services to get better runtime characteristics. Through this session, you will be introduced to useful probabilistic data structures, innovative bi-directional data passing, and open-source projects available from Netflix that make this all possible.

Justin Ryan, Playback Edge Engineering @Netflix

11:50am - 12:40pm

Architectures

Session details to follow.

1:40pm - 2:30pm

Mind Your State for Your State of Mind

Applications have had an interesting evolution as they have moved into the distributed and scalable world. Similarly, storage and its cousin databases have changed side by side with applications. Many times, the semantics, performance, and failure models of storage and applications do a subtle dance as they change in support of changing business requirements and environmental challenges.  

Different types of distributed stores offer various average speeds, variation in responsiveness, capacity, availability, and durability. This talk provides a partial taxonomy of diverse storage solutions available over a distributed cluster. Part of this is an exploration of the interactions among different features of a store. The talk then considers how distinct application patterns have grown over time to leverage these stores and the business requirements they meet. It concludes with a set of actionable takeaways.

Pat Helland, Software Architect @Salesforce

2:55pm - 3:45pm

Architectures

Session details to follow.

Robert Zuber, CTO @CircleCI

4:10pm - 5:00pm

Architectures

Session details to follow.

5:25pm - 6:15pm

Architectures Open Space

Session details to follow.

Tracks

Monday, 11 November

Tuesday, 12 November

Wednesday, 13 November