Track: Architectures You've Always Wondered about

Location:

Day of week:

"The architecture will work itself out" said no one ever. Come see the newest and biggest internet architectures in the world and how they work. Find out what went well during development, what the architects learned, and what exploded when traffic was expected to double, and it was 3am, and the databases were not responding. Stay for questions, share war stories, and drink brandy (scratch that last one...).

Track Host:
Marty Weiner
Engineer, Pinterest
Marty joined Pinterest in early 2011 as the 2nd engineer. Previously worked at Azul Systems as a VM engineer focused on building/improving the JIT compilers in HotSpot. @marty_pinterest
10:35am - 11:25am

by Jeremy Edberg
Ran Reddit, Netflix Reliability Architect

by Philip Fisher-Ogden
Director of Engineering at Netflix

In this talk, you'll hear about the lessons learned from all the biggest sites on the internet about how to build scalable and resilient architectures. We'll show you the design patterns the most successful companies use and how to go from nothing to billions.

11:50am - 12:40pm

by Richard Kasperowski
QCon Open Space Facilitator

Open Space

Join Marty Weiner, our speakers, and other attendees as we explore the newest and biggest Internet architectures in the world and how they work. Find out what goeswell during development, what architects learn, and what explodes when traffic was expected to double, and it was 3am, and the databases don’t respond. Stay for questions and share war stories!

What is Open Space?

Every day at QConSF, we’ll open space five...

1:40pm - 2:30pm

by Sid Anand
Chief Architect at ClipMine

With over 300 Million members worldwide, LinkedIn is an indispensable means to connect professionals the world over. By mining data from its ever-growing professional network, LinkedIn recommends jobs, connections, skills, and ads to its members. Using this same information, LinkedIn has proven itself a reliable hiring tool for companies in search of skilled talent. 

Through a series of acquisitions over the past 3 years, LinkedIn has grown its repository of user-generated...

2:55pm - 3:45pm

by John Bunting
API Lead at Tumblr

Tumblr lets you effortlessly share anything. From photos to videos, the Tumblr dashboard has been the place for you to experience new and exciting content from the Internet. We'll be talking about different services we have built and how our architecture helps us be fault tolerant as we continue to grow. We'll discuss how we've scaled our engineering teams to deal with this growth across several verticals. We'll be going in-depth on how Tumblr uses several key pieces of technology, such as...

4:10pm - 5:00pm

by Xun Liu
Software Engineer at Pinterest

by Raghavendra Prabhu
‎Engineering Manager at Pinterest

Zen is a storage service built at Pinterest that offers a graph data model on top of HBase and potentially other storage backends. Zen was originally conceived and built in summer 2013 and since then, has grown to be one of the our most widely used storage solutions, powering the home feed, interest graph, notifications, conversation and a number of other key features.

 In this talk, we'll go over the design motivation for Zen and describe its internals including the API, type...

5:25pm - 6:15pm

by Aaron Gardner
Engineering Director at Etsy

In this talk talk I pull back the covers on the Etsy Search ecosystem and how we got here -- the good, the bad, and the funky.

The heart of our system is patched Solr/Lucene & ElasticSearch (and a lot of Bash) running on our boxes. I’ll dig into: signal collection from our web stack and mobile apps into Hadoop, generating machine learning ranking signals with Scalding, indexing content from 900 MySQL shards, sharding our Solr index in a novel way for performance, building a native...

Tracks

Covering innovative topics

Monday, 3 November

Tuesday, 4 November

Wednesday, 5 November