Conference: Nov 13-15, 2017
Workshops: Nov 16-17, 2017
Track: Twitter Tech Day (Sponsored)
Location:
- Marina
Day of week:
- Monday
A special treat for QCon. A technical track with six presentations that dives into the full Twitter stack. Questions on how Twitter provisions hardware, leverages Manhattan (Twitter's distributed key-value store), deploys the JVM, handles Tweet fanout, and Microservices/reliability directly from the SE's building the stack.
by Nik Johnson
Provisioning Engineering SE @Twitter
by Matt Singer
Staff Hardware Engineer @Twitter
Twitter operates hundreds of thousands of servers. At that scale, repairs and reallocations are frequent and each requires a re-installation of the system. The Provisioning Engineering system at Twitter, called Wilson, is designed to handle every part of a server's lifecycle that does not require a person with a screwdriver. From bios updates to RAID controller configuration and OS installation, the Wilson stack does it all. Combined with our machine metadata service Audubon, Provisioning...
by Boaz Avital
Tech Lead of Manhattan Team @Twitter
Distributed databases are complex systems with multiple dependencies that must be maintained in order to conserve correctness. Manhattan, Twitter's primary distributed key-valve store, has many differing capabilities that require careful and subtly different orchestration while operating on the cluster in order to deploy new versions or add and remove nodes. This talk will touch on the evolution of Manhattan's automated cluster management service, cover some of...
by John Coomes
Staff Engineer, JVM Team @Twitter
by Ian Downes
Technical Manager Aurora / Mesos Team @Twitter
Twitter services have to be able to handle the flood of requests, responses and actions required to process hundreds of millions of tweets every day. This talk will cover how we schedule and manage services in our data centers to ensure reliablity and performance, as well as the challenges (and some solutions!) encountered in getting the JVM and JDK to run our scala- and java-based services to meet stringent response-time and resource requirements.
by Megan Kanne
Observability Software Engineer @Twitter
Twitter’s Observability team provides Twitter developers a monitoring infrastructure including real time dashboards and alerting for their services. Twitter has grown orders of magnitude since it debuted at SXSW. The monitoring infrastructure has followed suit, ingesting orders of magnitude more metrics, from millions to billions.
As the company grew, so did the challenges of providing an always available alerting system....
by Moses Nakamura
Core Systems Libraries Software Engineer @Twitter
We choose microservice architectures for many different reasons, including, often, improving reliability. However, there is a dark side. Modular systems have many benefits, but as you add more components, each of which can fail, it makes the overall system more fragile, because there are new ways in which it can fail that previously didn't exist. From its inception, Finagle was designed as a toolkit for reliable systems. We'll discuss understanding the...
by Mike Cvet
Tech Lead for Timelines Infrastructure Team / Sr Staff Software Engineer @Twitter
Twitter's massive write-time and nearly-instantaneous Tweet fanout system is well-known. This talk will discuss the architecture and challenges involved in the shift towards read-time determination and collection of Tweets for users, incorporating disparate content relevance and recommendation systems. With additional layers of software business logic composed into the core Twitter experience, this has necessitated the adoption of new contracts between teams and...
.
Tracks
Monday Nov 7
-
Architectures You've Always Wondered About
You know the names. Now learn lessons from their architectures
-
Distributed Systems War Stories
“A distributed system is one in which the failure of a computer you didn't even know existed can render your own computer unusable.” - Lamport.
-
Containers Everywhere
State of the art in Container deployment, management, scheduling
-
Art of Relevancy and Recommendations
Lessons on the adoption of practical, real-world machine learning practices. AI & Deep learning explored.
-
Next Generation Web Standards, Frameworks, and Techniques
JavaScript, HTML5, WASM, and more... innovations targetting the browser
-
Optimize You
Keeping life in balance is a challenge. Learn lifehacks, tips, & techniques for success.
Tuesday Nov 8
-
Next Generation Microservices
What will microservices look like in 3 years? What if we could start over?
-
Java: Are You Ready for This?
Real world lessons & prepping for JDK9. Reactive code in Java today, Performance/Optimization, Where Unsafe is heading, & JVM compile interface.
-
Big Data Meets the Cloud
Overviews and lessons learned from companies that have implemented their Big Data use-cases in the Cloud
-
Evolving DevOps
Lessons/stories on optimizing the deployment pipeline
-
Software Engineering Softskills
Great engineers do more than code. Learn their secrets and level up.
-
Modern CS in the Real World
Applied, practical, & real-world dive into industry adoption of modern CS ideas
Wednesday Nov 9
-
Architecting for Failure
Your system will fail. Take control before it takes you with it.
-
Stream Processing
Stream Processing, Near-Real Time Processing
-
Bare Metal Performance
Native languages, kernel bypass, tooling - make the most of your hardware
-
Culture as a Differentiator
The why and how for building successful engineering cultures
-
//TODO: Security <-- fix this
Building security from the start. Stories, lessons, and innovations advancing the field of software security.
-
UX Reimagined
Bots, virtual reality, voice, and new thought processes around design. The track explores the current art of the possible in UX and lessons from early adoption.