Workshops: Nov 19-20, 2015
Track: Streaming Data @ Scale
Location:
- Ballroom A
Day of week:
- Wednesday
Stream processing at scale has become essential for many practical applications: demand and supply forecasting in a market place, fraud detection, ad-hoc experiments, and real-time recommendations, just to name a few. Building and operating a stream system that handles high volume of data also demands many areas of expertise, such as distributed systems, applied statistics, and system optimization. This track will explore interesting stories of applying stream systems to solve real-world problems with focuses on effective techniques and promising new trends.
by Danny Yuan
Real-time Streaming Lead @Uber
The realtime system is the heart and soul of Uber's logistic platform. It is responsible for fulfilling requests from riders while striving to maximize driver utilization and minimize rider cost. To make our realtime system efficient and intelligent, we need to extract deep and timely insights from our carefully curated data. We also have to make the insights easily accessible for both people and machines to consume in real time. This talk will discuss how stream processing is used in Uber's...
by Gian Merlino
Cofounder @Imply
Stream processors are used for many things, including computations, creating derived streams, and taking actions based on streaming data. But one other common use case is keeping databases up to date. This presents a number of challenges, including how to load balance, how to avoid duplicating data and dropping data, and how to handle backfills. We'll talk about some of the possible approaches, their pros and cons, and look at how they are used in real world systems like Kafka, Storm, Samza...
by Helena Edelson
VP of Product Engineering @Tuplejump
This talk will address new architectures emerging for large scale streaming analytics. Some based on Spark, Mesos, Akka, Cassandra and Kafka (SMACK) and other newer streaming analytics platforms and frameworks using Apache Flink or GearPump. Popular architecture like Lambda separate layers of computation and delivery and require many technologies which have overlapping functionality. Some of this results in duplicated code, untyped processes, or high operational overhead, let alone the cost...
by Jerry Chen
Lead developer of Facebook's Stylus
At Facebook, we have diversified needs for a high performance, versatile, scalable and fault-tolerant stream processing system. We built a low level Stream Processing system called Stylus to enable developers quickly build stream processing applications for these needs. Stylus is currently being used by many teams at Facebook at scale. One of such use cases is currently processing 100's of billions of events per day. In this talk, I will talk about the architecture of Stylus, and how we...
by Karthik Ramasamy
Engineering Manager and Technical Lead for Real Time Analytics @Twitter
Storm has long served as the main platform for real-time analytics at Twitter. However, as the scale of data being processed in real- time at Twitter has increased, along with an increase in the diversity and the number of use cases, many limitations of Storm have become apparent. We need a system that scales better, has better debug-ability, has better performance, and is easier to manage – all while working in a shared cluster infrastructure. We considered various alternatives to meet...
Tracks
Covering innovative topics
Monday Nov 16
-
Architectures You've Always Wondered About
Silicon Valley to Beijing: Exploring some of the world's most intrigiuing architectures
-
Applied Machine Learning
How to start using machine learning and data science in your environment today. Latest and greatest best practices.
-
Browser as a platform (Realizing HTML5)
Exciting new standards like Service Workers, Push Notifications, and WebRTC are making the browser a formidable platform.
-
Modern Languages in Practice
The rise of 21st century languages: Go, Rust, Swift
-
Org Hacking
Our most innovative companies reimagining the org structure
-
Design Thinking
Level up your approach to problem solving and leave everything better than you found it.
Tuesday Nov 17
-
Containers in Practice
Build resilient, reactive systems one service at a time.
-
Architecting for Failure
Your system will fail. Take control before it takes you with it.
-
Modern CS in the Real World
Real-world Industry adoption of modern CS ideas
-
The Amazing Potential of .NET Open Source
From language design in the open to Rx.NET, there is amazing potential in an Open Source .NET
-
Optimizing You
Keeping life in balance is always a challenge. Learning lifehacks
-
Unlearning Performance Myths
Lessons on the reality of performance, scale, and security
Wednesday Nov 18
-
Streaming Data @ Scale
Real-time insights at Cloud Scale & the technologies that make them happen!
-
Taking Java to the Next Level
Modern, lean Java. Focuses on topics that push Java beyond how you currently think about it.
-
The Dark Side of Security
Lessons from your enemies
-
Taming Distributed Architecture
Reactive architectures, CAP, CRDTs, consensus systems in practice
-
JavaScript Everywhere!
Javascript is Everywhere. Learn why
-
Culture Reimagined
Lessons on building highly effective organizations
