Presentation: Stream Processing & Analytics with Flink @Uber

Duration

Duration: 
1:40pm - 2:30pm

Level:

Persona:

Abstract

In the core of Uber's architecture is a marketplace platform, which is responsible for fulfilling requests for rides, eats, deliveries, and etc. To make our marketplace system efficient and intelligent, we need to extract timely and deep insights from our carefully curated data, and make them available for both people and machines to consume in real time.

This talk will discuss how Uber builds its next generation of stream processing system to support real time analytics as well as complex event processing. In particular, this talk will focus on Uber's stream processing systems that supports many types of real-time analysis and forecasting of geospatial time series, as well as discovery and extracting interesting patterns from data streams. The talk will also discuss how we evolved our streaming system's underlying platform from Apache Samza and Spark Streaming to Apache Flink.

Speaker: Danny Yuan

Real-time Streaming Lead @Uber

Danny Yuan is a software engineer in Uber. He’s currently working on streaming systems for Uber’s marketplace platform. Prior to joining Uber, he worked on building Netflix’s cloud platform. His work includes predictive autoscaling, distributed tracing service, real-time data pipeline that scaled to process hundreds of billions of events every day, and Netflix’s low-latency crypto services.

Find Danny Yuan at

Similar Talks

Sr. Staff Engineer @Uber, Co-founder @Voxer

.

Tracks

Monday Nov 7

Tuesday Nov 8

Wednesday Nov 9

Conference for Professional Software Developers