Stream Processing
Streaming Databases: Embracing the Convergence of Stream Processing and Databases
Monday Oct 2 / 01:35PM PDT
Streaming databases have gained significant attention in recent years. From its name, it is evident that a streaming database combines the power of stream processing and databases.
Yingjun Wu
Founder and CEO @RisingWave Labs, Previously Engineer @AWS Redshift & Researcher @IBM Research Almaden
Incremental Data Processing with Apache Hudi
Monday Oct 2 / 03:55PM PDT
Incremental Data Processing is an emerging style of data processing gathering attention recently that has the potential to deliver orders of magnitude speed and efficiency over traditional batch processing on data lakes and data warehouses.
Saketh Chintapalli
Software Engineer @Uber, Bringing Incremental Data Processing to Data Warehouse Models
Bhavani Sudha Saktheeswaran
Distributed Systems Engineer @Onehouse, Apache Hudi PMC, Ex-Moveworks, Ex-Uber, Ex-Linkedin
Chronon - Airbnb’s End-to-End Feature Platform
Tuesday Oct 3 / 10:35AM PDT
ML Models typically use upwards of 100 features to generate a single prediction. As a result, there is an explosion in the number of data pipelines and high request fanout during prediction.
Nikhil Simha
Author of "Chronon Feature Platform", Previously Built Stream Processing Infra @Meta and NLP Systems @Amazon & @Walmartlabs