Data Accuracy
Session
Data Pipelines
Efficient Incremental Processing with Netflix Maestro and Apache Iceberg
Tuesday Nov 19 / 03:55PM PST
Incremental processing, an approach that processes only new or updated data in workflows, substantially reduces compute resource costs and execution time, leading to fewer potential failures and less need for manual intervention.
Jun He
Staff Software Engineer @Netflix, Managing and Automating Large-Scale Data/ML Workflows, Previously @Airbnb and @Hulu