Presentation: Crisis to Calm: Story of Data Validation @ Netflix

Track: Microservices / Serverless Patterns & Practices

Location: Ballroom A

Duration: 4:10pm - 5:00pm

Day of week: Monday

Level: Intermediate

Persona: Architect, Backend Developer

Share this on:

Abstract

The best outage is the one that never happens! Runtime system behavior is increasingly driven by data flowing from various data sources. Each update is as impactful as code pushes, if not more, increasing the risk of outages. This makes a strong case for automated detection of bad data, similar to what we already do for code pushes. To that end, we invested in detecting and preventing bad data in real time with techniques like circuit breakers and data canaries.
In this presentation, I will talk about the journey from having no data validations to our current set of techniques that are an essential part of availability at Netflix. I will share my experience in maintaining a great Netflix customer experience while enabling fast and safe data propagation.
Key takeaways:

  • Detecting and preventing bad data is essential to high availability.
  • Ways to make circuit breakers, data canaries and staggered rollout effective.
  • Efficient validations via sharding data and isolating change.

Speaker: Lavanya Kanchanapalli

Senior Software Engineer @Netflix

Lavanya Kanchanapalli is a senior software engineer in Netflix’s Platform Engineering team designing and building core data infrastructure. She has worked on Netflix’s catalog infrastructure which aggregates and propagates metadata of all the movies and shows on the service. Her latest project is building of a scalable and cost-effective unified logging infrastructure for all the systems at Netflix. 

Find Lavanya Kanchanapalli at

Similar Talks

Director of Developer Evangelism @fauna
VP Engineering @WeWork, Previously @StitchFix @Google & @Ebay
Senior Construction Technology Disrupter @WeWork
CEO and cofounder of Dusty Robotics
Robotics Systems Developer at AddRobots
Sr. Staff Software Engineer @Tesla
Security Researcher, Leader, Advisor @Netflix

Tracks

Monday, 5 November

Tuesday, 6 November

Wednesday, 7 November

The all-new QCon app!

Available on iOS and Android

The new QCon app helps you make the most of your conference experience. Easily browse and follow the conference schedule, star the talks you want to attend, and keep tabs on your personal itinerary. Download the app now for free on iOS and Android.