Why Most Machine Learning Projects Fail to Reach Production and How to Beat the Odds

QCon San Francisco 2024

Session AI/ML

Why Most Machine Learning Projects Fail to Reach Production and How to Beat the Odds

Monday Nov 18 / 02:45PM PST, Ballroom BC

Abstract

Despite the hype around AI, many ML projects fail, with only 15% of businesses' ML projects succeeding, according to McKinsey. Particularly with the significant investments in large language models and generative AI, only a small portion of companies have managed to realize their true value.

Drawing from her 10 years of experience at the forefront of bringing ML to production at various companies, Wenjie will explore common pitfalls that cause these failures, such as the inherent uncertainty of machine learning, misaligned optimization objectives, and skill gaps among practitioners. She will also highlight critical factors companies must consider when shaping and developing their ML strategies and execution plans. Attendees will gain actionable insights to increase their chances of success in the ever-evolving landscape of machine learning.

Main Takeaways:

  • Walk through common pitfalls in ML projects: misaligned objectives, skill gaps, and inherent uncertainty.
  • Share experiences for performance monitoring, continuous skill development, and effective team collaboration.
  • Understanding the important factors to help develop AI or GenAI strategies can help harness the true value of machine learning and achieve tangible business outcomes.

Topics

AI/ML MLOps Product Management LLMs
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Monday 18 November

10:35 Ballroom BC Session Knowledge Graphs Enhance LLMs’ Explainability and Trustworthiness With Knowledge Graphs Leann Chen AI Developer Advocate @Diffbot, Creator of AI and Knowledge Graph Content on YouTube, Passionate About Knowledge Graphs & Generative AI 11:45 Ballroom BC Session Scale Out Batch Inference with Ray Cody Yu Staff Software Engineer and Tech Lead @Anyscale, Ex-Amazonian, vLLM Committer, Apache TVM PMC 13:35 Ballroom BC Session AI/ML Recommender and Search Ranking Systems in Large Scale Real World Applications Moumita Bhattacharya Senior Research Scientist @Netflix, Previously @Etsy, Specialized in Machine Learning, Deep Learning, Big Data, Scala, Tensorflow, and Python 14:45 Ballroom BC Session AI/ML Why Most Machine Learning Projects Fail to Reach Production and How to Beat the Odds Wenjie Zi Senior Machine Learning Engineer and Tech Lead @Grammarly, Specializing in Natural Language Processing, 10+ Years of Industrial Experience in Artificial Intelligence Applications 15:55 Seacliff D Unconference Unconference: AI and ML for Software Engineers 17:05 Ballroom BC Session AI/ML Reinforcement Learning for User Retention in Large-Scale Recommendation Systems Saurabh Gupta, Gaurav Chakravorty