Why Most Machine Learning Projects Fail to Reach Production and How to Beat the Odds

Despite the hype around AI, many ML projects fail, with only 15% of businesses' ML projects succeeding, according to McKinsey. Particularly with the significant investments in large language models and generative AI, only a small portion of companies have managed to realize their true value.

Drawing from her 10 years of experience at the forefront of bringing ML to production at various companies, Wenjie will explore common pitfalls that cause these failures, such as the inherent uncertainty of machine learning, misaligned optimization objectives, and skill gaps among practitioners. She will also highlight critical factors companies must consider when shaping and developing their ML strategies and execution plans. Attendees will gain actionable insights to increase their chances of success in the ever-evolving landscape of machine learning.

Main Takeaways:

  • Walk through common pitfalls in ML projects: misaligned objectives, skill gaps, and inherent uncertainty.
  • Share experiences for performance monitoring, continuous skill development, and effective team collaboration.
  • Understanding the important factors to help develop AI or GenAI strategies can help harness the true value of machine learning and achieve tangible business outcomes.

Speaker

Wenjie Zi

Senior Machine Learning Engineer and Tech Lead @Grammarly, Specializing in Natural Language Processing, 10+ Years of Industrial Experience in Artificial Intelligence Applications

Wenjie Zi holds a Master’s degree in Computer Science from the University of Toronto, specializing in Natural Language Processing (NLP). Currently, she serves as a Senior Applied AI Engineer and Technical Lead at Grammarly, bringing over ten years of industrial experience in artificial intelligence applications. Wenjie has successfully implemented and deployed various projects, including Retrieval Augmented Generation (RAG), recommendation systems, semantic parsing (natural language to SQL), and quantitative trading.

Her research has been published in leading conferences and workshops such as ACL, NeurIPS, and KDD. Additionally, Wenjie is a course instructor for the certificate program at the University of Toronto, where she teaches deep learning-related subjects.

In her spare time, Wenjie actively participates in the Canadian AI community, serving as a committee member of MLOps World and as the lead of the Women in AI Canada Sponsorship team. She co-founded the Toronto AI Practitioners Network (TAPNET) in early 2024 and has organized multiple meetups with over 100 participants, aiming to connect technology practitioners across North America.

Read more
Find Wenjie Zi at:

From the same track

Session

No More Spray and Pray— Let's Talk About LLM Evaluations

Monday Nov 18 / 11:45AM PST

The pace of development in AI in the past year or so has been dizzying, to say the least, with new models and techniques emerging weekly. Yet, amidst the hype, a sobering reality emerges: much of these advancements lack robust empirical evidence.

Speaker image - Apoorva Joshi

Apoorva Joshi

Senior AI Developer Advocate @MongoDB, 6 Years of Experience as a Data Scientist in Cybersecurity, Active Member of Girls Who Code, Women in Cybersecurity (WiCyS) and AnitaB.org

Session

Recommender and Search Ranking Systems in Large Scale Real World Applications

Monday Nov 18 / 01:35PM PST

Recommendation and search systems are two of the key applications of machine learning models in industry. Current state of the art approaches have evolved from tree based ensembles models to large deep learning models within the last few years.

Speaker image - Moumita Bhattacharya

Moumita Bhattacharya

Senior Research Scientist @Netflix, Previously @Etsy, Specialized in Machine Learning, Deep Learning, Big Data, Scala, Tensorflow, and Python

Session

Verifiable and Navigable LLMs with Knowledge Graphs

Monday Nov 18 / 10:35AM PST

Graphs, especially knowledge graphs, are powerful tools for structuring data into interconnected networks. The structured format of knowledge graphs enhances the performance of LLM-based systems by improving information retrieval and ensuring the use of reliable sources.

Speaker image - Leann Chen

Leann Chen

AI Developer Advocate @Diffbot, Creator of AI and Knowledge Graph Content on YouTube, Passionate About Knowledge Graphs & Generative AI

Session

Reinforcement Learning for User Retention in Large-Scale Recommendation Systems

Monday Nov 18 / 05:05PM PST

This talk explores the application of reinforcement learning (RL) in large-scale recommendation systems to optimize user retention at scale - the true north star of effective recommendation engines.

Speaker image - Saurabh Gupta

Saurabh Gupta

Senior Engineering Leader @Meta, Veteran in the Video Recommendations Domain, Helping Scale Video Consumption

Speaker image - Gaurav Chakravorty

Gaurav Chakravorty

Uber TL @Meta, Previously Worked on Facebook Video Recommendations and Instagram Friending and Growth

Session

Unconference: AI and ML for Software Engineers

Monday Nov 18 / 03:55PM PST