Accelerating LLM-Driven Developer Productivity at Zoox

Summary

Disclaimer: This summary has been generated by AI. It is experimental, and feedback is welcomed. Please reach out to info@qconsf.com with any comments or concerns.

The presentation titled "Accelerating LLM-Driven Developer Productivity at Zoox" by Amit Navindgi focuses on enhancing developer productivity using Large Language Models (LLMs) through Zoox Intelligence (ZI), a company-wide initiative.

Main Points Covered:

  • The Developer Lifecycle: Amit explains the challenges faced by new developers such as information discovery, personal productivity obstacles, and effective software development integration.
  • Building a Secure and Flexible Platform: Zoox created a secure platform that integrates various modalities including text, images, and videos, catering to autonomous vehicle development needs.
  • Applications and Tools: The team developed tools like AutoAssist in Slack channels to reduce support load, foster focus, and ensure quick customer support.
  • Adoption and Evangelism: The importance of evangelizing AI tools, incentivizing usage, and having AI champions across departments to boost adoption was emphasized.
  • Customizable and Secure Platform Usage: Amit elaborates on the integration of safe, custom-built AI tools such as Confluence and Slack tools and the platform's scalable deployment capabilities.
  • Challenges and Solutions: Challenges faced include managing diverse data inputs, ensuring latency management, and sustaining diverse workflow requirements. The solutions involve isolating APIs and providing guided usage.
  • Key Takeaways: Building contributor-friendly platforms, empowering AI champions, sharing successes and failures, and focusing on practical applications over hype are crucial for driving innovation.

The session concludes with a call to resist hype, focus on impact, and leverage hackathons to drive AI tool development across the company.

This is the end of the AI-generated content.


Abstract

Over the past year, Zoox has invested in integrating Large Language Models (LLMs) into the entire developer lifecycle through a companywide initiative called Zoox Intelligence (ZI). This session covers how the team approached this transformation by mapping the real developer journey, building a flexible AI platform, and delivering applications across information discovery, personal productivity, software development, and customer support.

The talk explains how the platform was designed, how models were selected, and how it supports every part of the developer lifecycle. This includes faster information discovery, smoother onboarding, improved personal productivity, better code creation and review, and stronger customer support. It also highlights platform capabilities such as Tools and the Agents as API pattern, which allows teams to run custom agents with simple APIs rather than full deployments. These same foundations also power workflows unique to autonomous vehicle development, such as triaging events from the autonomy fleet and preparing for future customers.

A central focus of the session is the blueprint Zoox used to accelerate AI adoption across the company. This includes platform principles, application strategy, evangelism methods, and organizational patterns that help AI leads drive meaningful impact.

Whether an organization is early in its AI journey or scaling an internal platform, attendees will leave with a practical playbook they can bring back to their teams.


Speaker

Amit Navindgi

Staff Software Engineer, Developer Experience @ Zoox, Leading Applied AI Initiatives

Amit Navindgi is a Staff Software Engineer at Zoox, where he leads Zoox Intelligence — an initiative applying Large Language Models (LLMs) across engineering, operations, customer support, and autonomy. He builds products and platforms that combine technical depth with thoughtful design, creating interactions that are both intuitive to use and elegant to build. His expertise spans Applied AI, Observability, Semantic Search, Experimentation Platforms, Data Engineering, Frontend Development, and Oncall and Incident Management Systems.

He also runs the Zoox AI Hackathon and The Assembly, a cross-functional forum for knowledge sharing and innovation.

Earlier in his career, he developed web applications and distributed systems at Veritas Technologies and focused on Natural Language Processing at the Xerox Research Centre Europe

Read more
Find Amit Navindgi at:

From the same track

Session AI/ML

Powering the Future: Building Your GenAI Infrastructure Stack

Wednesday Nov 19 / 01:35PM PST

Behind every productivity leap is a rock-solid platform. Go under the hood with Intuit’s GenOS team to see how vector stores, prompt management, RAG pipelines, and agent orchestration come together to serve ~100 million users.

Speaker image - Merrin Kurian

Merrin Kurian

Distinguished Engineer @Intuit

Session AI/ML

AI-Driven Productivity: From Idea to Impact

Wednesday Nov 19 / 02:45PM PST

In this session you'll learn how product leaders turn GenAI enthusiasm into an enterprise-ready blueprint for real productivity gains.

Speaker image - Jyothi Nookula

Jyothi Nookula

Product Leader Director with 13+ Years Driving AI Product & Platform Innovation, Previously @Meta, @Amazon, and @Etsy

Session AI/ML

Choosing Your AI Copilot: Maximizing Developer Productivity

Wednesday Nov 19 / 10:35AM PST

The AI coding agent landscape evolves weekly. This talk compares today’s frontrunners, shows where each shines, and shares prompts, policies, and “rules templates” that turn code suggestions into production-quality output.

Speaker image - Sepehr Khosravi

Sepehr Khosravi

Machine Learning Platform Engineer @Coinbase, Award Winning Instructor @UC Berkeley - Gen-AI Bootcamp, Founder @ AI Scouts

Session AI/ML

Trustworthy Productivity: Securing AI-Accelerated Development

Wednesday Nov 19 / 03:55PM PST

Autonomous agents operate in a continuous loop: perceive context → reason → execute tools → observe. Each edge creates distinct attack surfaces. This talk maps vulnerabilities—memory poisoning in context ingestion, goal hijacking during reasoning, blind execution at the action stage.

Speaker image - Sriram  Madapusi Vasudevan

Sriram Madapusi Vasudevan

Senior Software Engineer @AWS Agentic AI, Previously Core Team @AWS SAM, AWS Cloudwatch, Core Developer @Openstack