Powering the Future: Building Your GenAI Infrastructure Stack

The presentation titled Powering the Future: Building Your GenAI Infrastructure Stack by Merrin Kurian highlights the construction of a generative AI infrastructure within Intuit. Here is a structured summary of the key points:

Introduction

Merrin Kurian, a Distinguished Engineer at Intuit, discusses the integration of AI agents in product experiences and the development of Intuit's GenoS (Generative AI Operating System). The presentation aims to elaborate on the components necessary to build, buy or borrow for scaling AI solutions while maintaining governance and cost control.

• Intuit's mission focuses on empowering prosperity globally through an AI-driven expert platform serving approximately 100 million users.
• Intuit's platform achieves scale by generating 60 billion ML predictions daily and managing massive financial operations, including processing $2 trillion in invoices.

AI Agent Development and GenoS Platform

The platform, GenoS, accelerates AI-powered experiences through user experience elements and developer tools. It includes various components like GenUX, developer tooling, and agent starter kits to facilitate a seamless development process.

• Prompt management and evaluation systems are provided for developers to manage their AI projects efficiently.
• The system supports rapid experimentation and assessments to enhance agility and adaptability in AI development.

Challenges and Solutions

Kurian addresses challenges like prompt portability and the subjectivity of LLM applications compared to traditional applications. Emphasizing the need for robust infrastructure and redefined evaluation criteria, she highlights the importance of continuous improvement and adaptation.

Conclusion

The presentation concludes with lessons learned on AI governance, emphasizing collaboration with industry standards, and continuous platform evolution to meet both regulatory and technological demands.

Overall, the talk provides a comprehensive look at scaling AI applications within an enterprise while focusing on infrastructure, collaboration, and governance.

This is the end of the AI-generated content.

Behind every productivity leap is a rock-solid platform. Go under the hood with Intuit’s GenOS team to see how vector stores, prompt management, RAG pipelines, and agent orchestration come together to serve ~100 million users. You’ll leave knowing which components to build, buy, or borrow—and how to scale from pilot to enterprise without sacrificing governance or cost control.