Designing Fast, Delightful UX with LLMs in Mobile Frontends

Abstract

Delivering AI-powered features in mobile apps is not just about calling an LLM API. It's about crafting fast, reliable, and engaging user experiences. In this talk, I’ll share practical lessons from designing and scaling LLM-driven experiences in mobile apps, where thoughtful frontend architecture and UX design made the difference between a demo and a product.

We’ll explore how to architect for speed and interactivity, when to use on-device LLMs versus backend inference, and how to design interfaces that gracefully handle latency, ambiguity, and errors from generative AI. Along the way, we’ll compare patterns used in apps like Perplexity, ChatGPT, and examine the trade-offs that shape responsive, cost-effective, and scalable frontend systems.

Whether you're experimenting with LLMs in your product or already in production, you’ll leave with concrete patterns to make your AI-powered experiences feel fast, native, and user-first.


Speaker

Balakrishnan (Bala) Ramdoss

Senior Android Engineer @Amazon - Building Camera-Based AI Features, Specializes in Scalable Solutions for Complex Challenges

Bala Ramdoss is a Senior Android Engineer at Amazon, where he builds camera-based AI features like Amazon Lens to enhance the visual shopping experience. With over 10 years of Android development experience, Bala specializes in scalable solutions for complex challenges, including AR-powered experiences and high-performance Android UI. When not building apps, he enjoys exploring new tech and engaging conversations over coffee.

Read more

From the same track

Session

Why Fetch When You Can Sync? Building Local-First Apps on a Sync Engine Architecture

Tuesday Nov 18 / 10:35AM PST

Front-end has long been about reactivity frameworks and client-side state management. However, the alpha in these is receding.

Speaker image - James Arthur

James Arthur

Co-founder and CEO @ElectricSQL, Previously Co-Founder and CTO @Hazy and @Opendesk

Session

Unconference: Innovations in Front-End

Tuesday Nov 18 / 01:35PM PST

Session

Scaling Design Systems: Internal Tooling & Craft

Tuesday Nov 18 / 05:05PM PST

Details coming soon.

Session

From VR to Flat Screens: Bridging the Input and Immersion Gap

Tuesday Nov 18 / 03:55PM PST

Expanding the market of your VR game to other platforms may seem like an easy way to increase your revenues but the journey is all but simple. When what makes your game unique is the presence and immersion it provides, reproducing the experience on a flat screen is a daunting task.

Speaker image - Dany Lepage

Dany Lepage

VP of Technology @Lucky VR - Building Virtual Vegas

Session

Rethinking User Interactions in JavaScript

Tuesday Nov 18 / 02:45PM PST

Details coming soon.