Automating the Web With MCP: Infra That Doesn’t Break

QCon San Francisco 2025

Session AI/ML

Automating the Web With MCP: Infra That Doesn’t Break

Tuesday Nov 18 / 05:05PM PST, Ballroom BC at Hyatt Regency, San Francisco

Abstract

AI agents are only as strong as the infrastructure beneath them. In this talk, we’ll walk through the architecture behind Browserbase’s model context protocol (MCP), built to support stateful browser automation at scale. From concurrency models to session isolation, this talk dives into what it actually takes to run parallel agents in production, and what we learned the hard way. Expect live demos, real-world lessons, and infra blueprints you can steal.

Main Takeaways:

  • Infra-first thinking is crucial for agent-based web automation.
  • MCPs are not just tools, they’re runtime environments with real constraints.
  • Attendees will leave with:
    • Concrete patterns for scaling headless browser fleets.
    • Security tips for managing cookies and sessions safely.
    • Infra cost models and deployment blueprints.
    • Hard-won lessons from production-scale orchestration.

Interview

We’re building a stateful, concurrency-safe browser infrastructure for AI agents. Our focus is making multi-agent orchestration reliable, secure, and scalable—without abstracting away the parts developers actually need to control, like context and memory.

Everyone’s excited about agents but very few talks get into the gritty, technical realities of running browser-based agents at scale. We wanted to share the behind-the-scenes of how infrastructure decisions shape performance, reliability, and developer experience. If you’re building agents that touch the web, this is the stuff no one’s documenting yet—but should be.

Chief Innovation Officers, Engineering Leads, AI Engineers, Technical Leads, etc.

Topics

AI/ML MCP Browser Automation
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2025 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Tuesday 18 November

10:35 Ballroom BC Session AI Agents Engineering at AI Speed: Lessons from the First Agentically Accelerated Software Project Adam Wolff Engineer and Individual Contributor to Claude Code @Anthropic, Previously @Robinhood, @Facebook 11:45 Ballroom BC Session Engineering AI for Creativity and Curiosity on Mobile Bhavuk Jain Tech Lead @Google 13:35 Ballroom BC Session AI/ML Improving Meta Generative Ad Text using Reinforcement Learning Alex Nikulkov Research Scientist (RL lead for Monetization GenAI) @Meta 14:45 Seacliff ABC Session AI Agents From Content to Agents: Scaling LLM Post-Training Through Real-World Applications and Simulation Faye Zhang, Andi Partovi 15:55 Ballroom BC Session Dynamic Moments: Weaving LLMs into Deep Personalization at DoorDash Sudeep Das, Pradeep Muthukrishnan 17:05 Ballroom BC Session AI/ML Automating the Web With MCP: Infra That Doesn’t Break Paul Klein Founder @Browserbase, previously Director of Self-Service & Engineering Manager @Mux, Co-Founder & CTO @Stream Club, Technical Lead @Twilio Inc.