Running Software Factory Efficiently at Uber Scale: Holding Agent Spend Steady While Requests Grew 9X

QCon San Francisco 2026

Session

Running Software Factory Efficiently at Uber Scale: Holding Agent Spend Steady While Requests Grew 9X

Monday Nov 16 / 10:35AM PST (50 minutes), Ballroom A at Hyatt Regency, San Francisco

Register

$2,995, Conference (3 days)
Current pricing ends November 10th

Abstract

At Uber, more than 70% of pull requests are attributed to coding agents. Engineers use more than 5K agent skills, and all MCP traffic goes through one gateway with more than 1,000 servers. Between February and August 2026, weekly active users of agentic tools grew 7x and weekly agent requests grew 9.4x and since May the spend has stabilized.

This talk describes the methods behind that. We split agent spend into six terms: users, sessions per user, turns per session, requests per turn, tokens per request, and price per token. For price per token, we built the Uber SWE Benchmark from 1,075 merged pull requests and use it to choose a model and reasoning effort for each workload. For tokens per request, we cap context and match prompt cache lifetimes to the workload. For requests per turn, we use tool search and code-mode batching, and we ground agents in a context graph.  For turns per session, we show engineers a live cost counter as they work.

Key takeaways

  • Split cost into terms you can measure, and give each term a lever.
  • Choose models per workload from a benchmark built on your own code.
  • Most savings come from agent overhead: fewer turns, fewer requests and fewer input tokens per request.
Register

$2,995, Conference (3 days). Current pricing ends November 10th. All pass options.

76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2026 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Monday 16 November

10:35 Ballroom A Session Running Software Factory Efficiently at Uber Scale: Holding Agent Spend Steady While Requests Grew 9X Uday Kiran Medisetty VP, Distinguished Engineer @Uber 11:45 Ballroom A Session AI How Airbnb Guardrailed Its AI Customer Support Agent Weiping Peng Distinguished Engineer @Airbnb, Previously Principal Architect @Salesforce for AI platform 13:35 Ballroom A Session LLM Flip-Flops: From Reliability Risk to a Hill-Climbing Signal Dianhuan Lin Staff Engineer @Datadog 14:45 Seacliff D Unconference Unconference: Guardrails & Safety Nets 15:55 Ballroom A Session Practical Concerns Running Agents in Production Amanda Walker Sr. Director, Engineering - Privacy, Safety and Security @Google 17:05 Ballroom A Session Testing & Verification for Code-Generating Agents

Current pricing ends November 10th
$2,995, Conference (3 days)

Register