Abstract
At Uber, more than 70% of pull requests are attributed to coding agents. Engineers use more than 5K agent skills, and all MCP traffic goes through one gateway with more than 1,000 servers. Between February and August 2026, weekly active users of agentic tools grew 7x and weekly agent requests grew 9.4x and since May the spend has stabilized.
This talk describes the methods behind that. We split agent spend into six terms: users, sessions per user, turns per session, requests per turn, tokens per request, and price per token. For price per token, we built the Uber SWE Benchmark from 1,075 merged pull requests and use it to choose a model and reasoning effort for each workload. For tokens per request, we cap context and match prompt cache lifetimes to the workload. For requests per turn, we use tool search and code-mode batching, and we ground agents in a context graph. For turns per session, we show engineers a live cost counter as they work.
Key takeaways
- Split cost into terms you can measure, and give each term a lever.
- Choose models per workload from a benchmark built on your own code.
- Most savings come from agent overhead: fewer turns, fewer requests and fewer input tokens per request.
$2,995, Conference (3 days). Current pricing ends November 10th. All pass options.
QCon San Francisco 2026 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
From the same track
Monday 16 November
10:35 Ballroom A Session Running Software Factory Efficiently at Uber Scale: Holding Agent Spend Steady While Requests Grew 9X Uday Kiran Medisetty VP, Distinguished Engineer @Uber At Uber, more than 70% of pull requests are attributed to coding agents. Engineers use more than 5K agent skills, and all MCP traffic goes through one gateway with more than 1,000 servers. 11:45 Ballroom A Session AI How Airbnb Guardrailed Its AI Customer Support Agent Weiping Peng Distinguished Engineer @Airbnb, Previously Principal Architect @Salesforce for AI platform When Airbnb launched its AI customer support assistant, the feature made the news — the guardrails built to make it safe to ship did not. Yet an AI agent that talks to millions of customers, remembers a conversation across turns, and can trigger account actions is a… 13:35 Ballroom A Session LLM Flip-Flops: From Reliability Risk to a Hill-Climbing Signal Dianhuan Lin Staff Engineer @Datadog Run the same task through the same LLM twice, and you may get two materially different answers. This behavior is often dismissed as the stochastic nature of LLMs, but it creates a serious product risk. 14:45 Seacliff D Unconference Unconference: Guardrails & Safety Nets 15:55 Ballroom A Session Practical Concerns Running Agents in Production Amanda Walker Sr. Director, Engineering - Privacy, Safety and Security @Google Details coming soon. 17:05 Ballroom A Session Testing & Verification for Code-Generating Agents Details coming soon.