When Your Users Are Agents: Lessons from Running Serverless Postgres

Abstract

Most systems are designed with human users in mind: predictable session lengths, expected traffic spikes, and query patterns shaped by application code. But what happens to your core infrastructure when some of your most active users are autonomous AI agents?

Agents don’t get bored or discouraged. They fan out, retry, and generate non-deterministic, dynamically constructed queries from partial context. The result is traffic that is bursty, expensive, difficult to predict, and sometimes just plain weird.

In this talk, we’ll explore the infrastructural shifts required when your users are no longer just humans, but AI agents. Drawing on hard-won lessons from running a Serverless Postgres platform at scale, we will look at how agentic workloads break traditional assumptions about connection pooling, query execution, resource management, rate limiting, and observability. You will leave with a practical framework for hardening your infrastructure to support autonomous AI workflows without compromising reliability, and some good war stories that will help you remember all this advice.

Key Takeaways:

  • Recognizing Agentic Traffic Patterns: Understand how autonomous AI workflows change connection lifecycles, concurrency, retry behavior, and query patterns compared to traditional application traffic.
  • Building Guardrails for Critical Infrastructure: Learn how to protect Postgres under unpredictable workloads using controls like timeouts, scoped permissions, rate limiting, and error handling. We’ll discuss when to use each technique and how each one can backfire when applied too bluntly.
  • Monitoring and Debugging Agent Workloads: Learn how to use database-side signals to catch agent-driven problems before they become expensive incidents. For example, an agent retrying the same failed SQL thousands of times.

Speaker

Gwen Shapira

Co-Founder and CPO @Nile, Previously Engineering Leader @Confluent, PMC Member @Kafka, & Committer Apache Sqoop

Gwen is a co-founder and CPO of Nile (thenile.dev). She has 20+ years of experience working with code and customers to build reliable and scalable data architectures - most recently as the head of Cloud Native Kafka engineering org at Confluent. Gwen is a committer to Apache Kafka, author of “Kafka - the Definitive Guide” and "Hadoop Application Architectures". You can find her speaking at tech conferences or talking data at the SaaS Developer Community.

Read more
Find Gwen Shapira at:

From the same track

Session

Adaptive Systems in Production: What Recommendation Systems Can Teach Us About Agents

As organizations race to build AI agents, many teams are encountering challenges that feel new: evaluation uncertainty, feedback loops, behavioral drift, exploration versus exploitation, and maintaining user trust in systems that continuously adapt.But these challenges are not new.

Speaker image - Mallika Rao

Mallika Rao

Senior Engineering Manager @Zocdoc, Previously @Netflix, @Twitter and @Walmart

Session

How to Build Online Systems with Object Storage

“Diskless” systems that delegate durability to object storage are everywhere, and for three good reasons:

Speaker image - Almog Gavra

Almog Gavra

Co-Founder @Responsive.dev - Building Object-Native Databases, Previously @Confluent and @LinkedIn

Session

Orderly Keys, Wild Values: Adaptive Compression for Distributed Key-Value Storage

At Netflix scale - billions of requests per day and petabytes of key-value data - even small inefficiencies in storage and network paths become expensive.

Speaker image - Joseph Lynch

Joseph Lynch

Principal Software Engineer @Netflix Building Highly-Reliable and High-Leverage Infrastructure Across Stateless and Stateful Services

Speaker image - Ayushi Singh

Ayushi Singh

Senior Software Engineer @Netflix Specializing in Large-Scale Distributed Data Systems