Rethinking Connectivity at the Edge: Scaling Fleets of Low-Powered Devices Using NATS.io

QCon San Francisco 2023

Session Edge

Rethinking Connectivity at the Edge: Scaling Fleets of Low-Powered Devices Using NATS.io

Wednesday Oct 4 / 10:35AM PDT, Seacliff ABC

Abstract

Building distributed systems is hard. Today’s organizations demand their applications be as flexible and resilient as possible. Whether it’s moving to the edge, supporting multi-cloud, multi-geo, or just getting everything to talk to each other properly – communication has been at the heart of these new challenges.

NATS is an open-source project that aims to fundamentally improve the way services communicate with each other. In this talk, you will learn how to leverage NATS to streamline communication and fleet management for devices at the edge, no matter their number, size or computing power.

Interview

I’m currently working at Synadia on the NATS.io messaging system. I get to work on really challenging distributed systems problems at the edge, specifically in the realm of decentralized security, data in motion, and adaptive architectures that span multiple clouds and geos.

I also produce a video series at https://rethink.synadia.com/ where I try and make understanding distributed systems more accessible to a wider range of developers, and challenge the status quo with how these large systems are built.

I think there is a ton of really fun challenges that come with building software at the edge. Cloud architectures are a pretty well-trodden path these days, but much of the thinking behind cloud doesn’t really translate to the edge. Devices are more resource constrained, have more unreliability in terms of connectivity, and require a different way of thinking in order to be successful.

I hope to shed light on some of these challenges and how we can rethink some fundamentals to build the best edge applications.

I try and make my talks accessible to software engineers at any level, but I think the folks who will enjoy it most will be those who are in a more senior or staff+ role, where you start having to solve problems that cut across multiple teams in an organization.

Also, anyone interested in running or building large-scale distributed systems will love this talk!

I always want folks to walk away feeling like their thinking has been challenged, and excited to take some of the ideas that NATS has implemented to their organization, so that they can engage in building more adaptive systems that scales alongside their business needs and team topology.

Topics

Edge AI/ML Messaging Data Streaming Distributed Systems
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Wednesday 4 October

10:35 Seacliff ABC Session Edge Rethinking Connectivity at the Edge: Scaling Fleets of Low-Powered Devices Using NATS.io Jeremy Saenz Senior Software Engineer @Synadia Working on NATS.io, Author of Martini, Negroni, Inject & CLI, Previously CPO @Kajabi 11:45 Seacliff ABC Session AI/ML Building Robust and Scalable Intelligent Writing Assistants: Challenges and Opportunities Leveraging GenAI Vipul Raheja Applied Research Scientist @Grammarly Working on Robust and Scalable Intelligent Writing Assistants 13:35 Seacliff ABC Session Networking Building a Rack-Scale Computer with P4 at the Core: Challenges, Solutions, and Practices in Engineering Systems on Programmable Network Processors Ryan Goodfellow Engineer @Oxide, Working Group Member @P4Lang, Open Source Developer on @illumos 14:45 Seacliff ABC Session Hardware Automating Bare Metal to Improve Your Quality of Life Julia Kreger Senior Principal Software Engineer @Red Hat 15:55 Seacliff ABC Session WebAssembly Fast, Scalable, Secure: WebAssembly and the Future of Isolation Tal Garfinkel Research Scientist @UC San Diego