Presentation: Control Theory In Container Orchestration
Share this on:
What You’ll Learn
- Find out some of the basic principles of observing systems, controller design, and PID controllers.
- Learn how to apply engineering control theory to container management.
- Listen about scaling controllers, using both first principles and proven designs from Kubernetes and Mesos.
Abstract
Containers offer 2 central promises: software as encapsulated and reproducible units. A key corollary of those promises is the ability to schedule and manage containers automatically. This session aims to give attendees a solid understanding of leveraging or building container orchestration using feedback signals.
We’ll apply engineering control theory to key container management scenarios. This will cover basic principles of observing systems, controller design, and PID controllers. In particular, we’ll dive into container scaling controllers, using both first principles and proven designs from Kubernetes and Mesos.
Are you talking of automation systems control theory?
It's about applying control theory as an existing engineering rather than accidentally reinventing control theory when you're building automation. I'm going to introduce the fundamentals of control theory, the terminology, and I'll step through some increasingly complex cases in orchestration. Starting with something very simple, maybe health checking container, and going out to focus on auto-scaling. Incrementally bring in more terminology and bring in more concepts, such as cold PID controllers. Concept-scenario, concept-scenario.
Who's the audience you are addressing? Poope that are building orchestration tools or those using them?
I'm not sure if I have a focus between those two. A lot of it is to people who are building orchestrators or heavily customising, which can go from customizing code to just very heavily leveraging settings. Auto-scaling is something I want to focus on because that's something that many people heavily customize based on particular servers, particular apps, even if they're not writing platform.
When you say 'first principles', what do you mean in the context of orchestration?
I have this little container I want to do something with it without talking about abstract things already existing. In the case of health checks I would want to talk about that in terms of just hearers first off, the kind of state machine of what's going on with this computer when you're managing health check.
What do you want someone to leave your talk with?
I want to leave with a better understanding of how we can build automation controllers.
Similar Talks
Tracks
Monday, 5 November
-
Microservices / Serverless Patterns & Practices
Evolving, observing, persisting, and building modern microservices
-
Practices of DevOps & Lean Thinking
Practical approaches using DevOps & Lean Thinking
-
JavaScript & Web Tech
Beyond JavaScript in the Browser. Exploring WebAssembly, Electron, & Modern Frameworks
-
Modern CS in the Real World
Thoughts pushing software forward, including consensus, CRDT's, formal methods, & probabilistic programming
-
Modern Operating Systems
Applied, practical, & real-world deep-dive into industry adoption of OS, containers and virtualization, including Linux on Windows, LinuxKit, and Unikernels
-
Optimizing You: Human Skills for Individuals
Better teams start with a better self. Learn practical skills for IC
Tuesday, 6 November
-
Architectures You've Always Wondered About
Next-gen architectures from the most admired companies in software, such as Netflix, Google, Facebook, Twitter, & more
-
21st Century Languages
Lessons learned from languages like Rust, Go-lang, Swift, Kotlin, and more.
-
Emerging Trends in Data Engineering
Showcasing DataEng tech and highlighting the strengths of each in real-world applications.
-
Bare Knuckle Performance
Killing latency and getting the most out of your hardware
-
Socially Conscious Software
Building socially responsible software that protects users privacy & safety
-
Delivering on the Promise of Containers
Runtime containers, libraries, and services that power microservices
Wednesday, 7 November
-
Applied AI & Machine Learning
Applied machine learning lessons for SWEs, including tech around TensorFlow, TPUs, Keras, PyTorch, & more
-
Production Readiness: Building Resilient Systems
More than just building software, building deployable production ready software
-
Developer Experience: Level up your Engineering Effectiveness
Improving the end to end developer experience - design, dev, test, deploy, operate/understand.
-
Security: Lessons Attacking & Defending
Security from the defender's AND the attacker's point of view
-
Future of Human Computer Interaction
IoT, voice, mobile: Interfaces pushing the boundary of what we consider to be the interface
-
Enterprise Languages
Workhorse languages found in modern enterprises. Expect Java, .NET, & Node in this track
