Presentation: Under the Hood: Elastic Scaling in Online Wagering
Duration
Abstract
William Hill is the UK's largest bookmaker with a network of 2,360 licensed betting shops across the country. In the USA, we are the largest legal bookmaker by outlet count operating more than half of the sports books in Nevada and the exclusive bookmaker to the Delaware State Lottery.
Our systems handle 5,000,000 price changes per day, with 160TB of data flowing through our network, peaking at 464 bets per second. Many of our current systems are based on a traditional database centric architecture. Our current capacity is fixed for the major sporting events relying on more exotic hardware each year to vertically scale this monolith. Much of this capacity can be idle during the troughs of the sporting calendar. We are exploring new Architecture patterns for our sports betting system designed to scale elastically according to demand, with a soft realtime shared nothing message based architecture.
The example for this session presents an Erlang/OTP engine packaged via Docker driven by a firehose from Apache Kafka. Join us as we reveal how we replay major sporting events into our systems to tune and tune again our architecture to distribute the load over all the available cores coping with the demands of 6 million concurrent processes over a typical weekend of sports betting.
Similar Talks
Tracks
Covering innovative topics
Monday Nov 16
-
Architectures You've Always Wondered About
Silicon Valley to Beijing: Exploring some of the world's most intrigiuing architectures
-
Applied Machine Learning
How to start using machine learning and data science in your environment today. Latest and greatest best practices.
-
Browser as a platform (Realizing HTML5)
Exciting new standards like Service Workers, Push Notifications, and WebRTC are making the browser a formidable platform.
-
Modern Languages in Practice
The rise of 21st century languages: Go, Rust, Swift
-
Org Hacking
Our most innovative companies reimagining the org structure
-
Design Thinking
Level up your approach to problem solving and leave everything better than you found it.
Tuesday Nov 17
-
Containers in Practice
Build resilient, reactive systems one service at a time.
-
Architecting for Failure
Your system will fail. Take control before it takes you with it.
-
Modern CS in the Real World
Real-world Industry adoption of modern CS ideas
-
The Amazing Potential of .NET Open Source
From language design in the open to Rx.NET, there is amazing potential in an Open Source .NET
-
Optimizing You
Keeping life in balance is always a challenge. Learning lifehacks
-
Unlearning Performance Myths
Lessons on the reality of performance, scale, and security
Wednesday Nov 18
-
Streaming Data @ Scale
Real-time insights at Cloud Scale & the technologies that make them happen!
-
Taking Java to the Next Level
Modern, lean Java. Focuses on topics that push Java beyond how you currently think about it.
-
The Dark Side of Security
Lessons from your enemies
-
Taming Distributed Architecture
Reactive architectures, CAP, CRDTs, consensus systems in practice
-
JavaScript Everywhere!
Javascript is Everywhere. Learn why
-
Culture Reimagined
Lessons on building highly effective organizations