Legacy Modernization: Architecting Real-Time Systems Around a Mainframe

QCon San Francisco 2024

Session

Legacy Modernization: Architecting Real-Time Systems Around a Mainframe

Monday Nov 18 / 05:05PM PST, Ballroom A

Abstract

Designing systems that take advantage of modern platforms, tools, and techniques is critical for building scalable, evolvable applications that underpin businesses of all stripes. Leveraging those when your data is captured in a mainframe, which does not scale well, is challenging. Technical and architectural debt is often a stifling element and the momentum to modernize can be both hard to gain and to maintain.

This talk discusses how National Grid built an event driven system using change data capture on top of a DB2 mainframe to power a cloud native GraphQL API hosted in Azure.

National Grid uses mainframes to power their customer billing capabilities. These mainframes encompass decades of data and capabilities in a monolithic, inelastic system. Many business and customer channels rely on this data and functionality. The motivating application for our project is the customer web portal. Earlier iterations of the portal relied on direct synchronous calls to the mainframe. This constraint historically caused problems for scaling to their customer base’s needs on the web. Availability and performance were key challenges.

Our architecture works by disconnecting the needs of the web application from the constraints of the mainframe. This ‘system of reference’ is hosted in the cloud with modern tech and is far better suited to adapting to business and (by extension) customer needs. It is a foundation which can, and is, being built upon to modernize National Grid’s technology portfolio, with no direct dependency on the legacy systems underlying them.

  • Change data capture enables near-real time synchronization
  • The ‘Customer Graph’ system-of-reference provides capability to scale independently from mainframe and be resilient to on-prem volatility
  • Asynchronous boundaries between cloud/on-prem resources decouples applications from connectivity/availability issues
  • APIs developed with domain-driven design, providing multi-channel support for diverse business applications

Interview

Jason: Cloud architecture and distributed systems

Jason: Growth

Jason: Senior engineers and architects

Jason: Ideas and context for creating innovation when dealing with legacy systems

Jason: AI seems too obvious. I actually think it will be the second or third order effects of AI. Particularly around what types of skill sets AI-aided development foster in new generations of engineers.

76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon San Francisco 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Monday 18 November

10:35 Ballroom A Session MLOps Supporting Diverse ML Systems at Netflix David Berg, Romain Cledat 11:45 Ballroom A Session Architecture Optimizing Search at Uber Eats Janani Narayanan, Karthik Ramasamy 13:35 Ballroom A Session Architecture Changing the Model: Why and How We Re-Architected Slack Ian Hoffman Staff Software Engineer @Slack, Previously @Chairish 14:45 Seacliff D Unconference Unconference: Architectures You've Always Wondered About 15:55 Ballroom A Session HTTP How GitHub Copilot Serves 400 Million Completion Requests a Day David Cheney Lead, Copilot Proxy @GitHub, Open Source Contributor and Project Member for Go Programming Language, Previously @VMware 17:05 Ballroom A Session Legacy Modernization: Architecting Real-Time Systems Around a Mainframe Jason Roberts, Sonia Mathew