How Databricks Solved Their Hybrid Cloud Connectivity Challenges

Hybrid cloud is the industry’s latest buzzword for client-server software architectures that allow your customers to bring their own cloud. One of the largest technical hurdles to adopting this architecture is allowing your hosted control plane to speak to APIs in the data plane. This used to be easy when the data plane ran in your own VPC, but now that the data plane runs in your customer’s network it creates a brand new set of networking challenges.

Asking every customers to set up VPNs, VPC peering across public clouds, or to poke holes in their firewalls is quickly a non-starter. How do we solve this problem across all environments with zero configuration from customers? What we really want is a way to create ingress at scale into each of our customer’s networks.

In this talk, we’ll show you how Databricks solved the problem of creating ingress at scale for all the data nodes that run in their customer’s environments. We’ll walk through creating ingress to APIs into Kubernetes clusters, no matter where it’s running, even if you’re not operating it yourself.


Speaker

Alan Shreve

Founder and CEO @Ngrok

Hacker and Entrepreneur, Alan is the founder and CEO of Ngrok. He’s an active open source contributor and began his career as one of the first engineers at Twilio.

Read more

Session Sponsored By

Ngrok is simplified, API-first ingress-as-a-service.

Date

Tuesday Oct 3 / 10:35AM PDT ( 50 minutes )

Location

Pacific LM

Video

Video is not available

Share

From the same track

Session

Optimizing a Query - An Optimization Tale

Tuesday Oct 3 / 01:35PM PDT

Understanding what goes on inside your database Unveiling the magic that allows you to query on TBs of data in milliseconds Leverage deep insight into how databases work to better optimize your system

Speaker image - Oren Eini

Oren Eini

CEO @RavenDB

Session

Service Mesh for Less

Tuesday Oct 3 / 11:45AM PDT

Adoption of service mesh continues to grow as its features become baseline expectations for any modern application platform but infrastructure and operational costs remain a concern. Istio's 'Ambient Mesh' feature is tackling these concerns head-on.

Speaker image - Louis Ryan

Louis Ryan

CTO @Solo

Speaker image - Alex Ly

Alex Ly

Field Engineer at @Solo

Session

Streaming Events? You Should be Storing Them

Tuesday Oct 3 / 02:45PM PDT

Event-driven architecture has been on many developers' minds for some time.

Speaker image - Yves Lorphelin

Yves Lorphelin

Head of Developer Advocacy @Event Store

Speaker image - Matt Macchia

Matt Macchia

VP of Engineering @Event Store

Session

TiDB: Inside the Journey to Build a Cloud-Native, Distributed SQL Database

Tuesday Oct 3 / 03:55PM PDT

In this talk, Technology Evangelist Li Shen will speak to the architecture of TiDB, an advanced open-source, distributed SQL database. You’ll discover how TiDB has evolved over time to meet the requirements of cloud-native applications. You’ll also explore:

Speaker image - Li Shen

Li Shen

SVP & Founding Engineer @PingCAP

Session

How the Largest Latin American Bank Reduced Software Delivery Lead Time on a Team with 16,000 Engineers

Tuesday Oct 3 / 05:05PM PDT

Discover how Itaú Unibanco, the largest bank in Latin America with approximately 16k engineers, achieved a reduction in lead times for software delivery through the implementation of a streamlined developer process and controlled technology stacks within the StackSpot Developer Platform.

Speaker image - Manuela Leoni

Manuela Leoni

Head of Product @Itaú Unibanco