Speaker
Abstract
Venice is an open-source derived data platform developed by LinkedIn. It is used mainly for ML feature storage, which requires the ability to refresh data at very high throughput, and to look it up with low latency.
The lion share of the project is in Java, although it also leverages RocksDB and ZSTD via JNI. On the Java side, every bit of performance which can be squeezed is fair game.
After briefly presenting Venice, this talk then deep dives into some of the tricks we have employed in our relentless pursuit to lower read latency and to reach 1M operations per second per node.
Topics
QCon San Francisco 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
From the same track
Tuesday 3 October
10:35 Pacific DEKJ Session Java How Netflix Really Uses Java Paul Bakker Java Platform @Netflix, Java Champion, and Co-Author of "Java 9 Modularity" Netflix is (in)famous for the way we develop our systems. Micro Services, RxJava, Hystrix and Spring Cloud Netflix are just a few things that developers often associate with Netflix. 11:45 Pacific DEKJ Session Distributed Systems The Journey to a Million Ops / Sec / Node in Venice Alex Dubrouski, Gaojie Liu Venice is an open-source derived data platform developed by LinkedIn. It is used mainly for ML feature storage, which requires the ability to refresh data at very high throughput, and to look it up with low latency. 13:35 Pacific DEKJ Session Harnessing Exotic Hardware: Charting the Future of JVM Performance Monica Beckwith Java Champion, Author of JVM Performance Engineering, JVM Performance Expert @Microsoft, First Lego League Coach, Advocate for STEAM + kids Monica Beckwith offers a deep dive into the intricate world of the JVM and its evolving relationship with exotic hardware in her enlightening presentation at QConSF's JVM trends track. 14:45 Seacliff D Unconference Unconference: JVM Trends What is an unconference? An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions. 15:55 Pacific DEKJ Session jvm Optimizing JVM for the Cloud: Strategies for Success Tobi Ajila Eclipse OpenJ9 JVM Engineer @IBM, Optimizing JVMs for Cloud Environments Embracing cloud-native is more than just a trend; it's a strategic move for modern businesses. As organizations pivot from monolithic structures to agile micro-services, the role of the JVM becomes increasingly significant. 17:05 Pacific DEKJ Session Java The Keys to Developer Productivity: Collaborate and Innovate Heather VanCura Vice President, Community Engagement @Oracle, Director & Chairperson at Java Community Process (JCP) Program, MySQL Community/DevRel, and Board Member In the JVM track at QCon SF, the speakers talked about the role of collaboration and innovation and how this is impacting their business.