Presentation: Performance Beyond Throughput:An OpenJ9 Case Study

Track: Performance Mythbusting

Location: Bayview AB

Duration: 2:55pm - 3:45pm

Day of week: Monday

Level: Intermediate

Persona: Architect, Backend Developer, CTO/CIO/Leadership, Developer, Developer, JVM, DevOps Engineer, General Software, Technical Engineering Manager

Share this on:

Abstract

Curious about Java application and JVM performance and how they are continuing to evolve? Come to this talk to learn more about exciting results and new advancements in the area of JVM performance using the latest open source JVM technology at Eclipse OpenJ9 running with OpenJDK! We'll talk about new performance boosts across a wide variety of applications and present results using different workloads and metrics to give you a fuller picture of what to expect from OpenJ9. We will also explore some common low-level Java performance problems and show how to look for these issues in an application. Low-level performance bottlenecks can be more challenging to diagnose since they can arise either from the OS kernel or from performance critical parts of the JVM such as the garbage collector (GC) or the just-in-time compiler (JIT). Rather than focusing on any single monitoring tool, we will explain the data you need to gather and provide you some examples of how to do so using system commands and profiling tools (like Linux Perf) as well as explaining different JVM tracing and logging capabilities. The view from “the bottom of the stack” can help in finding and fixing some stubborn performance problems often missed by high-level performance analysis tools.

Interview

Question: 
What is the focus of your work today?
Answer: 

For the past 14 years I've been working on Java JIT compiler development at IBM. However, I am not your typical compiler guy because I don't focus that much on code generator or optimizer. Instead I deal with heuristics that determine what methods to compile, when to compile them and how much to optimize them. With Java, and any other languages that can benefit from a JIT compiler, the overhead of the compilation needs to be kept in check. You simply cannot afford to compile every single method at the highest optimization level; instead the JIT compiler needs to be quite selective. I've also worked on the design of various runtime aspects of the JVM like code cache management, metadata cache management or interpreter profiler to name a few. More recently I got interested in the behavior of the JVM in the cloud which is a challenging domain because the environment is more dynamic.

Question: 
What’s the motivation for this talk?
Answer: 

The motivation for the talk is twofold:

First is to increase awareness about performance metrics that are usually ignored, for instance footprint to give just an example. Many times I have read in online forums the opinion that footprint is not important because nowadays servers have plenty of memory. This may not be true in the cloud where big machines are carved into smaller VMs.

Second is to draw attention to OpenJ9, a new open source JVM than IBM has donated to the Eclipse Foundation. OpenJ9 works in conjunction with OpenJDK and we think it offers a few performance advantages over HotSpot JVM which is traditionally used by developers.

Question: 
How you you describe the persona and level of the target audience?
Answer: 

Due to the OpenJ9 connection, the talk should appeal primarily to developers and architects that use Java in their projects. However, the performance aspects I touch on should appeal to a broader audience because performance is a key ingredient of any software system.

Question: 
With what does “that” persona walk away from your talk knowing that they might not have known 50 minutes before?
Answer: 

This is tightly connected to the motivation for this talk. We want the audience to leave with two key aspects: First is that there are many facets to performance and, as a developer, you have to consider them all because you don't know what your customer values most, you cannot fully guess how people are going to use your product. Even if you do guess it right today, that may change tomorrow. Secondly, we want to spread the word about OpenJ9 and why, in the cloud, it could be a good alternative to HotSpot. We want people to try it, use for their projects, come up with suggestions regarding improvements and, why not, even contribute code to the OpenJ9 project. I'll also show how to hunt for performance issues using OpenJ9 performance tools.

Question: 
What technology problem keeps you up at night?
Answer: 

For me it's about performance and more specifically it's about the balance between contradictory performance metrics. How do you make the right trade-offs without user guidance, without having to specify a long command line or go through a long and painful tuning process. How can the JVM adapt to the running environment especially when the environment is constantly changing from one minute to the next like in the cloud. The JVM (and other software application too) needs to become a lot smarter. It needs to collect information all the time about the environment, gather clues and change its behavior to match the environment.

Speaker: Marius Pirvu

Advisory Software Developer @IBM

Marius Pirvu is an Advisory Software Developer in the IBM Runtime Technologies Group. After receiving his Ph.D. degree in Computer Science from Texas A&M University in 2000 he joined HP where he designed the chipset architecture of next generation servers. For the last 14 years he has been working at the IBM Canada Lab on the design and implementation of Testarossa Just-In-Time compiler used in IBM’s J9 JVM (now Eclipse OpenJ9). His main focus is optimizing the JVM to improve start-up, ramp-up and footprint.

Find Marius Pirvu at

Similar Talks

Chief Language Designer of C# & Contributor to TypeScript, Visual Basic, Roslyn, LINQ
Principal Software Engineer @Microsoft focused on High-Performance .NET
Director of Vulnerability Research @Endgame
Technical Program Manager @Questback
Product Management and Marketing @Datacoral
Founding Member of the Atom Editor Team @GitHub

.

Tracks

  • Architectures You've Always Wondered About

    Architectural practices from the world's most well-known properties, featuring startups, massive scale, evolving architectures, and software tools used by nearly all of us.

  • Going Serverless

    Learn about the state of Serverless & how to successfully leverage it! Lessons learned in the track hit on security, scalability, IoT, and offer warnings to watch out for.

  • Microservices: Patterns and Practices

    Stories of success and failure building modern Microservices, including event sourcing, reactive, decomposition, & more.

  • DevOps: You Build It, You Run It

    Pushing DevOps beyond adoption into cultural change. Hear about designing resilience, managing alerting, CI/CD lessons, & security. Features lessons from open source, Linkedin, Netflix, Financial Times, & more. 

  • The Art of Chaos Engineering

    Failure is going to happen - Are you ready? Chaos engineering is an emerging discipline - What is the state of the art?

  • The Whole Engineer

    Success as an engineer is more than writing code. Hear inward looking thoughts on inclusion, attitude, leadership, remote working, and not becoming the brilliant jerk.

  • Evolving Java

    Java continues to evolve & change. Track covers Spring 5, async, Kotlin, serverless, the 6-month cadence plans, & AI/ML use cases.

  • Security: Attacking and Defending

    Offense and defensive security evolution that application developers should know about including SGX Enclaves, effects of AI, software exploitation techniques, & crowd defense

  • The Practice & Frontiers of AI

    Learn about machine learning in practice and on the horizon. Learn about ML at Quora, Uber's Michelangelo, ML workflow with Netflix Meson and topics on Bots, Conversational interfaces, automation, and deployment practices in the space.

  • 21st Century Languages

    Compile to Native, Microservices, Machine learning... tailor-made languages solving modern challenges, featuring use cases around Go, Rust, C#, and Elm.

  • Modern CS in the Real World

    Applied trends in Computer Science that are likely to affect Software Engineers today. Topics include category theory, crypto, CRDT's, logic-based automated reasoning, and more.

  • Stream Processing In The Modern Age

    Compelling applications of stream processing using Flink, Beam, Spark, Strymon & recent advances in the field, including Custom Windowing, Stateful Streaming, SQL over Streams.  

Conference for Professional Software Developers