From this track
Breaking down the walls to Python & Big Data + AI Performance with Transpilation and LLMs
Many of us have a love hate relationship with Apache Spark, especially when it comes to PySpark. Especially in Python, the UDF performance can be a dumpster fire.
Building a Data Platform with AI
Data platform sits at the intersection of infrastructure, governance, operations, and user experience.
Mouli Mukherjee
Engineering Manager @OpenAI