Speaker: Holden Karau
She / her / hers
Data Engineer @Snowflake & Co-Founder of Fight Health Insurance, Previously @Netfilx, @Apple, and @Google
I'm Holden Karau and I think a lot about distributed systems, I've (co-)written the following books: High Performance Spark, Distributed Computing 4 Kids and Executives, Learning Spark, Scaling Python with Dask, and Scaling Python With Ray.
Find Holden Karau at:
Session
Breaking Down the Walls to Python & Big Data + AI Performance with Transpilation and LLMs
Many of us have a love hate relationship with Apache Spark, especially when it comes to PySpark. Especially in Python, the UDF performance can be a dumpster fire.