Explaining the Python-JVM Boundary in Spark, and What Arrow Changed

Every place data crosses between Spark's JVM and Python used to be a pickle bottleneck. Over a decade, Apache Arrow took them one at a time, from...