I’m working on string manipulation in large files which is explained here. Based on the recommendations I received, I am using LazyFrames and the sink_parquet function.
As I try to improve throughput I want to optimize the sink_parquet function.