Everyone.
This problem has troubled me for a long time
My situation is that the data is too large to be imported, so I use Arrow’s open_dataset to handle it.
I want to convert csv files of different years into parquet format
So I encountered the following problems