How to add user defined functions to arrow compute
I am implementing an encryption and decryption transformation function that takes a parquet file as input and encrypts/decrypts each column of each row using AES-CTR and writes it back out to a destination location. (I am aware of Parquet Modular Encryption but that is not an option right now for various reasons).