I have a large CSV file with many columns that has mostly repetitive values but some columns with changing values from row to row. These changing columns either have data in them or are empty. Other columns have fixed values (see example below). How can I compress or remove duplicate rows such that the empty lines are merged into fewer lines? I have written a Python script that does this but it feels like there should be some elegant Linux command line way to do this in one go.