Loading data from Azure blob csv file to dataframe
I’m importing data from a SQL table into an Azure Databricks dataframe by exporting it to a CSV file, saving it in Azure Blob Storage, and then loading it into the dataframe. Most records are imported correctly, but for a few, the RecordInsertedDate shows 2023-12-31 in both SQL and the CSV, yet appears as NULL in the dataframe.