Is there official Databricks documentation about the event log of compute instances? Most of the entries are quite obvious – but for some of them it would be good to have some extra context.

I have a Delta Live Table (DLT) with a string column that contains a serialized JSON object. I’m trying to create another DLT that queries from this table with some filtering, parses the JSON, and creates a new DLT from the resulting object (properties become columns), inferring the schema.

In my try to modulize the databricks asset bundle yaml config file. I’m trying to find out if it’s possible to reference or include another YAML file within a job configuration YAML file.
For example:

Unable to load CSV file while creating table in databricks. Upload error ! unable to processing file.csv [object object]

Whenever I attempt to create a table using below code to a Mounted drive in ADLS Gen 2 I get the error:

I have a terraform code to deploy a Databricks Workspace.

When I attempt to create or save a table to a location in my Azure Datalake Gen 2 using example code:

Databricks allows to use spot instances for worker nodes.

I have recently started learning Azure Databricks, While setting up unity catalogue I had confusion, Why we need the third party connector (Azure Databricks Connector) while creating unity catalogue if the aim is to be able to access the storage account, won’t service principal work ? I’m confused why there is a need for the connector.