Databricks Performance Tuning with Joins around 15 tables with around 200 Million Rows
As part of our Databricks notebook, we are trying to run sql joining around 15 Delta Tables with 1 Fact and around 14 Dimension Tables. The Data coming out of Joins is around 200 Million records.