Relative Content

Tag Archive for analyticsdata-preprocessingoverfitting-underfittingpredictive

Pre-processing the dataset before splitting – model building – model tuning – performance evaluation

Below is the link for a dataset on focus. I want to split the dataset into training and test set, use training set to build the model and model tune, use test set to evaluate performance. But before doing that I want to make sure that original dataset doesn’t have noise, collinearity to address, no major outliers so that I have to transform the data using techniques like Box-Cox and looking at VIF to eliminate highly correlated predictors.

Pre-processing the dataset before splitting – model building – model tuning – performance evaluation

Below is the link for a dataset on focus. I want to split the dataset into training and test set, use training set to build the model and model tune, use test set to evaluate performance. But before doing that I want to make sure that original dataset doesn’t have noise, collinearity to address, no major outliers so that I have to transform the data using techniques like Box-Cox and looking at VIF to eliminate highly correlated predictors.