I am running a transformer model from hugging face via Google Colab GPU T4 and below is my code. There are 5 fold cross validations and each cross validation goes through 4 epoch (First cross validation: epoch 1,2,3,4 then second cross validation: epoch 1,2,3,4 etc). As you can see in the code, I have included checkpoints for each epoch.