Relative Content

Tag Archive for pythonmachine-learningpytorchnlp

Poor Performance and Signs of Overfitting When Fine-Tuning BART with Adapters on CNN/DailyMail Dataset

I am currently fine-tuning the BART model with adapters for a summarization task using the CNN/DailyMail dataset. I’ve noticed that the model shows poor performance and signs of overfitting. Below is my setup and the relevant code snippet. I’ve already experimented with different learning rates and the amount of training data. Any suggestions on what might be causing this issue or how to improve the model’s performance would be appreciated.