How to improve a Fine-tuned GPT2 model
Im working on a simple project on fine-tuning GPT2 to become a mental health assistant. However, after the fine-tuning process the model did not perform well. Is this due to the nature of GPT2 or could I adjust the model parameters and it will work better? Even though I tried multiple training arguments but not much improvement was made. Im also pretty sure my data is clean and well structured so I dont think thats the issue.