Relative Content

Tag Archive for artificial-intelligencegpt-2fine-tuning

How to improve a Fine-tuned GPT2 model

Im working on a simple project on fine-tuning GPT2 to become a mental health assistant. However, after the fine-tuning process the model did not perform well. Is this due to the nature of GPT2 or could I adjust the model parameters and it will work better? Even though I tried multiple training arguments but not much improvement was made. Im also pretty sure my data is clean and well structured so I dont think thats the issue.