Fine-Tuning LLMs: CUDA OOM Errors Despite Various Optimization Techniques
I’m working on fine-tuning an LLM to build a fantasy football league model. The goal is to have the model output a team with high potential (hopefully) given a round of games. I have built an RAG dataset and implemented custom loss functions and metrics to fine-tune the model.