“AssertionError: Torch not compiled with CUDA enabled” despite having correct versions of everything
I am trying to run a model using cuda on linux terminal with conda virtual environment. The model uses device_map = "auto" for device assignment like the following:
model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")