mlflow.transformers.load_model() from mlflow server throws error, whereas loading from local file works
Problem When trying to load a logged (=saved) peft model from mlflow server, I get an Error(s) in loading state_dict for PeftModelForCausalLM: size mismatch. When I load the very same model from a local file, it works :thinking: I’m on mlflow 2.15.1 and transformers 4.42.4. Any ideas how to solve this? Example Logging a peft […]
mlflow.transformers.load_model() from mlflow server throws error, whereas loading from local file works
Problem When trying to load a logged (=saved) peft model from mlflow server, I get an Error(s) in loading state_dict for PeftModelForCausalLM: size mismatch. When I load the very same model from a local file, it works :thinking: I’m on mlflow 2.15.1 and transformers 4.42.4. Any ideas how to solve this? Example Logging a peft […]