I’m developing a FastAPI application that uses Langchain with Ollama. The application is containerized using Docker, and I’m trying to connect to a separate Ollama container. However, I’m encountering a connection refused error when attempting to use the Ollama service.

When trying to access the ollama container from another (node) service in my docker compose setup, I get the following error: ResponseError: model 'llama3' not found, try pulling it first. I want the setup for the containers to be automatic and don’t want to manually connect to the containers and manually pull the models.
Is there a way to load the model of my choice automatically when I create the ollama docker container?

I would like to make a docker-compose which starts ollama (like ollama serve) on port 11434 and creates mymodel from ./Modelfile.

I want run ollama with docker-compose and using nvidia-gpu. What should I write in the docker-compose.yml file?