I’m trying to run the following code:

I’ve installed and can run against ollama locally with llama3. However I cannot seem to get this working in a local google colab. The following python code runs just fine as a python.py. But when I run a local docker instance and connect my colab project to that local colab instance, I cannot get the code to run.

I have a Windows machine, and I was able to install Ollama and run Llama3 on the machine. Besides, I was able to configure my home network and used port forwarding to make the Ollama service available on the internet.