ModuleNotFoundError: No module named ‘openai.types’ when deploying vllm
I am deploying an opensource llm using vllm on my gpu instance, when I run this line to deploy the server:
I am deploying an opensource llm using vllm on my gpu instance, when I run this line to deploy the server: