Relative Content

Tag Archive for pythonlangchainollama

Langchain library to calculate throughput

I want to calculate input and output throughput for a model. i am using Lang chain framework. so want to know does Lang chain provide any library which will help me to calculate the prompt eval time, total time, model load time etc. Can i get parameters like these using any Lang chain library ??
if anyone knows please help me this and provide some resource as well.