How much latency does the operating system add transferring video over USB to the host application?

I am transferring video from an image sensor to a C++ OpenCV application running on Linux. The signal chain is this: