I use OpenCV on Android. I use the goodFeaturesToTrack method to find features in a video frame. Then I take the next video frame and find those features in it using calcOpticalFlowPyrLK and estimate the needed transformation using estimateAffinePartial2D. Up to here everything works as I expect.