Trajectories and Camera Motion Compensation in Aerial Videos

This paper presents a method for trajectory extraction in videos acquired with a slightly moving camera. Trajectories are initialized at Shi-Tomasi [1] feature points and tracked thanks to the Lucas-Kanade [2] algorithm from the openCV library [3]. New feature points are regularly introduced to compensate for track losses and to handle newly appeared objects. A simple and fast method for camera motion compensation has been implemented, using the fact that near static scene points undergo an equal translation between any two images. Local histograms of displacement normally exhibit a clear peak since our application considers scenes with relatively few moving targets. These peaks designate which tracks and thus which points are best to estimate the homographies representing motion between frames of the sequence. Tracking results for pedestrian and vehicles with camera motion compensation are shown and discussed for two test cases with different environment, scenario and different video quality. The usefulness of camera motion compensated trajectories is demonstrated by an example of target classification based on track maximal speed and possible hotspot detection from long track pauses.

[1]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  Jiri Matas,et al.  Forward-Backward Error: Automatic Detection of Tracking Failures , 2010, 2010 20th International Conference on Pattern Recognition.

[4]  Michael Teutsch,et al.  Moving Object Detection and Segmentation for Remote Aerial Video Surveillance , 2014 .

[5]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Gabriel Oliver,et al.  Experimental Assessment of Different Feature Tracking Strategies for an IPT-based Navigation Task , 2010 .

[7]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jürgen Beyerer,et al.  A survey on moving object detection for wide area motion imagery , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[9]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[10]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[11]  Anand Singh Jalal,et al.  The State-of-the-Art in Visual Object Tracking , 2012, Informatica.

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  Sharath Pankanti,et al.  Efficient UAV video event summarization , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Bruce A. MacDonald,et al.  A Real-Time Method to Detect and Track Moving Objects (DATMO) from Unmanned Aerial Vehicles (UAVs) Using a Single Camera , 2012, Remote. Sens..