Real-Time Detection, Tracking and Classification of Multiple Moving Objects in UAV Videos

Unnamed Aerial Vehicles (UAVs) are becoming increasingly popular and widely used for surveillance and reconnaissance. There are some recent studies regarding moving object detection, tracking, and classification from UAV videos. A unifying study, which also extends the application scope of such previous works and provides real-time results, is absent from the literature. This paper aims to fill this gap by presenting a framework that can robustly detect, track and classify multiple moving objects in real-time, using commercially available UAV systems and a common laptop computer. The framework can additionally deliver practical information about the detected objects, such as their coordinates and velocities. The performance of the proposed framework, which surpasses human capabilities for moving object detection, is reported and discussed.

[1]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[2]  Nishu Singla.  Motion Detection Based on Frame Difference Method , 2014 .

[3]  Tamás Szirányi,et al.  Multi target tracking on aerial videos , 2015 .

[4]  Vladimir Reilly.  Detecting, Tracking, And Recognizing Activities In Aerial Video , 2012 .

[5]  Mubarak Shah,et al.  Human identity recognition in aerial images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Silvio Savarese,et al.  Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes , 2016, ECCV.

[7]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  S. Gedam,et al.  Area Based Image Matching Methods – A Survey , 2012 .

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[12]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[13]  Tong Heng Lee,et al.  Unmanned Rotorcraft Systems , 2011 .

[14]  Yumi Iwashita,et al.  Recognizing Humans in Motion: Trajectory-based Aerial Video Analysis , 2013, BMVC.

[15]  Kiran Kale,et al.  Moving object tracking using optical flow and motion vector estimation , 2015, 2015 4th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO) (Trends and Future Directions).

[16]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[17]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  B. Möller,et al.  An integrated analysis concept for errors in image registration , 2008, Pattern Recognition and Image Analysis.

[19]  Adel M. Alimi,et al.  Moving Object Detection System in Aerial Video Surveillance , 2013, ACIVS.

[20]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[21]  Yiğithan Dedeoğlu,et al.  Moving object detection, tracking and classification for smart video surveillance , 2004 .

[22]  Song Zheng,et al.  An Improved Moving Object Detection Algorithm Based on Frame Difference and Edge Detection , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[23]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.