A robust real-time image algorithm for moving target detection from unmanned aerial vehicles (UAV)

We propose a real time method for moving target detection from a camera embedded on a UAV. As the camera is moving, we must estimate the background motion in order to compensate it and then perform the moving target detection. This compensation is realized by an image registration method. For this, we use an hybrid method using global minimization and feature-based approaches, with a pyramidal implementation. The good results obtained for registration give us the potential moving targets. As some wrong detections still appear, due to noise, occlusions or local change of illuminations, we worked on a robust spatio-temporal tracker able to decide if potential targets are real moving targets or not. The algorithm must reach real time performances for VGA images at 30 fps with a standard PC.We have tested our method on different sequences and show the good results obtained thanks to the high precision in the image registration and the spatio-temporal tracker.

[1]  Maryline Chetto,et al.  Video rate color region segmentation for mobile robotic applications , 2005, SPIE Optics + Photonics.

[2]  P. Anandan,et al.  A Unified Approach to Moving Object Detection in 2D and 3D Scenes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[4]  Nassir Navab,et al.  A real-time tracking system combining template-based and feature-based approaches , 2007, VISAPP.

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[7]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  J. Odobez,et al.  Separation of Moving Regions from Background in an Image Sequence Acquired with a Mobil Camera , 1997 .

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  Isaac Cohen,et al.  Detection and Tracking of Objects in Airborne Video Imagery , 2003 .

[12]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[13]  Éric Marchand,et al.  Experiments with robust estimation techniques in real-time robot vision , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[15]  Mubarak Shah,et al.  COCOA: tracking in aerial imagery , 2006, SPIE Defense + Commercial Sensing.

[16]  Haroon Idrees,et al.  Detection and Tracking of Large Number of Targets in Wide Area Surveillance , 2010, ECCV.

[17]  Selim Benhimane,et al.  Real-time image-based tracking of planes using efficient second-order minimization , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[18]  Bruce A. MacDonald,et al.  A Real-Time Method to Detect and Track Moving Objects (DATMO) from Unmanned Aerial Vehicles (UAVs) Using a Single Camera , 2012, Remote. Sens..

[19]  Ardeshir Goshtasby,et al.  A Region-Based Approach to Digital Image Registration with Subpixel Accuracy , 1986, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[21]  Alois Knoll,et al.  Efficient compositional approaches for real-time robust direct visual odometry from RGB-D data , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Kamel Bouchefra,et al.  Temporally optimized edge segmentation for mobile robotics applications , 2005, SPIE Optics + Photonics.

[23]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[24]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization, Mapping and Moving Object Tracking , 2007, Int. J. Robotics Res..

[25]  Éric Marchand,et al.  Second-Order Optimization of Mutual Information for Real-Time Image Registration , 2012, IEEE Transactions on Image Processing.

[26]  Pierre Blazevic,et al.  Real time tracking system by vision simplifying the interaction between human and robot for remote control of mobile robot , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[27]  Patrick Bouthemy,et al.  Simultaneous Motion Detection and Background Reconstruction with a Conditional Mixed-State Markov Random Field , 2011, International Journal of Computer Vision.

[28]  Gérard G. Medioni,et al.  Efficient detection and tracking of moving objects in geo-coordinates , 2010, Machine Vision and Applications.

[29]  R. Kanchana,et al.  A Method to Align Images Using Image Segmentation , 2012 .

[30]  Matteo Matteucci,et al.  Use a Single Camera for Simultaneous Localization And Mapping with Mobile Object Tracking in dynamic environments , 2009, ICRA 2009.

[31]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..