Moving Object Detection Using Dynamic Motion Modelling from UAV Aerial Images

Motion analysis based moving object detection from UAV aerial image is still an unsolved issue due to inconsideration of proper motion estimation. Existing moving object detection approaches from UAV aerial images did not deal with motion based pixel intensity measurement to detect moving object robustly. Besides current research on moving object detection from UAV aerial images mostly depends on either frame difference or segmentation approach separately. There are two main purposes for this research: firstly to develop a new motion model called DMM (dynamic motion model) and secondly to apply the proposed segmentation approach SUED (segmentation using edge based dilation) using frame difference embedded together with DMM model. The proposed DMM model provides effective search windows based on the highest pixel intensity to segment only specific area for moving object rather than searching the whole area of the frame using SUED. At each stage of the proposed scheme, experimental fusion of the DMM and SUED produces extracted moving objects faithfully. Experimental result reveals that the proposed DMM and SUED have successfully demonstrated the validity of the proposed methodology.

[1]  Dah-Jye Lee,et al.  The Nature-Inspired BASIS Feature Descriptor for UAV Imagery and Its Hardware Implementation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Larry S. Davis,et al.  Vehicle Detection Using Partial Least Squares , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Mubarak Shah,et al.  Shadow Casting Out Of Plane (SCOOP) Candidates for Human and Vehicle Detection in Aerial Imagery , 2012, International Journal of Computer Vision.

[4]  Hsu-Yung Cheng,et al.  Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks , 2012, IEEE Transactions on Image Processing.

[5]  Shuqun Zhang,et al.  Object tracking in unmanned aerial vehicle (UAV) videos using a combined approach , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[6]  Patrick Pérez,et al.  Context-driven moving object detection in aerial scenes with user input , 2011, 2011 18th IEEE International Conference on Image Processing.

[7]  Xiaokang Yang,et al.  Efficient Spatio-temporal Segmentation for Extracting Moving Objects in Video Sequences , 2007, IEEE Transactions on Consumer Electronics.

[8]  Don R. Hush,et al.  Wide-Area Motion Imagery , 2010, IEEE Signal Processing Magazine.

[9]  Xiaoting Wang,et al.  Vehicle detection based on morphology from highway aerial images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[10]  U. U. Sheikh,et al.  Moving object detection using image registration for a moving camera platform , 2012, 2012 IEEE International Conference on Control System, Computing and Engineering.

[11]  A. S. Prabuwono,et al.  A Conceptual framework: Dynamic path planning system for simultaneous localization and mapping multirotor UAV , 2014 .

[12]  Zhenbang Gong,et al.  Real-time Vision-based Object Tracking from a Moving Platform in the Air , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Michael Teutsch,et al.  Spatio-temporal fusion of object segmentation approaches for moving distant targets , 2012, 2012 15th International Conference on Information Fusion.

[14]  Fei Wang,et al.  Registration-based moving vehicle detection for low-altitude urban traffic surveillance , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[15]  H. Abdul Rauf,et al.  Edgelet based human detection and tracking by combined segmentation and soft decision , 2009, 2009 International Conference on Control, Automation, Communication and Energy Conservation.

[16]  Kristian Ambrosch,et al.  Distortion Compensation for Movement Detection Based on Dense Optical Flow , 2011, ISVC.

[17]  Xingbao Wang,et al.  Pedestrian Recognition Based on Saliency Detection and Kalman Filter Algorithm in Aerial Video , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[18]  Michael Teutsch,et al.  Detection and classification of moving objects from UAVs with optical sensors , 2011, Defense + Commercial Sensing.

[19]  M. Eichner,et al.  Autonomous Real-time Vehicle Detection from a Medium-Level UAV , 2009 .

[20]  Xu Qian,et al.  A comparison of features extraction method for HMM-based motion recognition , 2010, 2010 The 2nd Conference on Environmental Science and Information Application Technology.

[21]  Tieniu Tan,et al.  A Discriminative Model of Motion and Cross Ratio for View-Invariant Action Recognition , 2012, IEEE Transactions on Image Processing.

[22]  Sujitha Juliet,et al.  Motion and feature based person tracking in surveillance videos , 2011, 2011 International Conference on Emerging Trends in Electrical and Computer Technology.

[23]  Hongguang Li,et al.  Aerial video image object detection and tracing based on motion vector compensation and statistic analysis , 2009, 2009 Asia Pacific Conference on Postgraduate Research in Microelectronics & Electronics (PrimeAsia).

[24]  C. N. Savithri,et al.  Vehicle Detection From Aerial Imagery , 2013 .

[25]  Gérard G. Medioni,et al.  Motion pattern interpretation and detection for tracking moving vehicles in airborne video , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Bruce A. MacDonald,et al.  A Real-Time Method to Detect and Track Moving Objects (DATMO) from Unmanned Aerial Vehicles (UAVs) Using a Single Camera , 2012, Remote. Sens..

[27]  Harish Bhaskar.  Integrated human target detection, identification and tracking for surveillance applications , 2012, 2012 6th IEEE International Conference Intelligent Systems.

[28]  H. Qjidaa,et al.  Improving the performance of image classification by Hahn moment invariants. , 2013, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  M. Chtourou,et al.  Aerial sequence registration for vehicle detection , 2012, International Multi-Conference on Systems, Sygnals & Devices.

[30]  Pengfei Fang,et al.  An Objects Detection Framework in UAV Videos , 2011 .

[31]  Guo Jiang,et al.  Moving object detection using motion enhancement and color distribution comparison , 2012 .

[32]  Xiaofeng Liu,et al.  Vehicle detection methods from an unmanned aerial vehicle platform , 2012, 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012).

[33]  K. Takaya,et al.  Motion vector search for 2.5D modeling of moving objects in a video scene , 2005, Canadian Conference on Electrical and Computer Engineering, 2005..

[34]  Xuchu Yu,et al.  Object Tracking Based on Unmanned Aerial Vehicle Video , 2011, ICAIC.

[35]  Xue-song Wang,et al.  Motion feature extraction for stepped frequency radar based on Hough transform , 2010 .

[36]  Shoujuan Zhang,et al.  New feature extraction algorithm for satellite image non-linear small objects , 2012, 2012 IEEE Symposium on Electrical & Electronics Engineering (EEESYM).

[37]  Sheng Wang.  Vehicle Detection on Aerial Images by Extracting Corner Features for Rotational Invariant Shape Matching , 2011, 2011 IEEE 11th International Conference on Computer and Information Technology.

[38]  Hideo Hashimoto,et al.  Automatic moving object extraction using x-means clustering , 2010, 28th Picture Coding Symposium.

[39]  Matthew E. Antone,et al.  Detecting and tracking all moving objects in wide-area aerial video , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[40]  Zhihai He,et al.  Low-Complexity and Reliable Moving Objects Detection and Tracking for Aerial Video Surveillance with Small UAVS , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[41]  Farid Melgani,et al.  A SIFT-SVM method for detecting cars in UAV images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[42]  Anton Satria Prabuwono,et al.  Real Time Vision Based Object Detection from UAV Aerial Images: A Conceptual Framework , 2013, FIRA.

[43]  Kannappan Palaniappan,et al.  Performance evaluation of optimization methods for super-resolution mosaicking on UAS surveillance videos , 2012, Defense, Security, and Sensing.

[44]  Anton Satria Prabuwono,et al.  Adaptive Motion Pattern Analysis for Machine Vision Based Moving Detection from UAV Aerial Images , 2013, IVIC.

[45]  Toby P. Breckon,et al.  Real-time people and vehicle detection from UAV imagery , 2011, Electronic Imaging.

[46]  Fuqiang Liu,et al.  Stationary vehicle detection in aerial surveillance with a UAV , 2012, 2012 8th International Conference on Information Science and Digital Content Technology (ICIDT2012).

[47]  Erdinç Altug,et al.  A Catadioptric and Pan-Tilt-Zoom Camera Pair Object Tracking System for UAVs , 2011, J. Intell. Robotic Syst..

[48]  Long Chen,et al.  A coarse-to-fine approach for vehicles detection from aerial images , 2012, 2012 International Conference on Computer Vision in Remote Sensing.

[49]  Jerry D. Gibson,et al.  Low-complexity video encoding for UAV reconnaissance and surveillance , 2011, 2011 - MILCOM 2011 Military Communications Conference.

[50]  Lu Wang,et al.  The adaptive compensation algorithm for small UAV image stabilization , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[51]  Witold Czajewski,et al.  Moving Objects Detection and Tracking Framework for UAV-based Surveillance , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[52]  Mubarak Shah,et al.  Human identity recognition in aerial images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[53]  Yi-Ta Wu,et al.  A Hybrid Moving Object Detection Method for Aerial Images , 2010, PCM.

[54]  Lloyd L. Coulter,et al.  AUTOMATED DETECTION OF PEOPLE AND VEHICLES IN NATURAL ENVIRONMENTS USING HIGH TEMPORAL RESOLUTION AIRBORNE REMOTE SENSING , 2012 .

[55]  Shipeng Li,et al.  Automatic extraction of moving objects using multiple features and multiple frames , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[56]  Debi Prosad Dogra,et al.  Object Extraction Using Novel Region Merging and Multidimensional Features , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[57]  Yongli Liu,et al.  A video semantic object extraction method based on motion feature and visual attention , 2010, 2010 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[58]  Hong Wei,et al.  Modeling Image Motion in Airborne Three-Line-Array (TLA) Push-broom Cameras , 2013 .

[59]  François Chaumette,et al.  Dynamic visual servoing with image moments for an unmanned aerial vehicle using a virtual spring approach , 2013, Adv. Robotics.

[60]  Sergio Pellegrino,et al.  Combining Color and Haar Wavelet Responses for Aerial Image Classification , 2012, ICAISC.

[61]  Michael Teutsch,et al.  Detection, Segmentation, and Tracking of Moving Objects in UAV Videos , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[62]  Anton Satria Prabuwono,et al.  A Review of Machine Vision based on Moving Objects : Object Detection from UAV Aerial Images , 2013 .

[63]  Anton Satria Prabuwono,et al.  Adaptive Long Term Motion Pattern Analysis For Moving Object Detection Using UAV Aerial Images , 2013 .