Real-time video stabilization without phantom movements for micro aerial vehicles

In recent times, micro aerial vehicles (MAVs) are becoming popular for several applications as rescue, surveillance, mapping, etc. Undesired motion between consecutive frames is a problem in a video recorded by MAVs. There are different approaches, applied in video post-processing, to solve this issue. However, there are only few algorithms able to be applied in real time. An additional and critical problem is the presence of false movements in the stabilized video. In this paper, we present a new approach of video stabilization which can be used in real time without generating false movements. Our proposal uses a combination of a low-pass filter and control action information to estimate the motion intention.

[1]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[6]  Myung Jin Chung,et al.  Long-time video stabilization using point-feature trajectory smoothing , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[7]  Ming-Yu Shih,et al.  Moving camera video stabilization using homography consistency , 2012, ICIP.

[8]  Sung-Jea Ko,et al.  Video stabilization based on motion segmentation , 2012, 2012 IEEE International Conference on Consumer Electronics (ICCE).

[9]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[10]  Cecilio Angulo,et al.  Robust video stabilization based on motion intention for low-cost micro aerial vehicles , 2014, 2014 IEEE 11th International Multi-Conference on Systems, Signals & Devices (SSD14).

[11]  MatsushitaYasuyuki,et al.  Full-Frame Video Stabilization with Motion Inpainting , 2006 .

[12]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[13]  Konstantinos G. Derpanis,et al.  Overview of the RANSAC Algorithm , 2005 .

[14]  Zujun Hou,et al.  Real-Time Video Stabilization for Unmanned Aerial Vehicles , 2011, MVA.

[15]  David W. Murray,et al.  Guided Sampling and Consensus for Motion Estimation , 2002, ECCV.

[16]  Axel Pinz,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[17]  Robert Strzodka,et al.  Real-time motion estimation and visualization on graphics cards , 2004, IEEE Visualization 2004.

[18]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[19]  Jing Dong,et al.  Real-Time Video Stabilization Based on Smoothing Feature Trajectories , 2014, CIT 2014.

[20]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Cecilio Angulo Bahón,et al.  Estabilización Robusta de Vídeo basada en Diferencia de Nivel de Gris , 2013 .

[22]  Cecilio Angulo,et al.  Estabilización de vídeo en micro vehículos aéreos y su aplicación en la detección de caras , 2014 .

[23]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[24]  Krystian Mikolajczyk,et al.  Evaluation of local detectors and descriptors for fast feature matching , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[25]  Bing-Yu Chen,et al.  Video stabilization using robust feature trajectories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Olivier D. Faugeras,et al.  The geometry of multiple images - the laws that govern the formation of multiple images of a scene and some of their applications , 2001 .

[27]  Dan Schonfeld,et al.  Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Cecilio Angulo Bahón,et al.  Control autónomo de cuadricópteros para seguimiento de trayectorias , 2014 .

[29]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[30]  Marynel Vázquez,et al.  Real-time video smoothing for small RC helicopters , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[31]  Yu-Feng Hsu,et al.  Moving camera video stabilization using homography consistency , 2012, 2012 19th IEEE International Conference on Image Processing.

[32]  Azriel Rosenfeld,et al.  Shooting a smooth video with a shaky camera , 2003, Machine Vision and Applications.

[33]  Hai Zhao,et al.  Robust video stabilization based on particle filtering with weighted feature points , 2012, IEEE Transactions on Consumer Electronics.

[34]  David C. Zhang,et al.  Adaptive smoothing in real-time image stabilization , 2012, Defense + Commercial Sensing.

[35]  S. Govindarajulu,et al.  A Comparison of SIFT, PCA-SIFT and SURF , 2012 .

[36]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[37]  Olli Silvén,et al.  Video Stabilization Performance Assessment , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[38]  Paresh Rawat,et al.  Adaptive Motion Smoothening for Video Stabilization , 2013 .

[39]  Jie Xu,et al.  Fast feature-based video stabilization without accumulative global motion estimation , 2012, IEEE Transactions on Consumer Electronics.

[40]  Bobby Bodenheimer,et al.  A comparison of motion capture data recorded from a Vicon system and a Microsoft Kinect sensor , 2012, SAP '12.

[41]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[42]  Sung-Jea Ko,et al.  Robust digital image stabilization using the Kalman filter , 2009, IEEE Transactions on Consumer Electronics.

[43]  Sunglok Choi,et al.  Performance Evaluation of RANSAC Family , 2009, BMVC.

[44]  Yue Wang,et al.  Video stabilization based on high degree B-spline smoothing , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[45]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Tsung-Han Tsai,et al.  Video stabilization with local rotational motion model , 2012, 2012 IEEE Asia Pacific Conference on Circuits and Systems.

[48]  Shang-Hong Lai,et al.  A robust and efficient video stabilization algorithm , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[49]  Sebastiano Battiato,et al.  SIFT Features Tracking for Video Stabilization , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).