A novel video stabilization method with global motion vector prediction and border region recovery

This paper presents a novel approach of vision stabilization, potentially applied to mobile robot or unmanned vehicle, which is inspired by the characteristics of human eye. Vision information processing is a key technology of intelligent mobile platform. However, in some condition, such as the vision module mount on the vehicle moving on the rugged ground, the system could not acquire stable vision, which influence the post-process of image information and make the observer uncomfortable. With video stabilization technology, the unwanted vibrations or shakes of video sequences is smoothed at real time speed. The algorithm proposed is mainly based on digital image stabilization technology, which divides the whole vision in 9 sub-area averagely, then processes searching and matching strategy by macro block with size of 16 ×16 or 8×8 pixels. Both the start point for searching and motion vector are predicted by the motion trend. After the motion compensation procedure, the video is stabilized. During the procedure above, the edge area of the video is lost. In this paper, a recovery method inspired by human vision is discussed, which consider the duration of vision factors. With the evaluating a sequence of unstable images acquired by vision system on the mobile robot, we can draw the conclusion that the effectiveness and validation of the method aforementioned is implemented.

[1]  Wenbin Chen,et al.  Video Stabilization Using Scale-Invariant Features , 2007, 2007 11th International Conference Information Visualization (IV '07).

[2]  Carlo S. Regazzoni,et al.  Color-based video stabilization for real-time on-board object detection on high-speed trains , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[3]  A. Amirat,et al.  Vision-based approach for people tracking using gait in distributed and automated visual surveillance , 2013, 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA).

[4]  Di Zhao,et al.  A Tele-operation System for Collaborative Works with Vision-Guided Autonomous Robot , 2008, ICIRA.

[5]  C. Miro,et al.  Digital video stabilization architecture for low cost devices , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[6]  Sebastiano Battiato,et al.  Digital video stabilization through curve warping techniques , 2008, IEEE Transactions on Consumer Electronics.

[7]  Carlo L. Bottasso,et al.  Tightly-coupled stereo vision-aided inertial navigation using feature-based motion sensors , 2014, Adv. Robotics.

[8]  Mohammad T. Sadeghi,et al.  Video Stabilization and Completion Using the Scale-Invariant Features and RANSAC Robust Estimator , 2011 .

[9]  Laurent Itti,et al.  Autonomous Mobile Robot Localization and Navigation Using a Hierarchical Map Representation Primarily Guided by Vision , 2014, J. Field Robotics.

[10]  Oscar C. Au,et al.  Predictive motion vector field adaptive search technique (PMVFAST): enhancing block-based motion estimation , 2000, IS&T/SPIE Electronic Imaging.

[11]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Li Chen,et al.  A fast video stabilization algorithm based on block matching and edge completion , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[13]  Janne Heikkilä,et al.  Fast full search block motion estimation for H.264/AVC with multilevel successive elimination algorithm , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[14]  Bing-Yu Chen,et al.  Video stabilization using robust feature trajectories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Sei-Wang Chen,et al.  Video stabilization for a camcorder mounted on a moving vehicle , 2004, IEEE Transactions on Vehicular Technology.

[16]  Magnus Jansson,et al.  Vision-Aided Inertial Navigation Based on Ground Plane Feature Detection , 2014, IEEE/ASME Transactions on Mechatronics.

[17]  Toby P. Breckon,et al.  Robust motion filtering as an enabler to video stabilization for a tele-operated mobile robot , 2013, Optics/Photonics in Security and Defence.

[18]  SchonfeldDan,et al.  Robust video stabilization based on particle filter tracking of projected camera motion , 2009 .

[19]  Sangkyung Sung,et al.  GNSS integration with vision-based navigation for low GNSS visibility conditions , 2013, GPS Solutions.

[20]  Kamesh Namuduri,et al.  Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework , 2009, IEEE Transactions on Consumer Electronics.