Feature-based real-time video stabilization for vehicle video recorder system

This paper presents a fast and effective method based on features to obtain real-time video stabilization for vehicle video recorder system. The corresponding feature points are first obtained from two consecutive frames and then optical flows are calculated based on these points. Next, the obtained optical flows are mapped to polar coordinates to obtain clusters and remove incorrect optical flows. These obtained clusters are used to evaluate the global motion and rotation angle. Finally, the obtained global motion and rotation angle are smoothed and then compensated to obtain the stabilized video. Experimental results show that the proposed method has good performance for video stabilization.

[1]  Wu-Chih Hu,et al.  Moving object detection and tracking from video captured by moving camera , 2015, J. Vis. Commun. Image Represent..

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[4]  Sung-Jea Ko,et al.  Feature point classification based global motion estimation for video stabilization , 2013, IEEE Transactions on Consumer Electronics.

[5]  Michael Bosse,et al.  Non-metric image-based rendering for video stabilization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Wu-Chih Hu,et al.  Effective Moving Object Detection from Videos Captured by a Moving Camera , 2014, ECC.

[7]  Michael Gleicher,et al.  Subspace video stabilization , 2011, TOGS.

[8]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[10]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[11]  Ashish Ghosh,et al.  Object Detection From Videos Captured by Moving Camera by Fuzzy Edge Incorporated Markov Random Field and Local Histogram Matching , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Feng Liu,et al.  Spatially and Temporally Optimized Video Stabilization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[14]  Kahlil Muchtar,et al.  Real-time background modeling based on a multi-level texture description , 2014, Inf. Sci..

[15]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[17]  Silvio Savarese,et al.  Ieee Transaction on Pattern Analysis and Machine Intelligence 1 a General Framework for Tracking Multiple People from a Moving Camera , 2022 .

[18]  Kamesh Namuduri,et al.  Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework , 2009, IEEE Transactions on Consumer Electronics.

[19]  Gianni Vernazza,et al.  Image stabilization algorithms for video-surveillance applications , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[20]  Hujun Bao,et al.  Video stabilization based on a 3D perspective camera model , 2009, The Visual Computer.

[21]  Byung Cheol Song,et al.  Fast 3D video stabilization using ROI-based warping , 2014, J. Vis. Commun. Image Represent..

[22]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Cecilio Angulo,et al.  Real-time video stabilization without phantom movements for micro aerial vehicles , 2014, EURASIP J. Image Video Process..

[24]  Chao Jia,et al.  Ieee Transactions on Signal Processing 1 Constrained 3d Rotation Smoothing via Global Manifold Regression for Video Stabilization , 2022 .

[25]  Jie Xu,et al.  Fast feature-based video stabilization without accumulative global motion estimation , 2012, IEEE Transactions on Consumer Electronics.

[26]  Gérard G. Medioni,et al.  A voting-based computational framework for visual motion analysis and interpretation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Wu-Chih Hu,et al.  Robust real-time ship detection and tracking for visual surveillance of cage aquaculture , 2011, J. Vis. Commun. Image Represent..

[28]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.