Change Detection in Crowded Underwater Scenes - Via an Extended Gaussian Switch Model Combined with a Flux Tensor Pre-segmentation

In this paper a new approach for change detection in videos of crowded scenes is proposed with the extended Gaussian Switch Model in combination with a Flux Tensor pre-segmentation. The extended Gaussian Switch Model enhances the previous method by combining it with the idea of the Mixture of Gaussian approach and an intelligent update scheme which made it possible to create more accurate background models even for difficult scenes. Furthermore, a foreground model was integrated and could deliver valuable information in the segmentation process. To deal with very crowded areas in the scene – where the background is not visible most of the time – we use the Flux Tensor to create a first coarse segmentation of the current frame and only update areas that are almost motionless and therefore with high certainty should be classified as background. To ensure the spatial coherence of the final segmentations, the N2Cut approach is added as a spatial model after the background subtraction step. The evaluation was done on an underwater change detection datasets and showed significant improvements over previous methods, especially in the crowded scenes.

[1]  Kannappan Palaniappan,et al.  Adaptive Robust Structure Tensors for Orientation Estimation and Image Segmentation , 2005, ISVC.

[2]  Enrico Gutzeit,et al.  Video Segmentation via a Gaussian Switch Background Model and Higher Order Markov Random Fields , 2015, VISAPP.

[3]  Tiejun Huang,et al.  Selective eigenbackgrounds method for background subtraction in crowed scenes , 2011, 2011 18th IEEE International Conference on Image Processing.

[4]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[5]  R. Vasiu,et al.  Background Modeling and Foreground Detection via a Reconstructive and Discriminative Subspace Learning Approach , 2012 .

[6]  Ian D. Reid,et al.  Stable multi-target tracking in real-time surveillance video , 2011, CVPR 2011.

[7]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Olaf Munkelt,et al.  Adaptive Background Estimation and Foreground Detection using Kalman-Filtering , 1995 .

[9]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Rui Wang,et al.  Static and Moving Object Detection Using Flux Tensor with Split Gaussian Models , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Serhat S Bucak,et al.  Incremental Nonnegative Matrix Factorization for Background Modeling in Surveillance Video , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[13]  Fahimeh Farhadifard,et al.  Dataset on underwater change detection , 2016, OCEANS 2016 MTS/IEEE Monterey.

[14]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[15]  Konrad Schindler,et al.  Smooth Foreground-Background Segmentation for Video Processing , 2006, ACCV.

[16]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[17]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[18]  Uwe von Lukas,et al.  Real time video segmentation optimization with a modified Normalized Cut , 2015, 2015 9th International Symposium on Image and Signal Processing and Analysis (ISPA).

[19]  Max Mignotte,et al.  A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation , 2010, IEEE Transactions on Image Processing.

[20]  Guillaume-Alexandre Bilodeau,et al.  SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity , 2015, IEEE Transactions on Image Processing.

[21]  S. Bianco,et al.  How Far Can You Get By Combining Change Detection Algorithms? , 2015, ICIAP.

[22]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[23]  Guna Seetharaman,et al.  Flux Tensor Constrained Geodesic Active Contours with Sensor Fusion for Persistent Object Tracking , 2007, J. Multim..

[24]  N. L. Seed,et al.  Approaches to static background identification and removal , 1993 .