Fuzzy-neural self-adapting background modeling with automatic motion analysis for dynamic object detection

We propose a novel fuzzy-neural background modeling robust to scene changes.The model involves self-adapting threshold and learning rates mechanism.The system involves scene analysis to automatically update the model parameters.An automatic optical flow-matting process improves dynamic object segmentation.The model shows competitive performance compared with state-of-the-art models. In this paper we propose a system that involves a Background Subtraction, BS, model implemented in a neural Self Organized Map with a Fuzzy Automatic Threshold Update that is robust to illumination changes and slight shadow problems. The system incorporates a scene analysis scheme to automatically update the Learning Rates values of the BS model considering three possible scene situations. In order to improve the identification of dynamic objects, an Optical Flow algorithm analyzes the dynamic regions detected by the BS model, whose identification was not complete because of camouflage issues, and it defines the complete object based on similar velocities and direction probabilities. These regions are then used as the input needed by a Matte algorithm that will improve the definition of the dynamic object by minimizing a cost function. Among the original contributions of this work are; an adapting fuzzy-neural segmentation model whose thresholds and learning rates are adapted automatically according to the changes in the video sequence and the automatic improvement on the segmentation results based on the Matte algorithm and Optical flow analysis. Findings demonstrate that the proposed system produces a competitive performance compared with state-of-the-art reported models by using BMC and Li databases.

[1]  Simone Palazzo,et al.  A texton-based kernel density estimation approach for background modeling under extreme conditions , 2014, Comput. Vis. Image Underst..

[2]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[3]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[4]  Chi-Keung Tang,et al.  KNN Matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Guillermo Sapiro,et al.  Geodesic Matting: A Framework for Fast Interactive Image and Video Segmentation and Matting , 2009, International Journal of Computer Vision.

[6]  Laure Tougne,et al.  A testing framework for background subtraction algorithms comparison in intrusion detection context , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[7]  Zezhi Chen,et al.  A self-adaptive Gaussian mixture model , 2014, Comput. Vis. Image Underst..

[8]  Yin Li,et al.  Flash matting , 2006, SIGGRAPH 2006.

[9]  Andrew Fitzgibbon,et al.  Bayesian video matting using learnt image priors , 2004, CVPR 2004.

[10]  Thierry Chateau,et al.  A Benchmark Dataset for Foreground/Background Extraction , 2012, ACCV 2012.

[11]  Liang-Gee Chen,et al.  An intelligent depth-based obstacle detection system for visually-impaired aid applications , 2012, 2012 13th International Workshop on Image Analysis for Multimedia Interactive Services.

[12]  Takeshi Takaki,et al.  High-Frame-Rate Optical Flow System , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Atsushi Shimada,et al.  Object detection based on spatiotemporal background models , 2014, Comput. Vis. Image Underst..

[14]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[15]  Bahadir Karasulu,et al.  Performance Evaluation Software: Moving Object Detection and Tracking in Videos , 2013 .

[16]  Dan Xu,et al.  Real-time dynamic gesture recognition system based on depth perception for robot navigation , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[17]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[18]  Lucia Maddalena,et al.  Neural Networks in Video Surveillance: A Perspective View , 2012 .

[19]  Mario Ignacio Chacon Murguia,et al.  An Adaptive Neural-Fuzzy Approach for Object Detection in Dynamic Backgrounds for Surveillance Systems , 2012, IEEE Transactions on Industrial Electronics.

[20]  Maneesh Agrawala,et al.  Interactive video cutout , 2005, SIGGRAPH 2005.

[21]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[22]  Mario Ignacio Chacon Murguia,et al.  An Adaptive Unsupervised Neural Network Based on Perceptual Mechanism for Dynamic Object Detection in Videos with Real Scenarios , 2014, Neural Processing Letters.

[23]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[24]  Tieniu Tan,et al.  Vs-star: A visual interpretation system for visual surveillance , 2010, Pattern Recognit. Lett..

[25]  David Schreiber,et al.  GPU-based non-parametric background subtraction for a practical surveillance system , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[26]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[27]  Lucia Maddalena,et al.  A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection , 2010, Neural Computing and Applications.

[28]  Serdar Korukoglu,et al.  Performance Evaluation Software , 2013, SpringerBriefs in Computer Science.

[29]  Lucia Maddalena,et al.  The 3dSOBS+ algorithm for moving object detection , 2014, Comput. Vis. Image Underst..

[30]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.