A genetically optimized graph-based people extraction method for embedded transportation systems real conditions

In this paper, we present a new method for people extraction in complex transport environments. Many background subtraction methods exist in the literature but don't give satisfactory results on complex images acquired in moving trains that include several locks such as fast brightness changes, noise, shadow, scrolling background, etc. To tackle this problem, a new method for people extraction in images is proposed. It is based on an image superpixel segmentation coupled with graph cuts binary clustering, initialized by a state-of-the-art foreground detection method. The proposed strategy is composed of four blocks. A pre-processing block that uses filters and colorimetric invariants to limit the presence of artifacts in images. A foreground detection block that enables to locate moving people in images. A post-treatment block that removes shadow regions of no-interest. A people extraction block that segments the image into SLIC superpixels and performs a graph cut binary clustering to precisely extract people. Tests are realized on a real database of the BOSS European project and are evaluated with the standard F-measure criteria. Since many state-of-the-art methods can be considered in our three first blocks along with many associated parameters, a genetic algorithm is used to automatically find the best methods and parameters of the proposed approach.

[1]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Thierry Chateau,et al.  Vehicle trajectories evaluation by static video sensors , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[4]  Chu-Song Chen,et al.  Moving cast shadow detection using physics-based features , 2009, CVPR.

[5]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[6]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Gerald Schaefer,et al.  Illuminant and device invariant colour using histogram equalisation , 2005, Pattern Recognit..

[8]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[9]  Brian C. Lovell,et al.  Improved Shadow Removal for Robust Person Tracking in Surveillance Scenarios , 2010, 2010 20th International Conference on Pattern Recognition.

[10]  Thierry Bouwmans,et al.  Fuzzy integral for moving object detection , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[11]  Hongxun zhang,et al.  Fusing Color and Texture Features for Background Model , 2006, FSKD.

[12]  Jean-Marc Odobez,et al.  Multi-Layer Background Subtraction Based on Color and Texture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Alessandro Leone,et al.  Shadow detection for moving objects based on texture analysis , 2007, Pattern Recognit..

[14]  Jun-Wei Hsieh,et al.  Shadow elimination for effective moving object detection by Gaussian shadow modeling , 2003, Image Vis. Comput..

[15]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[17]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  M. Sigari,et al.  Fuzzy Running Average and Fuzzy Background Subtraction: Concepts and Application , 2008 .

[19]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[20]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.