A new fuzzy based algorithm for solving stereo vagueness in detecting and tracking people

This paper describes a system capable of detecting and tracking various people using a new approach based on colour, stereo vision and fuzzy logic. Initially, in the people detection phase, two fuzzy systems are used to filter out false positives of a face detector. Then, in the tracking phase, a new fuzzy logic based particle filter (FLPF) is proposed to fuse stereo and colour information assigning different confidence levels to each of these information sources. Information regarding depth and occlusion is used to create these confidence levels. This way, the system is able to keep track of people, in the reference camera image, even when either stereo information or colour information is confusing or not reliable. To carry out the tracking, the new FLPF is used, so that several particles are generated while several fuzzy systems compute the possibility that some of the generated particles correspond to the new position of people. Our technique outperforms two well known tracking approaches, one based on the method from Nummiaro et al. [1] and other based on the Kalman/meanshift tracker method in Comaniciu and Ramesh [2]. All these approaches were tested using several colour-with-distance sequences simulating real life scenarios. The results show that our system is able to keep track of people in most of the situations where other trackers fail, as well as to determine the size of their projections in the camera image. In addition, the method is fast enough for real time applications.

[1]  Euntai Kim,et al.  A new probabilistic fuzzy model: Fuzzification-Maximization (FM) approach , 2009, Int. J. Approx. Reason..

[2]  Costin Barbu,et al.  Fuzzy component based object detection , 2007, Int. J. Approx. Reason..

[3]  Trevor Darrell,et al.  Integrated Person Tracking Using Stereo, Color, and Pattern Detection , 2000, International Journal of Computer Vision.

[4]  S M Mirhassani,et al.  Fuzzy based foreground background discrimination for probabilistic color based object tracking , 2009, 2009 5th IEEE GCC Conference & Exhibition.

[5]  T. Kailath.  The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[6]  Luis Jiménez,et al.  Real-time moving object segmentation in H.264 compressed domain based on approximate reasoning , 2009, Int. J. Approx. Reason..

[7]  Etienne E. Kerre,et al.  Special issue on recent advances in soft computing in image processing , 2009, Int. J. Approx. Reason..

[8]  Isabelle Bloch,et al.  Defining belief functions using mathematical morphology - Application to image fusion under imprecision , 2008, Int. J. Approx. Reason..

[9]  W. Badawy,et al.  Fuzzy logic based particle filter for tracking a maneuverable target , 2005, 48th Midwest Symposium on Circuits and Systems, 2005..

[10]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[11]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[12]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Michael Harville,et al.  Foreground segmentation using adaptive mixture models in color and depth , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[14]  Ronald R. Yager,et al.  Essentials of fuzzy modeling and control , 1994 .

[15]  Dorin Comaniciu,et al.  Mean shift and optimal prediction for efficient object tracking , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[16]  Hiroshi Mizoguchi,et al.  Visual tracking of human back and shoulder for person following robot , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[17]  Vicenç Torra,et al.  A review of the construction of hierarchical fuzzy systems , 2002, Int. J. Intell. Syst..

[18]  Francisco José Madrid-Cuevas,et al.  Multi-camera people tracking using evidential filters , 2009, Int. J. Approx. Reason..

[19]  Suchendra M. Bhandarkar,et al.  Face detection and tracking using a Boosted Adaptive Particle Filter , 2009, J. Vis. Commun. Image Represent..

[20]  James D. Foley,et al.  Fundamentals of interactive computer graphics , 1982 .

[21]  Stanley T. Birchfield,et al.  Elliptical head tracking using intensity gradients and color histograms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[23]  Myo-Taeg Lim,et al.  Fuzzy Adaptive Particle Filter for Localization of a Mobile Robot , 2007, KES.

[24]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[26]  Michael Harville,et al.  Stereo person tracking with adaptive plan-view templates of height and occupancy statistics , 2004, Image Vis. Comput..

[27]  Z. Zenn Bien,et al.  A model-based machine vision system using fuzzy logic , 1997, Int. J. Approx. Reason..

[28]  Christèle Lecomte,et al.  Hierarchical and conditional combination of belief functions induced by visual tracking , 2010, Int. J. Approx. Reason..

[29]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[30]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[31]  Gilles Selleron,et al.  A soft computing-based approach to spatio-temporal prediction , 2009, Int. J. Approx. Reason..

[32]  Rafael Muñoz-Salinas,et al.  People detection and tracking using stereo vision and color , 2007, Image Vis. Comput..

[33]  S. Godsill,et al.  Monte Carlo filtering for multi target tracking and data association , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[34]  Umberto Straccia,et al.  Description logic programs under probabilistic uncertainty and fuzzy vagueness , 2009, Int. J. Approx. Reason..

[35]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Reinhard Koch,et al.  Realtime multi-camera person tracking for immersive environments , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[37]  Zongli Lin,et al.  Fuzzy Particle Filter Used for Tracking of Leukocytes , 2008, 2008 International Symposium on Intelligent Information Technology Application Workshops.

[38]  Yi Sun,et al.  A Particle Filtering and DSmT Based Approach for Conflict Resolving in case of Target Tracking with Multiple Cues , 2010, Journal of Mathematical Imaging and Vision.

[39]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[40]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Neil A. Thacker,et al.  The Bhattacharyya metric as an absolute similarity measure for frequency coded data , 1998, Kybernetika.

[42]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[43]  Alberto Sanfeliu,et al.  3D real-time head tracking fusing color histograms and stereovision , 2002, Object recognition supported by user interaction for service robots.

[44]  Neil J. Gordon,et al.  Bayesian State Estimation for Tracking and Guidance Using the Bootstrap Filter , 1993 .