A neural approach to extract foreground from human movement images

In recent years many approaches to foreground extraction from images related to human movement have been presented. The foreground extraction represents a pre-processing procedure to be implemented in a system for capturing human movement in order to facilitate the tracking of anatomical landmarks on human bodies. In this work, an approach based on an unsupervised neural network has been studied: a Kohonen map has been designed to recognize and separate structures characterizing foreground and background. The proposed technique is fully automatic and its performance has been compared with those of two further approaches based on differences between foreground and background images. In order to quantify the segmentation quality, an already validated, objective, and automatic criterion has been used. The obtained results are adequate with the final aim of the application and show the feasibility of the proposed approach.

[1]  Jan J. Gerbrands,et al.  Three-dimensional image segmentation using a split, merge and group approach , 1991, Pattern Recognit. Lett..

[2]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[4]  Helge J. Ritter,et al.  Adaptive color segmentation-a comparison of neural and statistical methods , 1997, IEEE Trans. Neural Networks.

[5]  Fernando Pereira,et al.  Stand-Alone Objective Segmentation Quality Evaluation , 2002, EURASIP J. Adv. Signal Process..

[6]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[7]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[8]  Alexandre R. J. François,et al.  Adaptive Color Background Modeling for Real-Time Segmentation of Video Streams* , 1999 .

[9]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[10]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[11]  Fernando Pereira,et al.  Objective evaluation of video segmentation quality , 2003, IEEE Trans. Image Process..

[12]  Matti Pietikäinen,et al.  Accurate color discrimination with classification based on feature distributions , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[13]  Minoru Asada,et al.  MDL-based spatiotemporal segmentation from motion in a long image sequence , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Suchendra M. Bhandarkar,et al.  A multi-layer Kohonen's self-organizing feature map for range image segmentation , 1993, IEEE International Conference on Neural Networks.

[15]  Mohan M. Trivedi,et al.  Low-Level Segmentation of Aerial Images with Fuzzy Clustering , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  Marco Carli,et al.  Fast Hybrid Technique for Colour Image Segmentation , 2001 .

[17]  Gerhard Rigoll,et al.  Person tracking in real-world scenarios using statistical methods , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[18]  Bir Bhanu,et al.  Adaptive integrated image segmentation and object recognition , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[19]  Fernando Pereira,et al.  Objective evaluation of relative segmentation quality , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[20]  Trevor Darrell,et al.  A novel environment for situated vision and behavior , 1994 .

[21]  Masanobu Yamamoto,et al.  Human motion analysis based on a robot arm model , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Masanori Yamada,et al.  A new robust real-time method for extracting human silhouettes from color images , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[23]  Atsushi Nakazawa,et al.  Human tracking using distributed vision systems , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[24]  Jens-Rainer Ohm,et al.  Feature-based cluster segmentation of image sequences , 1997, Proceedings of International Conference on Image Processing.

[25]  He Xu,et al.  Textured image segmentation using autoregressive model and artificial neural network , 1995, Pattern Recognit..

[26]  Masahiko Yachida,et al.  Posture estimation using structure and motion models , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[27]  C. Liedtke,et al.  Segmentation of microscopic cell scenes. , 1987, Analytical and quantitative cytology and histology.

[28]  He Xu,et al.  Textured image segmentation using autoregressive model and artificial neural network , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[29]  Jack Bryant,et al.  On the clustering of multidimensional pictorial data , 1979, Pattern Recognit..

[30]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[31]  Stephen J. McKenna,et al.  Tracking interacting people , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[32]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[33]  Ricardo M. L. Barros,et al.  A flexible software for tracking of markers used in human motion analysis , 2003, Comput. Methods Programs Biomed..

[34]  King-Sun Fu,et al.  A survey on image segmentation , 1981, Pattern Recognit..

[35]  W. A. Perkins,et al.  Area Segmentation of Images Using Edge Points , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Neill W. Campbell,et al.  Automatic Segmentation and Classification of Outdoor Images Using Neural Networks , 1997, Int. J. Neural Syst..

[37]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory, Third Edition , 1989, Springer Series in Information Sciences.

[38]  Y. J. Zhang,et al.  A survey on evaluation methods for image segmentation , 1996, Pattern Recognit..