SEGMENTATION OF MULTIPLE HUMAN OBJECTS IN VIDEO SEQUENCES

This article presents a method for segmentation of multiple human objects in a video stream. Given the base frame of a video stream, a fuzzy self-clustering technique is used to group similar pixels of the frame into a set of segments. Combinations of segments are checked if candidate face regions can be formed using chrominance values and the face shape feature. The existence of a face within each candidate face region is investigated by searching for possible constellations of eyes-mouth triangles and verifying each eyes-mouth combination based on the predefined template and a set of criteria. By referring to the position and orientation of a face, the corresponding body is found. Then rough foreground and background are formed. Finally, human objects in the base frame and the remaining frames of the video stream are located by a fuzzy neural network, which is trained by a SVD-based hybrid learning algorithm. From experimental results, we have found that our system can locate human objects more accurately and efficiently than other systems.

[1]  Michael G. Strintzis,et al.  Spatiotemporal segmentation and tracking of objects for visualization of videoconference image sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[2]  Roberto Marcondes Cesar Junior,et al.  A wavelet subspace method for real-time face tracking , 2004, Real Time Imaging.

[3]  Yao Wang,et al.  Facial feature extraction and tracking in video sequences , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[4]  Matti Pietikäinen,et al.  Color-based face detection using skin locus model and hierarchical filtering , 2002, Object recognition supported by user interaction for service robots.

[5]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[6]  Jianping Fan,et al.  Automatic image segmentation by integrating color-edge extraction and seeded region growing , 2001, IEEE Trans. Image Process..

[7]  King Ngi Ngan,et al.  Automatic segmentation of moving objects for video object plane generation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[8]  Shie-Jue Lee,et al.  A neuro-fuzzy approach for segmentation of human objects in image sequences , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Wan-Chi Siu,et al.  Extracting Semantic Video Objects , 2001, IEEE Computer Graphics and Applications.

[11]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Sang-Hui Park,et al.  Face Detection Using Template Matching and Ellipse Fitting , 2000 .

[13]  Qian Chen,et al.  Face Detection From Color Images Using a Fuzzy Pattern Matching Method , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Eli Saber,et al.  Frontal-view face detection and facial feature extraction using color, shape and symmetry based cost functions , 1998, Pattern Recognit. Lett..

[15]  Shie-Jue Lee,et al.  A neuro-fuzzy system modeling with self-constructing rule generationand hybrid SVD-based learning , 2003, IEEE Trans. Fuzzy Syst..

[16]  Karim Faez,et al.  An Efficient Feature Extraction Method with Pseudo-Zernike Moment in RBF Neural Network-Based Human Face Recognition System , 2003, EURASIP J. Adv. Signal Process..

[17]  Alain Trémeau,et al.  Regions adjacency graph applied to color image segmentation , 2000, IEEE Trans. Image Process..

[18]  Amir Averbuch,et al.  Automatic segmentation of moving objects in video sequences: a region labeling approach , 2002, IEEE Trans. Circuits Syst. Video Technol..

[19]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Thomas Serre,et al.  Hierarchical classification and feature reduction for fast face detection with support vector machines , 2003, Pattern Recognit..

[21]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[22]  Kin-Man Lam,et al.  An efficient approach for facial feature detection , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[23]  ChangShih-Fu,et al.  A highly efficient system for automatic face region detection in MPEG video , 1997 .

[24]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[25]  Stefanos D. Kollias,et al.  Improving the Performance of MPEG Compatible Encoding at Low Bit Rates Using Adaptive Neural Networks , 2000, Real Time Imaging.

[26]  Shu-Ching Chen,et al.  Spatiotemporal vehicle tracking: the use of unsupervised learning-based segmentation and object tracking , 2005, IEEE Robotics & Automation Magazine.

[27]  Jian-Huang Lai,et al.  GA-fisher: a new LDA-based face recognition algorithm with selection of principal components , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[29]  Se-Young Oh,et al.  Facial feature extraction using PCA and wavelet multi-resolution images , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[30]  Kuo-Chin Fan,et al.  Human face detection using geometric triangle relationship , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.