Costume: a new feature for automatic video content indexing

This paper deals with the introduction of costume as a new feature for automatic video content indexing. We present in this paper an application of person recognition using costumes, in order to show the relevance of costume for indexation. The recognition is carried out by extracting the costume of all the persons who appear in the video. Then, their reappearance in subsequent frames is performed by searching the reappearance of their costume. The human presence is detected by searching faces, and then a feature for costume is extracted according to the scale and the location of each face. The Bhattacharyya coefficient, which is a coefficient derived from the Bayes error, is used to compare the color distribution of the various costumes. Finally, some results of people recognition are presented, as well as different axes for further research.

[1]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[2]  Earl E. Swartzlander,et al.  Introduction to Mathematical Techniques in Pattern Recognition , 1973 .

[3]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[4]  William K. Pratt,et al.  Digital image processing (2nd ed.) , 1991 .

[5]  Frank-Michael Nack,et al.  AUTEUR : the application of video semantics and theme representation for automated film editing , 1996 .

[6]  Steve McLaughlin,et al.  Comparative study of textural analysis techniques to characterise tissue from intravascular ultrasound , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[7]  Neil A. Thacker,et al.  The Bhattacharyya metric as an absolute similarity measure for frequency coded data , 1998, Kybernetika.

[8]  Cordelia Schmid,et al.  Face detection in a video sequence - a temporal approach , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[11]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[13]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[15]  Alain Crouzil,et al.  Non-rigid object localization from color model using mean shift , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[16]  Joonki Paik,et al.  Color active shape models for tracking non-rigid objects , 2003, Pattern Recognit. Lett..

[17]  Itheri Yahiaoui.  Construction automatique de résumés vidéos , 2003 .

[18]  Charay Lerdsudwichai,et al.  Algorithm for multiple faces tracking , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[19]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[21]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[22]  Marcel Worring,et al.  Multimodal Video Indexing : A Review of the State-ofthe-art , 2001 .

[23]  Marcel Worring,et al.  Multimedia Event-Based Video Indexing: A Review of the State-of-the-art , 2005 .