Video shot classification using human faces

People usually make up a lot of the information content in videos. The abilities to answer queries and facilitate browsing related to people in videos are crucial. In a single video sequence, a particular person may appear multiple number of times. We propose a scheme to automatically detect the repeated occurrences of the same people to enable fast people related searching. In particular, we propose a video shot classification scheme using human faces, regardless of scale and background. Video shots are classified by clustering facial features extracted from these shots. Potential applications include video indexing and browsing. Employing unsupervised clustering algorithms, this scheme requires no human intervention. Experimental results on a 4-minute news sequence show that it achieves encouraging results.

[1]  K. Selçuk Candan,et al.  The Advanced Video Information System: data structures and query processing , 1996, Multimedia Systems.

[2]  Boon-Lock Yeo,et al.  Video browsing using clustering and scene transitions on compressed sequences , 1995, Electronic Imaging.

[3]  Mourad Cherfaoui,et al.  Two-stage strategy for indexing and presenting video , 1994, Electronic Imaging.

[4]  Sun-Yuan Kung,et al.  A probabilistic decision-based neural network for locating deformable objects and its applications to surveillance system and video browsing , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[5]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.