Towards Intelligent Content Based Retrieval of Wildlife Videos

In this paper we describe a system that embarks upon the problem of efficient video processing and representation for automatic semantic classification and modelling for indexing and retrieval of large multimedia databases. The major focus of the system is the integration of a large-scale wildlife digital video archive with manually annotated semantic metadata organised in a structured taxonomy and media classification system. Our research challenges the problems of temporal analysis of video, intelligent key-frame extraction and summarisation, animal gait analysis, unsupervised semantic modelling and classification and identification of individual animals. In order to evaluate the system a demonstrator is being developed as a part of the ICBR project within the 3C Research programme of convergent technology research for digital media processing and communications.

[1]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[2]  Marc Davis,et al.  Knowledge Representation for Video , 1994, AAAI.

[3]  Janko Calic,et al.  Automated Visual Recognition of Individual African Penguins , 2004 .

[4]  Svetha Venkatesh,et al.  Computational Media Aesthetics: Finding Meaning Beautiful , 2001, IEEE Multim..

[5]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[6]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[7]  Neill W. Campbell,et al.  Quadruped gait analysis using sparse motion information , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Sion Hannuna,et al.  SEGMENTING QUADRUPED GAIT PATTERNS FROM WILDLIFE VIDEO , 2005 .

[9]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[10]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[11]  Janko Calic,et al.  Spatial analysis in key-frame extraction using video segmentation , 2004 .

[12]  Janko Calic,et al.  Efficient key-frame extraction and video analysis , 2002, Proceedings. International Conference on Information Technology: Coding and Computing.

[13]  Andreas Girgensohn,et al.  Time-Constrained Keyframe Selection Technique , 2004, Multimedia Tools and Applications.

[14]  Majid Mirmehdi,et al.  ICBR - Multimedia Management System for Intelligent Content Based Retrieval , 2004, CIVR.

[15]  Majid Mirmehdi,et al.  Temporal video segmentation and classification of edit effects , 2003, Image Vis. Comput..

[16]  Janko Calic,et al.  Tracking Animals in Wildlife Videos Using Face Detection , 2004, EWIMT.

[17]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[18]  Brendan J. Frey,et al.  Probabilistic multimedia objects (multijects): a novel approach to video indexing and retrieval in multimedia systems , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).