Using event segmentation to improve indexing of consumer photographs

Automatic albuming --- the automatic organization of photographs, either as an end in itself or for use in other applications -- is an application that promises to be of great assistance to photographers. Relatively sophisticated image content analysis techniques have been used for image indexing, organization and retrieval. In this paper, we describe a method of organizing photographs into events using spoken photograph captions. The results of this process can be used to improve image indexing and retrieval.

[1]  Beth Ann Hockey,et al.  XTAG System - A Wide Coverage Grammar for English , 1994, COLING.

[2]  Jerry R. Hobbs,et al.  FASTUS : Extracting Information from Natural-Language Texts , 1996 .

[3]  M. F. Porter,et al.  An algorithm for suffix stripping , 1997 .

[4]  Nina Wacholder,et al.  Disambiguation of Proper Names in Text , 1997, ANLP.

[5]  Douglas E. Appelt,et al.  FASTUS: A Cascaded Finite-State Transducer for Extracting Information from Natural-Language Text , 1997, ArXiv.

[6]  Sharon Flank,et al.  A Layered Approach to NLP-Based Information Retrieval , 1998, ACL.

[7]  Yorick Wilks,et al.  Information Extraction: Beyond Document Retrieval , 1998, Int. J. Comput. Linguistics Chin. Lang. Process..

[8]  Karen Sparck Jones What is the Role of NLP in Text Retrieval , 1999 .

[9]  Kerry Rodden How Do People Organise Their Photographs? , 1999, BCS-IRSG Annual Colloquium on IR Research.

[10]  Alexander C. Loui,et al.  A software system for automatic albuming of consumer pictures , 1999, MULTIMEDIA '99.

[11]  Marc Moens,et al.  XML Tools And Architecture for Named Entity Recognition , 1999, Markup Lang..

[12]  Lynette Hirschman,et al.  EVALUATING CONTENT EXTRACTION FROM AUDIO SOURCES , 1999 .

[13]  J. C. Platt AutoAlbum: clustering digital photographs using probabilistic model merging , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[14]  Hao Jiang,et al.  Integrating visual, audio and text analysis for news video , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[15]  Andreas E. Savakis,et al.  Automatic image event segmentation and quality screening for albuming applications , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[16]  Amanda Clare,et al.  ANVIL: a System for the Retrieval of Captioned Images using NLP Techniques , 2001 .