Extracting relational facts for indexing and retrieval of crime-scene photographs

This paper presents work on text-based photograph indexing and retrieval for crime investigation, an application domain where efficient querying of large crime-scene photograph databases is of crucial importance. Automating this task will change current police practices considerably, by bringing 'intelligence' to crime support information systems. The prototype presented, goes beyond common approaches to the automation of image indexing and retrieval, by applying a novel method that captures deep semantic relations expressed in the captions that accompany crime-scene photographs. The extraction of these semantic triples is based on advanced knowledge-based Natural Language Processing technologies and resources.

[1]  Vasileios Hatzivassiloglou,et al.  Text-Based Approaches for the Categorization of Images , 1999, ECDL.

[2]  Amanda Clare,et al.  ANVIL: a System for the Retrieval of Captioned Images using NLP Techniques , 2001 .

[3]  Neil C. Rowe,et al.  Natural-language retrieval of images based on descriptive captions , 1996, TOIS.

[4]  Ellen Riloff,et al.  Extraction-based Text Categorization: Generating Domain-specific Role Relationships , 1999 .

[5]  Ellen M. Voorhees,et al.  Using WordNet to disambiguate word senses for text retrieval , 1993, SIGIR.

[6]  Remco C. Veltkamp,et al.  Content-based image retrieval systems: A survey , 2000 .

[7]  Ellen Riloff,et al.  Little words can make a big difference for text classification , 1995, SIGIR '95.

[8]  Yorick Wilks,et al.  SOCIS: Scene of Crime Information System - IGR Review Report , 2003 .

[9]  Chris Mellish,et al.  Natural Language Processing in PROLOG , 1989 .

[10]  Lucy Vanderwende,et al.  MindNet: Acquiring and Structuring Semantic Information from Text , 1998, COLING-ACL.

[11]  Alan F. Smeaton,et al.  Experiments on using semantic distances between words in image caption retrieval , 1996, SIGIR '96.

[12]  Alan F. Smeaton,et al.  Experiments on incorporating syntactic processing of user queries into a document retrieval strategy , 1988, SIGIR '88.

[13]  Kevin Humphreys,et al.  XI: A Simple Prolog-based Language for Cross-Classification and Inheritance , 1996 .

[14]  Neil C. Rowe,et al.  Precise and Efficient Retrieval of Captioned Images: The MARIE Project , 1999, Libr. Trends.

[15]  Mark Hepple,et al.  Independence and Commitment: Assumptions for Rapid Training and Execution of Rule-based POS Taggers , 2000, ACL.

[16]  M.McGee Wood,et al.  Natural language processing in Prolog , 1990 .