Natural Language Query Processing in Multimedia Ontologies

In this paper a natural language query interface is developed for semantic and spatio-temporal querying of MPEG-7 based domain ontologies. The underlying ontology is created by attaching domain ontologies to the core Rhizomik MPEG-7 ontology. The user can pose concept, complex concept, spatial, temporal, object trajectory and directional trajectory queries. Furthermore, the system handles the negative meaning in the user query. When the user enters a natural language query, it is parsed with the link parser. According to query type, the objects, attributes, spatial relation, temporal relation, trajectory relation, time filter and time information are extracted from the parser output by using predefined information extraction rules. After the information extraction, SPARQL queries are generated, and executed against the ontology by using an RDF API. The results are used to calculate spatial, temporal, and trajectory relations between objects. The results satisfying the required relations are displayed in a tabular format and the user can navigate through the

[1]  Maneesh Kumar Singh,et al.  State-of-the-art on spatio-temporal information-based video retrieval , 2009, Pattern Recognit..

[2]  Daniel Dominic Sleator,et al.  Parsing English with a Link Grammar , 1995, IWPT.

[3]  Özgür Ulusoy,et al.  BilVideo: A Video Database Management System , 2003, IEEE Multim..

[4]  Chong Wang,et al.  SPARK: Adapting Keyword Query to Semantic Search , 2007, ISWC/ASWC.

[5]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[6]  Vassilis Christophides,et al.  Generating On the Fly Queries for the Semantic Web: The ICS-FORTH Graphical RQL Interface (GRQL) , 2004, SEMWEB.

[7]  Nipun Bhatia,et al.  GuNQ - A Semantic Web Engine with a Keyword Based Query Approach , 2006, AAAI Fall Symposium: Semantic Web for Collaborative Knowledge Acquisition.

[8]  E. Prud hommeaux,et al.  SPARQL query language for RDF , 2011 .

[9]  Kalina Bontcheva,et al.  A Natural Language Query Interface to Structured Information , 2008, ESWC.

[10]  Haofen Wang,et al.  Q2Semantic: A Lightweight Keyword Interface to Semantic Search , 2008, ESWC.

[11]  Zhang Hai-ling Semantic Integration and Retrieval of Multimedia Metadata , 2007 .

[12]  Raphaël Troncy,et al.  MPEG-7 based Multimedia Ontologies: Interoperability Support or Interoperability Issue? , 2007 .

[13]  Orkunt Sabuncu,et al.  An ontology-based retrieval system using semantic indexing , 2010, 2010 IEEE 26th International Conference on Data Engineering Workshops (ICDEW 2010).

[14]  Nihan Kesim Cicekli,et al.  Natural language querying for video databases , 2008, Inf. Sci..

[15]  Tiziana Catarci,et al.  An Ontology Based Visual Tool for Query Formulation Support , 2004, OTM Workshops.

[16]  Marios D. Dikaiakos,et al.  MashQL: a query-by-diagram topping SPARQL , 2008, ONISW '08.

[17]  Nigel Shadbolt,et al.  NITELIGHT: A Graphical Tool for Semantic Query Construction , 2008 .

[18]  Arjohn Kampman,et al.  SeRQL: A Second Generation RDF Query Language , 2003 .

[19]  Enrico Motta,et al.  SemSearch: A Search Engine for the Semantic Web , 2006, EKAW.

[20]  Adnan Yazici,et al.  Spatio-temporal querying in video databases , 2004, Inf. Sci..

[21]  Adnan Yazici,et al.  Spatio-temporal querying in video databases , 2002, Inf. Sci..