Improving habitability of natural language interfaces for querying ontologies with feedback and clarification dialogues

Abstract Natural Language Interfaces (NLIs) are a viable, human-readable alternative to complex, formal query languages like SPARQL, which are typically used for accessing semantically structured data (e.g. RDF and OWL repositories). However, in order to cope with natural language ambiguities, NLIs typically support a more restricted language. A major challenge when designing such restricted languages is habitability–how easily, naturally and effectively users can use the language to express themselves within the constraints imposed by the system. In this paper, we investigate two methods for improving the habitability of a Natural Language Interface: feedback and clarification dialogues. We model feedback by showing the user how the system interprets the query, thus suggesting repair through query reformulation. Next, we investigate how clarification dialogues can be used to control the query interpretations generated by the system. To reduce the cognitive overhead, clarification dialogues are coupled with a learning mechanism. Both methods are shown to have a positive effect on the overall performance and habitability.

[1]  Raymond J. Mooney,et al.  Using Multiple Clause Constructors in Inductive Logic Programming for Semantic Parsing , 2001, ECML.

[2]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[3]  Sanda M. Harabagiu,et al.  Advances in Open Domain Question Answering , 2007 .

[4]  Abraham Bernstein,et al.  Querix: A Natural Language Interface to Query Ontologies Based on Clarification Dialogs , 2006 .

[5]  Kalina Bontcheva,et al.  Transition of legacy systems to semantically enabled applications: TAO method and tools , 2012, Semantic Web.

[6]  Hamish Cunningham,et al.  Identification of the Question Focus: Combining Syntactic Analysis and Ontology-based Lookup through the User Interaction , 2010, LREC.

[7]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[8]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[9]  William C. Ogden Using Natural Language Interfaces , 1988 .

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  Philipp Cimiano,et al.  Porting natural language interfaces between domains: an experimental user study with the ORAKEL system , 2007, IUI '07.

[12]  Douglas E. Appelt,et al.  TEAM: An Experiment in the Design of Transportable Natural-Language Interfaces , 1987, Artif. Intell..

[13]  Enrico Motta,et al.  Cross ontology query answering on the semantic web: an initial evaluation , 2009, K-CAP '09.

[14]  Hamish Cunningham,et al.  Natural Language Interfaces to Ontologies: Combining Syntactic Analysis and Ontology-Based Lookup through the User Interaction , 2010, ESWC.

[15]  Enrico Motta,et al.  AquaLog: An ontology-driven question answering system for organizational semantic intranets , 2007, J. Web Semant..

[16]  Kalina Bontcheva,et al.  Adapting SVM for data sparseness and imbalance: a case study in information extraction , 2009, Natural Language Engineering.

[17]  Nenad Stojanovic,et al.  On the query refinement in the ontology-based searching for information , 2005, Inf. Syst..

[18]  Josef Ruppenhofer,et al.  FrameNet II: Extended theory and practice , 2006 .

[19]  Samuel S. Epstein,et al.  Transportable natural language processing through simplicity—the PRE system , 1985, TOIS.

[20]  Brian M. Slator,et al.  Pygmalion at the interface , 1986, CACM.

[21]  Elizabeth Zoltan-Ford,et al.  Reducing Variability in Natural-Language Interactions with Computers , 1984 .

[22]  Abraham Bernstein,et al.  Evaluating semantic search tools using the SEALS Platform , 2010, IWEST@ISWC.

[23]  Enrico Motta,et al.  PowerAqua: Fishing the Semantic Web , 2006, ESWC.

[24]  Erik F. Tjong Kim Sang,et al.  Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition , 2003, CoNLL.

[25]  Kenneth Ward Church,et al.  Coping with Syntactic Ambiguity or How to Put the Block in the Box on the Table , 1982, CL.

[26]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[27]  Hamish Cunningham,et al.  FREyA: An Interactive Way of Querying Linked Data Using Natural Language , 2011, ESWC Workshops.

[28]  Paul Thompson,et al.  Finding Out About: A Cognitive Perspective on Search Engine Technology and the WWW , 2002, Information Retrieval.

[29]  Chong Wang,et al.  PANTO: A Portable Natural Language Interface to Ontologies , 2007, ESWC.

[30]  James E. McDonald,et al.  Habitability In Question-Answering Systems , 2008 .

[31]  Abraham Bernstein,et al.  GINO - A Guided Input Natural Language Ontology Editor , 2006, SEMWEB.

[32]  Kalina Bontcheva,et al.  A Text-based Query Interface to OWL Ontologies , 2008, LREC.

[33]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[34]  Enrico Motta,et al.  The usability of semantic search tools: a review , 2007, The Knowledge Engineering Review.

[35]  Dan Klein,et al.  Fast Exact Inference with a Factored Model for Natural Language Parsing , 2002, NIPS.

[36]  David Frohlich,et al.  Management of repair in human-computer interaction , 1994 .