Porting natural language interfaces between domains: an experimental user study with the ORAKEL system

We present a user-centered model for porting natural language interfaces (NLIs) between domains efficiently. The model assumes that domain experts without any background knowledge about computational linguistics will perform the customization of the NLI to a specific domain. In fact, it merely requires familiarity with the underlying knowledge base as well as with a few basic subcategorization types. Our model is iterative in the sense that the adaption of the NLI is performed in several cycles on the basis of the questions which the NLI failed to answer, thus iteratively increasing the coverage of the system. We provide experimental evidence in form of a user study as well as a case study involving a real-world application corroborating that our model is indeed a feasible way of customizing the interface to a certain domain.

[1]  Richard Montague,et al.  The Proper Treatment of Quantification in Ordinary English , 1973 .

[2]  Gary G. Hendrix,et al.  Developing a natural language interface to complex data , 1977, TODS.

[3]  Frederick B. Thompson,et al.  ASK is transportable in half a dozen ways , 1985, TOIS.

[4]  Douglas E. Appelt,et al.  TEAM: An Experiment in the Design of Transportable Natural-Language Interfaces , 1987, Artif. Intell..

[5]  William C. Ogden Using Natural Language Interfaces , 1988 .

[6]  Aravind K. Joshi,et al.  Parsing Strategies with ‘Lexicalized’ Grammars: Application to Tree Adjoining Grammars , 1988, COLING.

[7]  Madeleine Bates Rapid Porting of the Parlancetm Natural Language Interface , 1989, HLT.

[8]  Karen Spärck Jones,et al.  Natural language interfaces to databases , 1990, The Knowledge Engineering Review.

[9]  Peter Thanisch,et al.  Natural language interfaces to databases – an introduction , 1995, Natural Language Engineering.

[10]  Michael Kifer,et al.  Logical foundations of object-oriented and frame-based languages , 1995, JACM.

[11]  Aravind K. Joshi,et al.  Tree-Adjoining Grammars , 1997, Handbook of Formal Languages.

[12]  Cynthia A. Thompson and Raymond J. Mooney and Lappoon R. Tang,et al.  Learning to Parse Natural Language Database Queries into Logical Form , 1997 .

[13]  Reinhard Muskens,et al.  Talking about Trees and Truth-Conditions , 2001, J. Log. Lang. Inf..

[14]  Nicola Guarino,et al.  WonderWeb Deliverable D18 Ontology Library , 2003 .

[15]  Henry A. Kautz,et al.  Towards a theory of natural language interfaces to databases , 2003, IUI '03.

[16]  Philipp Cimiano ORAKEL: A Natural Language Interface to an F-Logic Knowledge Base , 2004, NLDB.

[17]  Enrico Motta,et al.  AquaLog: An Ontology-Portable Question Answering System for the Semantic Web , 2005, ESWC.

[18]  Abraham Bernstein,et al.  Querying Ontologies: A Controlled English Interface for End-Users , 2005, SEMWEB.

[19]  Francis Jeffry Pelletier,et al.  Representation and Inference for Natural Language: A First Course in Computational Semantics , 2005, Computational Linguistics.

[20]  Uwe Reyle,et al.  Towards Foundational SemanticsOntological Semantics Revisited , 2006 .

[21]  Peter Haase,et al.  Question answering on top of the BT digital library , 2006, WWW '06.

[22]  Uwe Reyle,et al.  Towards Foundational Semantics - Ontological Semantics Revisited , 2006, FOIS.

[23]  Gerold Schneider,et al.  Attempto Controlled English Meets the Challenges of Knowledge Representation, Reasoning, Interoperability and User Interfaces , 2006, FLAIRS.

[24]  Philipp Cimiano,et al.  ORAKEL: A Portable Natural Language Interface to Knowledge Bases , 2007 .

[25]  Berthold Crysmann,et al.  Question answering from structured knowledge sources , 2007, J. Appl. Log..