A Discourse and Dialogue Infrastructure for Industrial Dissemination

We think that modern speech dialogue systems need a prior usability analysis to identify the requirements for industrial applications. In addition, work from the area of the Semantic Web should be integrated. These requirements can then be met by multimodal semantic processing, semantic navigation, interactive semantic mediation, user adaptation/personalisation, interactive service composition, and semantic output representation which we will explain in this paper. We will also describe the discourse and dialogue infrastructure these components develop and provide two examples of disseminated industrial prototypes.

[1]  Alex Pentland,et al.  Artifical Intelligence for Human Computing, ICMI 2006 and IJCAI 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers , 2007, Artifical Intelligence for Human Computing.

[2]  Ilango Krishnamurthi,et al.  NLION: Natural Language Interface for querying ONtologies , 2009, COMPUTE '09.

[3]  Wolfgang Wahlster,et al.  SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell , 2003 .

[4]  Daniel Sonntag,et al.  Design and Implementation of Combined Mobile and Touchscreen-based Multimodal Web 3.0 Interfaces , 2009, IC-AI.

[5]  James F. Allen,et al.  An architecture for a generic dialogue shell , 2000, Natural Language Engineering.

[6]  Joseph Polifroni,et al.  Organization, communication, and control in the GALAXY-II conversational system , 1999, EUROSPEECH.

[7]  Enrico Motta,et al.  AquaLog: An Ontology-Portable Question Answering System for the Semantic Web , 2005, ESWC.

[8]  Anthony Jameson,et al.  Introduction to the Special Issue on "Usable AI" , 2009, AI Mag..

[9]  Sebastian Rudolph,et al.  Foundations of Semantic Web Technologies , 2009 .

[10]  Ashwani Kumar,et al.  Miamm — A Multimodal Dialogue System Using Haptics , 2005 .

[11]  Douglas B. Moran,et al.  The Open Agent Architecture: A Framework for Building Distributed Software Systems , 1999, Appl. Artif. Intell..

[12]  Roberto Boselli,et al.  Semantic Navigation through Multiple Topic Ontologies , 2005, SWAP.

[13]  Lora Aroyo,et al.  The Semantic Web: Research and Applications , 2009, Lecture Notes in Computer Science.

[14]  Daniel Sonntag,et al.  Ontologies and Adaptivity in Dialogue for Question Answering , 2010, Studies on the Semantic Web.

[15]  Norbert Reithinger,et al.  An integration framework for a mobile multimodal dialogue system accessing the semantic web , 2005, INTERSPEECH.

[16]  Philipp Cimiano,et al.  Porting natural language interfaces between domains: an experimental user study with the ORAKEL system , 2007, IUI '07.

[17]  Haofen Wang,et al.  Top-k Exploration of Query Candidates for Efficient Keyword Search on Graph-Shaped (RDF) Data , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[18]  Roberto Pieraccini,et al.  Where do we go from here? Research and Commercial Spoken Dialog Systems , 2005, SIGDIAL.

[19]  Daniel Sonntag.  Towards Dialogue-based Interactive Semantic Mediation in the Medical Domain , 2008, OM.

[20]  Norbert Reithinger,et al.  SmartWeb Handheld - Multimodal Interaction with Ontological Knowledge Bases and Semantic Web Services , 2007, Artifical Intelligence for Human Computing.

[21]  Ralf Engel.  SPIN : A Semantic Parser for Spoken Dialog Systems , 2006 .

[22]  Sharon L. Oviatt,et al.  Ten myths of multimodal interaction , 1999, Commun. ACM.

[23]  F. Hall,et al.  The radiology report of the future. , 2009, Radiology.

[24]  Gobinda G. Chowdhury,et al.  Spinning the Semantic Web: Bringing the World Wide Web to Its Full Potential , 2004 .

[25]  Hans Uszkoreit,et al.  Introduction to this Special Issue , 2000, Natural Language Engineering.

[26]  J. V. Kuppevelt,et al.  Advances in natural multimodal dialogue systems , 2005 .

[27]  David L Weiss,et al.  Structured reporting: patient care enhancement or productivity nightmare? , 2008, Radiology.

[28]  Norbert Pfleger,et al.  FADE-An Integrated Approach to Multimodal Fusion and Discourse Processing , 2005 .

[29]  Daniel Sonntag,et al.  Unifying Semantic Annotation and Querying in Biomedical Image Repositories - One Solution for Two Problems of Medical Knowledge Engineering , 2009, KMIS.

[30]  Daniel Sonntag,et al.  A Multimodal Mobile B2B Dialogue Interface on the iPhone , 2009 .