Conversational Homes

—As devices proliferate, the ability for us to interact with them in an intuitive and meaningful way becomes increasingly challenging. In this paper we take the typical home as an exper- imental environment to investigate the challenges and potential solutions arising from ever-increasing device proliferation and complexity. We show a potential solution based on conversational interactions between “things” in the environment where those things can be either machine devices or human users. Our key innovation is the use of a Controlled Natural Language (CNL) technology as the underpinning information representation language for both machine and human agents, enabling humans and machines to trivially “read” the information being exchanged. The core CNL is augmented with a conversational protocol enabling different speech acts to be exchanged within the system. This conversational layer enables key contextual information to be conveyed, as well as providing a mechanism for translation from the core CNL to other forms, such as device specific API requests, or more easily consumable human representations. Our goal is to show that a single, uniform language can support machine- machine, machine-human, human-machine and human-human interaction in a dynamic environment that is able to rapidly evolve to accommodate new devices and capabilities as they are encountered.

[1]  Robert Dale,et al.  The return of the chatbots , 2016, Natural Language Engineering.

[2]  Filippo Menczer,et al.  The rise of social bots , 2014, Commun. ACM.

[3]  Alun D. Preece,et al.  Building a “living database” for human-machine intelligence analysis , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[4]  Lida Xu,et al.  The internet of things: a survey , 2014, Information Systems Frontiers.

[5]  Alun D. Preece,et al.  Conversational sensing , 2014, Sensing Technologies + Applications.

[6]  Tobias Kuhn,et al.  A Survey and Classification of Controlled Natural Languages , 2014, CL.

[7]  Alun D. Preece,et al.  Human-machine conversations to support multi-agency missions , 2014, MOCO.

[8]  Tien Pham,et al.  Controlled English to facilitate human/machine analytical processing , 2013, Defense, Security, and Sensing.

[9]  Michael J. Witbrock,et al.  Conversational Computation , 2013, Handbook of Human Computation.

[10]  Alun D. Preece,et al.  Agilely Assigning Sensing Assets to Mission Tasks in a Coalition Context , 2013, IEEE Intelligent Systems.

[11]  Alun Preece,et al.  Tasking and sharing sensing assets using controlled natural language , 2012, Defense + Commercial Sensing.

[12]  A. Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[13]  Rolf Schwitter,et al.  Controlled Natural Languages for Knowledge Representation , 2010, COLING.

[14]  Michael C. Dorneich,et al.  Hybrid Rationale and Controlled Natural Language for Shared Understanding , 2010 .

[15]  James Hendler,et al.  Layered Controlled Natural Languages , 2009 .

[16]  Alun D. Preece,et al.  The International Technology Alliance in Network and Information Sciences , 2007, IEEE Intelligent Systems.

[17]  Siobhan Chapman Logic and Conversation , 2005 .

[18]  Munindar P. Singh The Practical Handbook of Internet Computing , 2004 .

[19]  Allison Dougherty Garvey,et al.  If This, Then That , 2004 .

[20]  James C. Lester,et al.  Conversational Agents , 2004, The Practical Handbook of Internet Computing.

[21]  M. Chalmers Seamful Design and Ubicomp Infrastructure , 2003 .

[22]  Mark Steedman,et al.  Surface structure, intonation, and discourse meaning , 1993 .

[23]  M. Weiser The Computer for the Twenty-First Century , 1991 .