Using Contextual Knowledge to Resume Human-Agent Conversations when Programming the Intelligence of Smart Environments

This paper presents a hybrid technical solution towards addressing conversational interruptions when interacting (via a typed interface) with a virtual agent to program the intelligence of a smart environment. The AmI Solertis system is a ubiquitous programming environment that facilitates the definition of the behavior of a Smart Environment. To address the issue above, Ami Solertis introduces a mechanism that stores any unexpectedly interrupted conversations in a stack along with relevant contextual information. This context-sensitive information attached to the dialog, is used to re-establish a detailed context in the user’s working memory when resuming human-agent conversations, within.

[1]  P. J. Landin The Mechanical Evaluation of Expressions , 1964, Comput. J..

[2]  Rachel Hinman The Mobile Frontier , 2012 .

[3]  Jerome R. Bellegarda,et al.  Spoken Language Understanding for Natural Interaction: The Siri Experience , 2012, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[4]  HENRY LIEBERMAN,et al.  End-User Development: An Emerging Paradigm , 2006, End User Development.

[5]  Eric Atwell,et al.  Chatbots: Are they Really Useful? , 2007, LDV Forum.

[6]  Valery Sklyarov Hierarchical finite-state machines and their use for digital control , 1999, IEEE Trans. Very Large Scale Integr. Syst..

[7]  Diane J. Cook,et al.  Author's Personal Copy Pervasive and Mobile Computing Ambient Intelligence: Technologies, Applications, and Opportunities , 2022 .

[8]  Naoyuki Kanda,et al.  A two-layer model for behavior and dialogue planning in conversational service robots , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Constantine Stephanidis,et al.  Enabling Programmability of Smart Learning Environments by Teachers , 2015, HCI.

[10]  Geoffrey Zweig,et al.  Fast and easy language understanding for dialog systems with Microsoft Language Understanding Intelligent Service (LUIS) , 2015, SIGDIAL Conference.

[11]  Renée Chlopan There's No Place Like . . . . , 2012 .

[12]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[13]  Christine Julien,et al.  The case for end-user programming of ubiquitous computing environments , 2010, FoSER '10.

[14]  Nathaniel S. Borenstein,et al.  Multipurpose Internet Mail Extensions (MIME) Part Two: Media Types , 1996, RFC.

[15]  R. Lazarus,et al.  Comparison of two modes of stress measurement: Daily hassles and uplifts versus major life events , 1981, Journal of Behavioral Medicine.

[16]  Steve Krug,et al.  Don't Make Me Think!: A Common Sense Approach to Web Usability , 2000 .

[17]  Andreas Stolcke,et al.  Dialogue act modeling for automatic tagging and recognition of conversational speech , 2000, CL.