From events to goals: Supporting semantic interaction in smart environments

When we connect smart devices to one another we open up many new possibilities. One interesting possibility is to support high-level semantic interaction without requiring multiple steps on multiple devices. In this paper we investigate how ontologies, runtime task models, Belief-Desire-Intention (BDI) models, and the blackboard architectural pattern may be used to enable semantic interaction for pervasive computing. An initial demonstrator was developed to visualize and manipulate semantic connections between devices in a smart home environment. The demonstrator provides a way for users to physically interact with devices on a high level of semantic abstraction without being bothered with the low-level details.

[1]  Eila Niemelä,et al.  Agile middleware of pervasive computing environments , 2004, IEEE Annual Conference on Pervasive Computing and Communications Workshops, 2004. Proceedings of the Second.

[2]  Sungyoung Lee,et al.  Developing Context-Aware Ubiquitous Computing Systems with a Unified Middleware Framework , 2004, EUC.

[3]  Matthew Fisher,et al.  Semantic Web Programming , 2009 .

[4]  Ian Oliver,et al.  Personal Semantic Web Through A Space Based Computing Environment , 2008, ArXiv.

[5]  Jean Vanderdonckt,et al.  Comparing Task Models for User Interface Design , 2003 .

[6]  Lmg Loe Feijs.  Commutative product semantics , 2009 .

[7]  Simon A. Dobson,et al.  Ontology-based models in pervasive computing systems , 2007, The Knowledge Engineering Review.

[8]  Philip J. Barnard,et al.  THE HANDBOOK OF TASK ANALYSIS FOR HUMAN-COMPUTER INTERACTION , 2003 .

[9]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[10]  Jun Hu,et al.  Semantic connections: Exploring and manipulating connections in smart spaces , 2010, The IEEE symposium on Computers and Communications.

[11]  Emile H. L. Aarts,et al.  Ambient intelligence: a multimedia perspective , 2004, IEEE MultiMedia.

[12]  David Garlan,et al.  Context is key , 2005, CACM.

[13]  Harry Chen,et al.  SOUPA: standard ontology for ubiquitous and pervasive applications , 2004, The First Annual International Conference on Mobile and Ubiquitous Systems: Networking and Services, 2004. MOBIQUITOUS 2004..

[14]  Jp Tom Djajadiningrat,et al.  Design and semantics of form and movement:DeSForM 2013, 8th International Conference on Design and Semantics of Form and Movement, September 22-25, 2013, Wuxi, China , 2013 .

[15]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[16]  Gerrit C. van der Veer,et al.  An Ontology for Task World Models , 1998, DSV-IS.

[17]  Anand S. Rao,et al.  A profile of the Australian Artificial Intelligence Institute [World Impact] , 1996, IEEE Expert.

[18]  Pattie Maes,et al.  Siftables: towards sensor network user interfaces , 2007, TEI.

[19]  Michael Wooldridge,et al.  The Belief-Desire-Intention Model of Agency , 1998, ATAL.

[20]  S. M. Hansen.  Where the action is. , 1985, Journal (National Association for Hospital Development (U.S.)).

[21]  Charles Rich,et al.  Building Task-Based User Interfaces with ANSI/CEA-2018 , 2009, Computer.