Semantic connections: Exploring and manipulating connections in smart spaces

In envisioned smart environments, enabled by ubiquitous computing technologies, electronic objects will be able to interconnect and interoperate. How will users of such smart environments make sense of the connections that are made and the information that is exchanged? This Internet of Things could have a life of its own, exchanging digital concepts and values between its members, having an understanding of each other and communicating in their own language. In this paper we report on an ongoing research project in the context of smart home environments. We discuss possibilities to represent this digital world in the physical reality we live in, by providing handles to control and clues to understand, build conceptual models of connections that exist or can be made. This is achieved by making semantic abstractions of low-level events and presenting them to users at a higher level, in a simplified fashion. Furthermore, we used an ontology to describe the low-level events, and used reasoning to infer high-level meaningful information. Although we are in the preliminary stages of our research, we consider it worthwhile to share and illustrate our findings by presenting a demonstrator, that implements our ideas in a home entertainment scenario.

[1]  Pattie Maes,et al.  Siftables: towards sensor network user interfaces , 2007, TEI.

[2]  Ki-Won Yeom,et al.  Select-and-point: a novel interface for multi-device connection and control based on simple hand gestures , 2008, CHI Extended Abstracts.

[3]  Lars Erik Holmquist,et al.  Token-Based Acces to Digital Information , 1999, HUC.

[4]  Emile H. L. Aarts,et al.  The New Everyday: Views on Ambient Intelligence , 2003 .

[5]  K. Krippendorff The Semantic Turn: A New Foundation For Design , 2005 .

[6]  Lmg Loe Feijs Commutative product semantics , 2009 .

[7]  Jp Tom Djajadiningrat,et al.  Design and semantics of form and movement:DeSForM 2013, 8th International Conference on Design and Semantics of Form and Movement, September 22-25, 2013, Wuxi, China , 2013 .

[8]  Jun Rekimoto,et al.  tranSticks: physically manipulatable virtual connections , 2005, CHI.

[9]  Jun Rekimoto,et al.  Proximal Interactions: A Direct Manipulation Technique for Wireless Networking , 2003, INTERACT.

[10]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[11]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[12]  Judith Hills,et al.  The semantic turn: A new foundation for design , 2008 .

[13]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[14]  Jun Hu,et al.  From events to goals: Supporting semantic interaction in smart environments , 2010, The IEEE symposium on Computers and Communications.