A Middleware for Implicit Interaction

Achieving intuitive and seamless interaction with computational artifacts remains a cherished objective for HCI professionals. Many have a vested interest in the achievement of this objective as usability remains a formidable barrier to the acceptance of technology in many domains and by various groups within the general population. Indeed, the potential of computing in its diverse manifestations will not be realized fully until such time as communication between humans and computational objects can occur transparently and instinctively in all instances. One step towards achieving this is to harness the various cues that people normally use when communicating as such cues augment and enrich the communication act. Implicit interaction offers a model by which this may be understood and realized; however, implementing a solution that effectively harnesses implicit interaction is problematic. This chapter presents an intelligent middleware framework as a means for harnessing the disparate data sources necessary for capturing and interpreting implicit interaction events.

[1]  Jadwiga Indulska,et al.  Modelling and using imperfect context information , 2004, IEEE Annual Conference on Pervasive Computing and Communications Workshops, 2004. Proceedings of the Second.

[2]  Robin R. Murphy,et al.  Comparison of Bayesian and Dempster-Shafer theory for sensing: a practitioner's approach , 1993, Optics & Photonics.

[3]  Gregory M. P. O'Hare,et al.  Mobile agents for mobile tourists: a user evaluation of Gulliver's Genie , 2005, Interact. Comput..

[4]  Paddy Nixon,et al.  An Overview of Pervasive Computing Systems , 2008 .

[5]  Saul Greenberg,et al.  Context as a Dynamic Construct , 2001, Hum. Comput. Interact..

[6]  R.B. Smith,et al.  SPOTWorld and the Sun SPOT , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[7]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[8]  Roy H. Campbell,et al.  An infrastructure for context-awareness based on first order logic , 2003, Personal and Ubiquitous Computing.

[9]  Young-Koo Lee,et al.  Modeling uncertainty in context-aware computing , 2005, Fourth Annual ACIS International Conference on Computer and Information Science (ICIS'05).

[10]  Hung Keng Pung,et al.  A BAYESIAN APPROACH FOR DEALING WITH UNCERTAIN CONTEXTS , 2004 .

[11]  Richard Tynan,et al.  Agency, Ambience, Assistance: A Framework for Practical AAL , 2010, ISAmI.

[12]  Manfred Tscheligi,et al.  Trends in the Living Room and Beyond , 2007, EuroITV.

[13]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[14]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[15]  Patrycja Ciosek,et al.  Sensor arrays for liquid sensing--electronic tongue systems. , 2007, The Analyst.

[16]  Seng Wai Loke.  Representing and reasoning with situations for context-aware pervasive computing: a logic programming perspective , 2004, Knowl. Eng. Rev..

[17]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[18]  Gregory M. P. O'Hare,et al.  Towards Pervasive Intelligence: Reflections on the Evolution of the Agent Factory Framework , 2009, Multi-Agent Programming, Languages, Tools and Applications.

[19]  Michael Johnston,et al.  Finite-state multimodal integration and understanding , 2005, Natural Language Engineering.

[20]  Juan Ye,et al.  Resolving Uncertainty in Context Integration and Abstraction , 2008 .

[21]  Sigeru Omatu,et al.  Classifying smokes using an electronic nose and neural networks , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[22]  Harry Chen,et al.  An ontology for context-aware pervasive computing environments , 2003, The Knowledge Engineering Review.

[23]  Ahmet M. Kondoz,et al.  Runtime middleware for the generation of adaptive user interfaces on resource-constrained devices , 2008, 2008 Third International Conference on Digital Information Management.

[24]  Brendan O'Flynn,et al.  The CLARITY Modular Ambient Health and Wellness Measurement Platform , 2010, 2010 Fourth International Conference on Sensor Technologies and Applications.

[25]  Oriana Riva,et al.  Challenges and Lessons in Developing Middleware on Smart Phones , 2008, Computer.

[26]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[27]  Jadwiga Indulska,et al.  Developing context-aware pervasive computing applications: Models and approach , 2006, Pervasive Mob. Comput..

[28]  Z. Obrenovic,et al.  Modeling multimodal human-computer interaction , 2004, Computer.

[29]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[30]  Gregory M. P. O'Hare,et al.  Addressing Mobile HCI Needs through Agents , 2002, Mobile HCI.

[31]  John F. Bradley,et al.  Embedded agents: a paradigm for mobile services , 2006, Int. J. Web Grid Serv..

[32]  Simon A. Dobson,et al.  Ontology-based models in pervasive computing systems , 2007, The Knowledge Engineering Review.

[33]  Gregory M. P. O'Hare,et al.  Easishop: Ambient intelligence assists everyday shopping , 2008, Inf. Sci..

[34]  Juan Ye,et al.  Using Situation Lattices to Model and Reason about Context , 2007 .

[35]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[36]  Jukka Riekki,et al.  Middleware support for implementing context-aware multimodal user interfaces , 2004, MUM '04.

[37]  Ricardo Costa,et al.  Ambient Assisted Living , 2009 .

[38]  Hani Hagras,et al.  Creating an ambient-intelligence environment using embedded agents , 2004, IEEE Intelligent Systems.

[39]  Simon A. Dobson,et al.  Resolving uncertainty in context integration and abstraction: context integration and abstraction , 2008, ICPS '08.

[40]  N. Ambady,et al.  Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. , 1992 .

[41]  Chenyang Lu,et al.  Mobile agent middleware for sensor networks: an application case study , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[42]  Gregory D. Abowd,et al.  Human-Computer Interaction (3rd Edition) , 2003 .

[43]  Albrecht Schmidt,et al.  Implicit human computer interaction through context , 2000, Personal Technologies.

[44]  Roy H. Campbell,et al.  Reasoning about Uncertain Contexts in Pervasive Computing Environments , 2004, IEEE Pervasive Comput..

[45]  M. Argyle,et al.  The Communication of Inferior and Superior Attitudes by Verbal and Non‐verbal Signals* , 1970 .

[46]  Philip A. Bernstein,et al.  Middleware: a model for distributed system services , 1996, CACM.

[47]  Yun Peng,et al.  A probabilistic extension to ontology language OWL , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[48]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[49]  Sharon Oviatt,et al.  Multimodal interactive maps: designing for human performance , 1997 .

[50]  Waltenegus Dargie,et al.  The Role of Probabilistic Schemes in Multisensor Context-Awareness , 2007, Fifth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PerComW'07).

[51]  Stathes Hadjiefthymiades,et al.  Situational computing: An innovative architecture with imprecise reasoning , 2007, J. Syst. Softw..

[52]  Anind K. Dey.  Modeling and intelligibility in ambient environments , 2009, J. Ambient Intell. Smart Environ..

[53]  Nicu Sebe,et al.  Multimodal interfaces: Challenges and perspectives , 2009, J. Ambient Intell. Smart Environ..