Sensing Opportunities for Physical Interaction

Today’s technology offers a wide variety of sensors. Although many sensing applications have been produced, there is no support for the design of applications offering physical interaction. In order to make a step towards such a design framework this paper analyzes different means of sensing of humans and human activity. In particular we identify six sensing goals, referred to dimensions of sensing: ID (1), Object Use (2), Location (3), Bio Signs/Emotions (4), Activity (5) and Interaction among humans (6). Those dimensions together with different sensor placements are used to review and analyze ubiquitous computing research related to physical interaction and sensing. The final discussion draws conclusions from this analysis with respect to appropriateness of sensors and sensor placement for different sensing dimensions.

[1]  R.M. White,et al.  A Sensor Classification Scheme , 1987, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[2]  Gaetano Borriello,et al.  Labscape: A Smart Environment for the Cell Biology Laboratory , 2002, IEEE Pervasive Comput..

[3]  Albrecht Schmidt,et al.  Applying wearable sensors to avalanche rescue , 2003, Comput. Graph..

[4]  Florian Michahelles,et al.  Proactive Instructions for Furniture Assembly , 2002, UbiComp.

[5]  Petteri Alahuhta,et al.  Location Estimation Indoors by Means of Small Computing Power Devices, Accelerometers, Magnetic Sensors, and Map Knowledge , 2002, Pervasive.

[6]  Gregory D. Abowd,et al.  The context toolkit: aiding the development of context-enabled applications , 1999, CHI '99.

[7]  Andy Hopper,et al.  The active badge location system , 1992, TOIS.

[8]  Andy Hopper,et al.  A ubiquitous, personalized computing environment for all: Teleporting in an X Window System Environment , 1994, IEEE Personal Communications.

[9]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Gaetano Borriello,et al.  Location Systems for Ubiquitous Computing , 2001, Computer.

[11]  Paul Lukowicz,et al.  WearNET: A Distributed Multi-sensor System for Context Aware Wearables , 2002, UbiComp.

[12]  Jonathan Klein,et al.  Computers that recognise and respond to user emotion: theoretical and practical implications , 2002, Interact. Comput..

[13]  Barry Brumitt,et al.  EasyLiving: Technologies for Intelligent Environments , 2000, HUC.

[14]  Karl Ernst Osthaus.  Van de Velde , 1920 .

[15]  Paul Lukowicz,et al.  Wearable Sensing to Annotate Meeting Recordings , 2002, SEMWEB.

[16]  James Church,et al.  Wearable sensor badge and sensor jacket for context awareness , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[17]  Jun Rekimoto,et al.  Tilting operations for small screen interfaces , 1996, UIST '96.

[18]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[19]  Anil K. Jain,et al.  Biometric Systems: Technology, Design and Performance Evaluation , 2004 .

[20]  Rosalind W. Picard,et al.  Modeling drivers' speech under stress , 2003, Speech Commun..

[21]  Kristof Van Laerhoven,et al.  Real-time analysis of data from many sensors with neural networks , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[22]  Wendy S. Ark,et al.  The Emotion Mouse , 1999, HCI.

[23]  Andreas Butz,et al.  User acceptance of a decision-theoretic location-aware shopping guide , 2002, IUI '02.

[24]  Andy Hopper,et al.  Teleporting in an X Window System Environment , 1994 .

[25]  Albrecht Schmidt,et al.  Advanced Interaction in Context , 1999, HUC.

[26]  Rosalind W. Picard,et al.  Expression glasses: a wearable device for facial expression recognition , 1999, CHI Extended Abstracts.

[27]  Albrecht Schmidt,et al.  Context Acquisition Based on Load Sensing , 2002, UbiComp.

[28]  Trevor Darrell,et al.  Plan-view trajectory estimation with dense stereo background models , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[29]  Albrecht Schmidt,et al.  Implicit human computer interaction through context , 2000, Personal Technologies.

[30]  Lars Erik Holmquist,et al.  Designing tomorrow's smart products' experience with the Smart-Itsxs platform , 2003, DUX '03.

[31]  Eric Horvitz,et al.  Sensing techniques for mobile interaction , 2000, UIST '00.

[32]  Gordon S. Blair,et al.  Developing a Context Sensitive Tourist Guide , 1998 .

[33]  Philippe C. Cattin,et al.  Biometric authentication system using human gait , 2002 .

[34]  Marc Langheinrich,et al.  First Steps Towards an Event-Based Infrastructure for Smart Things , 2000 .

[35]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[36]  Christian Floerkemeier,et al.  Interaction in pervasive computing settings using Bluetooth-enabled active tags and passive RFID technology together with mobile phones , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[37]  Roy Want,et al.  Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces , 1998, CHI.