ReachMedia: on-the-move interaction with everyday objects

Mobile and wearable interfaces try to integrate digital information into our everyday experiences but usually require more attention than is appropriate and often fail to do so in a natural and socially acceptable way. In this paper we present "ReachMedia", a system for seamlessly providing just-in-time information for everyday objects, built around a wireless wristband with an RFID reader to detect objects that the user is interacting with. It enables hands- and eyes-free interaction with relevant information using a unique combination of audio output and gestural input, allowing socially acceptable, on-the-move interaction. This paper focuses on the general merits of the design, and the novel gesture recognition technique used, showing 95% classification rate using the realtime online classification system.

[1]  Gregory D. Abowd,et al.  Cyberguide: A mobile context‐aware tour guide , 1997, Wirel. Networks.

[2]  Philip H. Mirvis.  Flow: The Psychology of Optimal Experience , 1991 .

[3]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[4]  Katashi Nagao,et al.  Ubiquitous Talker: Spoken Language Interaction with Real World Objects , 1995, IJCAI.

[5]  Henry A. Kautz,et al.  Guide: Towards Understanding Daily Life via Auto- Identification and Statistical Analysis , 2003 .

[6]  Pattie Maes,et al.  xLink: Context Management Solution for Commodity Ubiquitous Computing Environments , 2005, ubiPCMM.

[7]  Mahadev Satyanarayanan,et al.  IEEE Workshop on mobile computing systems and applications , 1995, IEEE Wirel. Commun..

[8]  Eric Horvitz,et al.  Foreground and background interaction with sensor-enhanced mobile devices , 2005, TCHI.

[9]  Stephen A. Brewster,et al.  Multimodal 'eyes-free' interaction techniques for wearable devices , 2003, CHI '03.

[10]  Dadong Wan,et al.  Magic Medicine Cabinet: A Situated Portal for Consumer Healthcare , 1999, HUC.

[11]  Guanling Chen,et al.  Context aggregation and dissemination in ubiquitous computing systems , 2002, Proceedings Fourth IEEE Workshop on Mobile Computing Systems and Applications.

[12]  Benjamin B. Bederson,et al.  Interfaces for staying in the flow , 2004, UBIQ.

[13]  Chris Schmandt,et al.  Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments , 2000, TCHI.

[14]  Paul Lukowicz,et al.  Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers , 2004, Pervasive.

[15]  Jun Rekimoto,et al.  GestureWrist and GesturePad: unobtrusive wearable interaction devices , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[16]  Kent Larson,et al.  MITes: Wireless Portable Sensors for Studying Behavior , 2004 .

[17]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[18]  Enrico Costanza,et al.  Toward subtle intimate interfaces for mobile devices using an EMG controller , 2005, CHI.

[19]  Jani Mäntyjärvi,et al.  Enabling fast and effortless customisation in accelerometer based gesture interaction , 2004, MUM '04.

[20]  M. Satyanarayanan.  Workshop on Mobile Computing Systems and Applications Digest of Proceedings , 2007 .

[21]  Marisa E. Campbell.  CHI 2002 , 2002, INTR.

[22]  Mary Czerwinski,et al.  Subjective Duration Assessment: An Implicit Probe for Software Usability , 2001 .

[23]  Stephen A. Brewster,et al.  Gestural and audio metaphors as a means of control for mobile devices , 2002, CHI.

[24]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[25]  Christian Floerkemeier,et al.  Issues with RFID Usage in Ubiquitous Computing Applications , 2004, Pervasive.

[26]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[27]  Richard Hull,et al.  Towards situated computing , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[28]  John Turek,et al.  Challenges in Flexible Aggregation of Pervasive Data , 2001 .

[29]  Tracy L. Westeyn,et al.  Georgia tech gesture toolkit: supporting experiments in gesture recognition , 2003, ICMI '03.

[30]  Antonio Krüger,et al.  Integrating Intra and Extra Gestures into a Mobile and Multimodal Shopping Assistant , 2005, Pervasive.