Intimate interfaces in action: assessing the usability and subtlety of emg-based motionless gestures

Mobile communication devices, such as mobile phones and networked personal digital assistants (PDAs), allow users to be constantly connected and communicate anywhere and at any time, often resulting in personal and private communication taking place in public spaces. This private -- public contrast can be problematic. As a remedy, we promote intimate interfaces: interfaces that allow subtle and minimal mobile interaction, without disruption of the surrounding environment. In particular, motionless gestures sensed through the electromyographic (EMG) signal have been proposed as a solution to allow subtle input in a mobile context. In this paper we present an expansion of the work on EMG-based motionless gestures including (1) a novel study of their usability in a mobile context for controlling a realistic, multimodal interface and (2) a formal assessment of how noticeable they are to informed observers. Experimental results confirm that subtle gestures can be profitably used within a multimodal interface and that it is difficult for observers to guess when someone is performing a gesture, confirming the hypothesis of subtlety.

[1]  E. Goffman.  Behavior in Public Places , 1963 .

[2]  Carlo J. De Luca,et al.  Physiology and Mathematics of Myoelectric Signals , 1979 .

[3]  G. Hefftner,et al.  The electromyogram (EMG) as a control signal for functional neuromuscular stimulation. I. Autoregressive modeling as a means of EMG signature discrimination , 1988, IEEE Transactions on Biomedical Engineering.

[4]  R. Benjamin Knapp,et al.  A Bioelectric Controller for Computer Music Applications , 1990 .

[5]  Carlo J. De Luca,et al.  The Use of Surface Electromyography in Biomechanics , 1997 .

[6]  John G. Webster,et al.  Medical Instrumentation: Application and Design , 1997 .

[7]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[8]  Robert Rosenberg.  The biofeedback pointer: EMG control of a two dimensional pointer , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[9]  Armando Barreto,et al.  Hands-off human-computer interfaces for individuals with severe motor disabilities , 1999, HCI.

[10]  Jun Rekimoto,et al.  GestureWrist and GesturePad: unobtrusive wearable interaction devices , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[11]  Krista Coleman,et al.  Electromyography based human-computer-interface to induce movement in elderly persons with movement impairments , 2001, WUAUC'01.

[12]  L. Fortunati.  The mobile phone: Towards new categories and social relations , 2002 .

[13]  Stephen A. Brewster,et al.  Gestural and audio metaphors as a means of control for mobile devices , 2002, CHI.

[14]  Atau Tanaka,et al.  Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing , 2002, NIME.

[15]  Atau Tanaka,et al.  A Wireless, Network-based Biosensor Interface for Music , 2002, ICMC.

[16]  R. Paradiso,et al.  Wearable health care system for vital signs monitoring , 2003, 4th International IEEE EMBS Special Topic Conference on Information Technology Applications in Biomedicine, 2003..

[17]  Toshiaki Sugimura,et al.  "Unvoiced speech recognition using EMG - mime speech recognition" , 2003, CHI Extended Abstracts.

[18]  Stephen A. Brewster,et al.  A paradigm shift: alternative interaction techniques for use with mobile & wearable devices , 2003, CASCON.

[19]  Charles Jorgensen,et al.  Gestures as Input: Neuroelectric Joysticks and Keyboards , 2003, IEEE Pervasive Comput..

[20]  Enrique Company-Bosch,et al.  ECG Front-End Design is Simplified with MicroConverter ® , 2003 .

[21]  D F Stegeman,et al.  A thin, flexible multielectrode grid for high-density surface EMG. , 2004, Journal of applied physiology.

[22]  Vincent M. Stanford,et al.  Biosignals offer potential for direct interfaces and health monitoring , 2004, IEEE Pervasive Computing.

[23]  R. Paradiso,et al.  Wearable system for vital signs monitoring. , 2004, Studies in health technology and informatics.

[24]  B. Gaver,et al.  Provocative Awareness , 2002, Computer Supported Cooperative Work (CSCW).

[25]  Martin R. Gibbs,et al.  Mediating intimacy: designing technologies to support strong-tie relationships , 2005, CHI.

[26]  Richard L. Hazlett,et al.  Incorporating Facial EMG Emotion Measures as Feedback in the Software Design Process , 2005 .

[27]  Rajesh P. N. Rao,et al.  Real-Time Classification of Electromyographic Signals for Robotic Control , 2005, AAAI.

[28]  Enrico Costanza,et al.  Toward subtle intimate interfaces for mobile devices using an EMG controller , 2005, CHI.

[29]  P. K. Chan,et al.  A CMOS analog front-end IC for portable EEG/ECG monitoring applications , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[30]  Pattie Maes,et al.  ReachMedia: on-the-move interaction with everyday objects , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[31]  Joaquim A. Jorge,et al.  EMG as a daily wearable interface , 2006, GRAPP.

[32]  Paul Lukowicz,et al.  Detecting and Interpreting Muscle Activity with Wearable Force Sensors , 2006, Pervasive.

[33]  Mizuko Ito,et al.  Keitai in Public Transportation , 2006 .

[34]  Pattie Maes,et al.  eye-q: eyeglass peripheral display for subtle intimate notifications , 2006, Mobile HCI.

[35]  Caroline Parker,et al.  An examination of the effects of a wearable display on informal face-to-face communication , 2006, CHI.