Quantitative and Comparative Assessment of Learning in a Tongue-Operated Computer Input Device

Tongue drive system (TDS) is a wireless, wearable assistive technology that enables individuals with severe motor impairments to access computers, drive wheelchairs, and control their environments using tongue motion. In this paper, we have evaluated the TDS performance as a computer input device in four tasks, commonly known as horizontal, vertical, center-out, and multidirectional rapid tapping, based on Fitts' law and ISO9241-9 Standard. Nine able-bodied subjects, who already had tongue piercing, participated in this trial over five sessions during 5 weeks, allowing us to study the TDS learning process and its current limiting factors. Subjects wore tongue rings made of titanium in the form of a barbell with a small rare-earth magnetic tracer hermetically sealed inside the upper ball. Participants performed the same tasks with a mouse (only in the first session) as a reference as well as a standard keypad for benchmarking. Six performance measures were considered, including throughput, error rate, and reaction time, all of these improved significantly from the first to the last session, and some of these plateaued over the course of the experiment. The comparison between tongue-TDS versus index-finger-keypad provides valuable insights into tongue human factors, which can lead the way in improving the usability of the TDS and similar tongue-operated assistive technologies.

[1]  Maysam Ghovanloo,et al.  Effects of additional workload on hand and tongue performance , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[2]  I. Scott MacKenzie,et al.  Accuracy measures for evaluating computer pointing devices , 2001, CHI.

[3]  Xiao Li,et al.  The Vocal Joystick: Evaluation of voice-based cursor control techniques for assistive technology , 2008, Disability and rehabilitation. Assistive technology.

[4]  R.F. Kirsch,et al.  Evaluation of Head Orientation and Neck Muscle EMG Signals as Command Inputs to a Human–Computer Interface for Individuals With High Tetraplegia , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  P. Manns,et al.  Components of Quality of Life for Persons with a Quadriplegic and Paraplegic Spinal Cord Injury , 2001, Qualitative health research.

[6]  Terry C. Lansdown,et al.  The mind's eye: cognitive and applied aspects of eye movement research , 2005 .

[7]  M Adjouadi,et al.  A practical EMG-based human-computer interface for users with motor disabilities. , 2000, Journal of rehabilitation research and development.

[8]  Gerhard Tröster,et al.  Wearable EOG goggles: Seamless sensing and context-awareness in everyday environments , 2009, J. Ambient Intell. Smart Environ..

[9]  Fred H. Gage,et al.  Therapeutic interventions after spinal cord injury , 2006, Nature Reviews Neuroscience.

[10]  Maysam Ghovanloo,et al.  Wireless control of smartphones with tongue motion using tongue drive assistive technology , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[11]  Marcia J. Scherer Living in the state of stuck , 2005 .

[12]  M. Betke,et al.  The Camera Mouse: visual tracking of body features to provide computer access for people with severe disabilities , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Maysam Ghovanloo,et al.  Using Fitts's law for evaluating Tongue Drive System as a pointing device for computer access , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[14]  C Lau,et al.  Comparison of computer interface devices for persons with severe physical disabilities. , 1993, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[15]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[16]  Arthur Prochazka,et al.  Evaluation of Tooth-Click Triggering and Speech Recognition in Assistive Technology for Computer Access , 2010, Neurorehabilitation and neural repair.

[17]  Albert M. Cook,et al.  Assistive Technologies: Principles and Practice , 1995 .

[18]  Xueliang Huo,et al.  A Magneto-Inductive Sensor Based Wireless Tongue-Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Maysam Ghovanloo,et al.  Using Unconstrained Tongue Motion as an Alternative Control Mechanism for Wheeled Mobility , 2009, IEEE Transactions on Biomedical Engineering.

[20]  I. Scott MacKenzie,et al.  An empirical comparison of "wiimote" gun attachments for pointing tasks , 2009, EICS '09.

[21]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[22]  C. MacKenzie,et al.  Three-Dimensional Movement Trajectories in Fitts' Task: Implications for Control , 1987 .

[23]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[24]  K. Hiiemae,et al.  Tongue movements in feeding and speech. , 2003, Critical reviews in oral biology and medicine : an official publication of the American Association of Oral Biologists.

[25]  Armando Barreto,et al.  Integrated electromyogram and eye-gaze tracking cursor control system for computer users with motor disabilities. , 2008, Journal of rehabilitation research and development.

[26]  Xiao Li,et al.  The vocal joystick:: evaluation of voice-based cursor control techniques , 2006, Assets '06.

[27]  Xuan Zhang,et al.  Evaluating Eye Tracking with ISO 9241 - Part 9 , 2007, HCI.

[28]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[29]  Maysam Ghovanloo,et al.  Evaluation of a wireless wearable tongue–computer interface by individuals with high-level spinal cord injuries , 2010, Journal of neural engineering.

[30]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. 1954. , 1992, Journal of experimental psychology. General.

[31]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[32]  Denis Mottet,et al.  Behind Fitts' law: kinematic patterns in goal-directed movements , 2004, Int. J. Hum. Comput. Stud..

[33]  M. Mazo,et al.  System for assisted mobility using eye movements based on electrooculography , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Josip Musić,et al.  Testing inertial sensor performance as hands-free human-computer interface , 2009 .

[35]  Marcia J. Scherer,et al.  Living in the state of stuck : how assistive technology impacts the lives of people with disabilities , 2005 .

[36]  I. Scott MacKenzie,et al.  ISO 9241-9 evaluation of video game controllers , 2009, Graphics Interface.