Tapping into tongue motion to substitute or augment upper limbs

Assistive technologies (AT) play an important role in the lives of people with disabilities. Most importantly, they allow individuals with severe physical disabilities become more independence. Inherent abilities of the human tongue originated from its strong representation in the motor cortex, its direct connection to the brain through well-protected cranial nerves, and easy access without a surgery have resulted in development of a series of tongue-operated ATs that tap into the dexterous, intuitive, rapid, precise, and tireless motion of the tongue. These ATs not only help people with tetraplegia as a result of spinal cord injury or degenerative neurological diseases to access computers/smartphones, drive wheelchairs, and interact with their environments but also have the potential to enhance rehabilitation paradigms for stroke survivors. In this paper, various types of tongue operated ATs are discussed based on their working principles and task based performances. Comparisons are drawn based on widely accepted and standardized quantitative measures, such as throughput, information transfer rate, typing speed/accuracy, tracking error, navigation period, and navigation accuracy as well as qualitative measures, such as user feedback. Finally, the prospects of using variations of these versatile devices to enhance human performance in environments that limit hand and finger movements, such as space exploration or underwater operations are discussed.

[1]  Albert M. Cook,et al.  Assistive Technologies: Principles and Practice , 1995 .

[2]  M. Shinohara,et al.  Motor performance of tongue with a computer-integrated system under different levels of background physical exertion , 2013, Ergonomics.

[3]  Maysam Ghovanloo,et al.  An Arch-Shaped Intraoral Tongue Drive System with Built-in Tongue-Computer Interfacing SoC , 2014, Sensors.

[4]  D.R. Reddy,et al.  Speech recognition by machine: A review , 1976, Proceedings of the IEEE.

[5]  Lotte N. S. Andreasen Struijk,et al.  Clinical evaluation of wireless inductive tongue computer interface for control of computers and assistive devices , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[6]  Ashley N. Johnson,et al.  Dual-task motor performance with a tongue-operated assistive technology compared with hand operations , 2012, Journal of NeuroEngineering and Rehabilitation.

[7]  A. May,et al.  Structural brain alterations following 5 days of intervention: dynamic aspects of neuroplasticity. , 2007, Cerebral cortex.

[8]  Krzysztof Iniewski,et al.  A Wireless Intraoral Tongue–Computer Interface , 2016 .

[9]  Maysam Ghovanloo,et al.  Wireless control of smartphones with tongue motion using tongue drive assistive technology , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[10]  Xueliang Huo,et al.  A Magneto-Inductive Sensor Based Wireless Tongue-Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Lotte N. S. Andreasen Struijk,et al.  Inductive tongue control of powered wheelchairs , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[12]  R. Weitkunat,et al.  Tongue-muscle training by intraoral electrical neurostimulation in patients with obstructive sleep apnea. , 2004, Sleep.

[13]  M. Ghovanloo,et al.  The Tongue Enables Computer and Wheelchair Control for People with Spinal Cord Injury , 2013, Science Translational Medicine.

[14]  Hui Tang,et al.  An oral tactile interface for blind navigation , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  M. P. Bolton,et al.  Mouse emulator for tetraplegics , 2006, Medical and Biological Engineering and Computing.

[16]  A. Schumacher,et al.  Bioavailability in vivo of naltrexone following transbuccal administration by an electronically-controlled intraoral device: a trial on pigs. , 2010, Journal of controlled release : official journal of the Controlled Release Society.

[17]  Bo Bentsen,et al.  Fully integrated wireless inductive tongue computer interface for disabled people , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Maysam Ghovanloo,et al.  A Wireless Magnetoresistive Sensing System for an Intraoral Tongue-Computer Interface , 2012, IEEE Transactions on Biomedical Circuits and Systems.

[19]  Maysam Ghovanloo,et al.  Toward Silent-Speech Control of Consumer Wearables , 2015, Computer.

[20]  Albert M. Cook,et al.  Cook & Hussey's Assistive Technologies Principles and Practice , 2007 .

[21]  Bogdan Draganski,et al.  Neuroplasticity: Changes in grey matter induced by training , 2004, Nature.

[22]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[23]  Maysam Ghovanloo,et al.  Developing a Tongue Controlled Exoskeleton for a Wrist Tracking Exercise: A Preliminary Study , 2015 .

[24]  Xueliang Huo,et al.  A Wireless Tongue-Computer Interface Using Stereo Differential Magnetic Field Measurement , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Maysam Ghovanloo,et al.  The tongue and ear interface: a wearable system for silent speech recognition , 2014, SEMWEB.

[26]  Maysam Ghovanloo,et al.  Live demonstration: Towards an ultra low power on-board processor for Tongue Drive System , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[27]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[28]  Xueliang Huo,et al.  A Magnetic Wireless Tongue-Computer Interface , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[29]  Maysam Ghovanloo,et al.  Tongue-controlled robotic rehabilitation: A feasibility study in people with stroke. , 2016, Journal of rehabilitation research and development.

[30]  S. Schultz Principles of Neural Science, 4th ed. , 2001 .

[31]  Wolfgang Nutt,et al.  Tongue-mouse for quadriplegics , 1998 .

[32]  Maysam Ghovanloo,et al.  Evaluation of a Smartphone Platform as a Wireless Interface Between Tongue Drive System and Electric-Powered Wheelchairs , 2012, IEEE Transactions on Biomedical Engineering.

[33]  John Hetling,et al.  Comparison of Three Head-Controlled Mouse Emulators in Three Light Conditions , 2009, Augmentative and alternative communication.

[34]  Lotte N. S. Andreasen Struijk A Tongue Based Control for Disabled People , 2006, ICCHP.

[35]  Maysam Ghovanloo,et al.  Introduction and preliminary evaluation of the Tongue Drive System: wireless tongue-operated assistive technology for people with little or no upper-limb function. , 2008, Journal of rehabilitation research and development.

[36]  M. Milicevic,et al.  Health Condition and Quality of Life in Persons with Spinal Cord Injury , 2014, Iranian journal of public health.

[37]  Maysam Ghovanloo,et al.  A multimodal human computer interface combining head movement, speech and tongue motion for people with severe disabilities , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[38]  Mark D. Huffman,et al.  Heart disease and stroke statistics--2013 update: a report from the American Heart Association. , 2013, Circulation.

[39]  Maysam Ghovanloo,et al.  A Dual-Mode Human Computer Interface Combining Speech and Tongue Motion for People with Severe Disabilities , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  Maysam Ghovanloo,et al.  Enhancements of a tongue-operated robotic rehabilitation system , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[41]  Maysam Ghovanloo,et al.  Assessment of the Tongue-Drive System Using a Computer, a Smartphone, and a Powered-Wheelchair by People With Tetraplegia , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  C. Burgar,et al.  Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke. , 2002, Archives of physical medicine and rehabilitation.

[43]  Shumin Zhai,et al.  An isometric tongue pointing device , 1997, CHI.

[44]  Maysam Ghovanloo,et al.  Toward an Ultralow-Power Onboard Processor for Tongue Drive System , 2015, IEEE Transactions on Circuits and Systems II: Express Briefs.

[45]  Desney S. Tan,et al.  Optically sensing tongue gestures for computer input , 2009, UIST '09.

[46]  Michael Gaihede,et al.  Development and functional demonstration of a wireless intraoral inductive tongue computer interface for severely disabled persons , 2017, Disability and rehabilitation. Assistive technology.

[47]  Maysam Ghovanloo,et al.  An apparatus for improving upper limb function by engaging synchronous tongue motion , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).