Controlling a robotic arm for functional tasks using a wireless head-joystick: A case study of a child with congenital absence of upper and lower limbs

Children with movement impairments needing assistive devices for activities of daily living often require novel methods for controlling these devices. Body-machine interfaces, which rely on body movements, are particularly well-suited for children as they are non-invasive and have high signal-to-noise ratios. Here, we examined the use of a head-joystick to enable a child with congenital absence of all four limbs to control a seven degree-of-freedom robotic arm. Head movements were measured with a wireless inertial measurement unit and used to control a robotic arm to perform two functional tasks—a drinking task and a block stacking task. The child practiced these tasks over multiple sessions; a control participant performed the same tasks with a manual joystick. Our results showed that the child was able to successfully perform both tasks, with movement times decreasing by ~40–50% over 6–8 sessions of training. The child’s performance with the head-joystick was also comparable to the control participant using a manual joystick. These results demonstrate the potential of using head movements for the control of high degree-of-freedom tasks in children with limited movement repertoire.

[1]  L Fehr,et al.  Adequacy of power wheelchair control interfaces for persons with severe disabilities: a clinical survey. , 2000, Journal of rehabilitation research and development.

[2]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[3]  Rajiv Ranganathan,et al.  Body-Machine Interface Enables People With Cervical Spinal Cord Injury to Control Devices With Available Body Movements: Proof of Concept , 2017, Neurorehabilitation and neural repair.

[4]  William W. Abbott,et al.  Gaze-based teleprosthetic enables intuitive continuous control of complex robot arm use: Writing & drawing , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[5]  F. Mussa-Ivaldi,et al.  Functional reorganization of upper-body movement after spinal cord injury , 2010, Experimental Brain Research.

[6]  Clément Gosselin,et al.  Intuitive wireless control of a robotic arm for people living with an upper body disability , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Mei-Hua Lee,et al.  Age-dependent differences in learning to control a robot arm using a body-machine interface , 2019, Scientific Reports.

[8]  Mei-Hua Lee,et al.  Body-machine interface for control of a screen cursor for a child with congenital absence of upper and lower limbs: a case report , 2016, Journal of NeuroEngineering and Rehabilitation.

[9]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[10]  Ferdinando A. Mussa-Ivaldi,et al.  Unsupervised Coadaptation of an Assistive Interface to Facilitate Sensorimotor Learning of Redundant Control , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[11]  Zachary Danziger,et al.  Learning Algorithms for Human–Machine Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[12]  D. Sugden,et al.  Children's perceptions of their use of assistive devices in home and school settings , 2009, Disability and rehabilitation. Assistive technology.

[13]  Rajiv Ranganathan,et al.  A five degree-of-freedom body-machine interface for children with severe motor impairments , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Michael Goldfarb,et al.  IMU-Based Wrist Rotation Control of a Transradial Myoelectric Prosthesis , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Nina Rudigkeit,et al.  Evaluation of control modes for head motion-based control with motion sensors , 2015, 2015 IEEE International Symposium on Medical Measurements and Applications (MeMeA) Proceedings.

[16]  Camilla Pierella,et al.  Upper Body-Based Power Wheelchair Control Interface for Individuals With Tetraplegia , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  T. Saitoh,et al.  Voice controlled intelligent wheelchair , 2007, SICE Annual Conference 2007.

[18]  Daniel Gomes,et al.  Head-movement interface for wheelchair driving based on inertial sensors* , 2019, ENBENG 2019.

[19]  Dagmar Sternad,et al.  Sensitivity of Smoothness Measures to Movement Duration, Amplitude, and Arrests , 2009, Journal of motor behavior.

[20]  U. Frese,et al.  Applying a 3DOF Orientation Tracker as a Human-Robot Interface for Autonomous Wheelchairs , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[21]  Krishna V Shenoy,et al.  Human cortical prostheses: lost in translation? , 2009, Neurosurgical focus.

[22]  S-C Chen,et al.  A head orientated wheelchair for people with disabilities , 2003, Disability and rehabilitation.

[23]  Aidan D. Roche,et al.  Prosthetic Myoelectric Control Strategies: A Clinical Perspective , 2014, Current Surgery Reports.

[24]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[25]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[26]  Elizabeth Dymond,et al.  Controlling assistive technology with head movements - a review , 1996 .

[27]  S. Lane,et al.  Assistive Technology for Children with Disabilities , 2003, Occupational therapy in health care.

[28]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[29]  Marion Gebhard,et al.  Head Motion and Head Gesture-Based Robot Control: A Usability Study , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.