A Voice Control System for Assistive Robotic Arms: Preliminary Usability Tests on Patients

One of the major issues for the success of assistive robotics concerns the question whether patients not only accept the technology and profit from it, but also whether they can effectively use it. This is especially relevant when patients are highly impaired and present several functional limitations. Therefore, it is important to enable patients to control robots with alternative methods during their activities of daily living. This work deals with the development of a voice control system based on the ROS middleware framework. The voice control was customized on the JACO2(Kinova Technology, Montreal, QC, Canada), a 6 degree-of-freedom assistive robotic manipulator. Two subjects with different impairments due to a neurodegenerative disease tested the robot for usability controlling it through the JACO2joystick and the developed voice control system. Both subjects used the voice control system successfully and scored highly its usability. The most impaired subject preferred the voice control while, by contrast, the less impaired one preferred to use the joystick. Preliminary results showed good usability of the system, which could be an important aid for highly impaired people.

[1]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[2]  C. Rotariu,et al.  Pupil detection algorithms for eye tracking applications , 2015, 2015 IEEE 21st International Symposium for Design and Technology in Electronic Packaging (SIITME).

[3]  R. Cooper,et al.  Functional assessment and performance evaluation for assistive robotic manipulators: Literature review , 2013, The journal of spinal cord medicine.

[4]  H.J.A. Stuyt,et al.  Cost-savings and economic benefits due to the assistive robotic manipulator (ARM) , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[5]  Rory A. Cooper,et al.  ARoMA-V 2 : Assistive Robotic Manipulation Assistance with Computer Vision and Voice Recognition , 2015 .

[6]  Dan Ding,et al.  Performance evaluation of 3D vision-based semi-autonomous control method for assistive robotic manipulator , 2018, Disability and rehabilitation. Assistive technology.

[7]  S. P. Levine,et al.  Voice control of a powered wheelchair , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[9]  Michael J. Black,et al.  systems in humans with tetraplegia Assistive technology and robotic control using MI ensemble-based neural interface Physiology in Press , 2007 .

[10]  Just L. Herder,et al.  A review of assistive devices for arm balancing , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[11]  Carlos Balaguer,et al.  Assistive Robot Multi-modal Interaction with Augmented 3D Vision and Dialogue , 2013, ROBOT.

[12]  Zhao Wang,et al.  How Autonomy Impacts Performance and Satisfaction: Results From a Study With Spinal Cord Injured Subjects Using an Assistive Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  T. Saitoh,et al.  Voice controlled intelligent wheelchair , 2007, SICE Annual Conference 2007.

[14]  Hongliu Yu,et al.  Development of the control system of a voice-operated wheelchair with multi-posture characteristics , 2017, 2017 2nd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS).

[15]  G. Pacnik,et al.  Voice operated intelligent wheelchair - VOIC , 2005, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[16]  R J Shephard,et al.  Benefits of sport and physical activity for the disabled: implications for the individual and for society. , 2020, Scandinavian journal of rehabilitation medicine.

[17]  Fernando Alonso-Martín,et al.  INTEGRATION OF A VOICE RECOGNITION SYSTEM IN A SOCIAL ROBOT , 2011, Cybern. Syst..

[18]  K. Jellinger,et al.  Aids to the Examination of the Peripheral Nervous System , 2001 .

[19]  Dan Ding,et al.  Computer Access Technologies for Controlling Assistive Robotic Manipulators: Potentials and Challenges , 2015, ICRA 2015.

[20]  Nicholas Roy,et al.  Learning Unknown Groundings for Natural Language Interaction with Mobile Robots , 2017, ISRR.

[21]  Cristina Urdiales.  Collaborative Assistive Robot for Mobility Enhancement , 2012 .

[22]  Romulus Lontis,et al.  Wireless intraoral tongue control of an assistive robotic arm for individuals with tetraplegia , 2017, Journal of NeuroEngineering and Rehabilitation.

[23]  C. Leroux,et al.  Evaluation of a graphic interface to control a robotic grasping arm: a multicenter study. , 2009, Archives of physical medicine and rehabilitation.

[24]  Ali A. Abed,et al.  Design of Voice Controlled Smart Wheelchair , 2015 .

[25]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .