Operational learning with sensory feedback for controlling a robotic thumb using the posterior auricular muscle

Extra robotic limbs in a robotic system that are designed to augment and expand human abilities have received attention in the field of wearable robotics. We aim to develop a robotic system that is controlled by body parts that are not used on a daily basis in order to augment and expand human abilities. This paper presents operational learning experiments for manipulating a robotic thumb using the posterior auricular muscle, a body part that is not used in everyday life. In these experiments, reaching motions were executed using sensory feedback in the robotic thumb through a device that continuously displays its position. The experimental results indicate the proposed operational learning experiments improve the ability to contract the posterior auricular muscles. In addition, the results indicate the operability of a robotic thumb could be improved by acquiring internal models through repetitive operational learning. GRAPHICAL ABSTRACT

[1]  Yasuhisa Hasegawa,et al.  Improvement of operability of extra robotic thumb using tactile feedback by electrical stimulation , 2015, 2015 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[2]  Giuseppe di Pellegrino,et al.  Neuropsychological Evidence of an Integrated Visuotactile Representation of Peripersonal Space in Humans , 1998, Journal of Cognitive Neuroscience.

[3]  M. Kawato,et al.  Behavioral/systems/cognitive Functional Magnetic Resonance Imaging Examination of Two Modular Architectures for Switching Multiple Internal Models , 2022 .

[4]  M Reischl,et al.  Steer by ear: Myoelectric auricular control of powered wheelchairs for individuals with spinal cord injury. , 2015, Restorative neurology and neuroscience.

[5]  H. Harry Asada,et al.  Design and Control of Lightweight Supernumerary Robotic Limbs for Sitting/Standing Assistance , 2016, ISER.

[6]  Aiguo Song,et al.  Closed-Loop Hybrid Gaze Brain-Machine Interface Based Robotic Arm Control with Augmented Reality Feedback , 2017, Front. Neurorobot..

[7]  P. Sheehan,et al.  Role of the feedback signal in electromyograph biofeedback: the relevance of attention. , 1981, Journal of experimental psychology. General.

[8]  J C Rothwell,et al.  Manual motor performance in a deafferented man. , 1982, Brain : a journal of neurology.

[9]  Yukio Okada,et al.  Distributions of sensory spots in the hand and two-point discrimination thresholds in the hand, face and mouth in dental students , 1999, Journal of Physiology-Paris.

[10]  Seungmoon Choi,et al.  Initial study for creating linearly moving vibrotactile sensation on mobile device , 2010, 2010 IEEE Haptics Symposium.

[11]  Abdulmotaleb El Saddik,et al.  Spatial resolution of vibrotactile perception on the human forearm when exploiting funneling illusion , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[12]  Yasuhisa Hasegawa,et al.  Hand space change after use of extra robotic thumb , 2016, 2016 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[13]  Aiguo Song,et al.  A Control Strategy with Tactile Perception Feedback for EMG Prosthetic Hand , 2015, J. Sensors.

[14]  Yasuhisa Hasegawa,et al.  Modification of body schema by use of extra robotic thumb , 2018 .

[15]  Claudio Pacchierotti,et al.  Using the robotic sixth finger and vibrotactile feedback for grasp compensation in chronic stroke patients , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[16]  D. Wolpert,et al.  Abnormalities in the awareness of action , 2002, Trends in Cognitive Sciences.

[17]  H. Harry Asada,et al.  Design and control of Supernumerary Robotic Limbs for balance augmentation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  H. Harry Asada,et al.  “Hold-and-manipulate” with a single hand being assisted by wearable extra fingers , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[19]  M. Lungarella,et al.  Towards a model for tool-body assimilation and adaptive tool-use , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[20]  H. Harry Asada,et al.  Supernumerary Robotic Limbs for aircraft fuselage assembly: Body stabilization and guidance by bracing , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  A. Maravita,et al.  Tools for the body (schema) , 2004, Trends in Cognitive Sciences.

[22]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[23]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[24]  C. Cipriani,et al.  HyVE: Hybrid Vibro-Electrotactile Stimulation for Sensory Feedback and Substitution in Rehabilitation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.