Force-Guided High-Precision Grasping Control of Fragile and Deformable Objects Using sEMG-Based Force Prediction

Regulating contact forces with high precision is crucial for grasping and manipulating fragile or deformable objects. We aim to utilize the dexterity of human hands to regulate the contact forces for robotic hands and exploit human sensory-motor synergies in a wearable and non-invasive way. We extracted force information from the electric activities of skeletal muscles during their voluntary contractions through surface electromyography (sEMG). We built a regression model based on a Neural Network to predict the gripping force from the preprocessed sEMG signals and achieved high accuracy ($R^2 = 0.982$). Based on the force command predicted from human muscles, we developed a force-guided control framework, where force control was realized via an admittance controller that tracked the predicted gripping force reference to grasp delicate and deformable objects. We demonstrated the effectiveness of the proposed method on a set of representative fragile and deformable objects from daily life, all of which were successfully grasped without any damage or deformation.

[1]  Antonis A. Argyros,et al.  Hand-Object Contact Force Estimation from Markerless Visual Tracking , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Belhassen-Chedli Bouzgarrou,et al.  Model-based strategy for grasping 3D deformable objects using a multi-fingered robotic hand , 2017, Robotics Auton. Syst..

[3]  Kejun Zhang,et al.  Modified EMG-based handgrip force prediction using extreme learning machine , 2017, Soft Comput..

[4]  George Samaras,et al.  A Study on the Deployment of a Service Robot in an Elderly Care Center , 2018, Int. J. Soc. Robotics.

[5]  Panagiotis Artemiadis,et al.  Neural closed-loop control of a hand prosthesis using cross-modal haptic feedback , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[6]  Yang Gao,et al.  Space Robotics & Autonomous Systems: Widening the horizon of space exploration , 2018 .

[7]  Werner Friedl,et al.  Human-Robotic Variable-Stiffness Grasps of Small-Fruit Containers Are Successful Even Under Severely Impaired Sensory Feedback , 2018, Front. Neurorobot..

[8]  Aude Billard,et al.  Learning Compliant Manipulation through Kinesthetic and Tactile Human-Robot Interaction , 2014, IEEE Transactions on Haptics.

[9]  Gordon Cheng,et al.  Tactile-based manipulation of deformable objects with dynamic center of mass , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[10]  Nikolaos G. Tsagarakis,et al.  Stabilization for the compliant humanoid robot COMAN exploiting intrinsic and controlled compliance , 2012, 2012 IEEE International Conference on Robotics and Automation.

[11]  Panagiotis K. Artemiadis,et al.  EMG-Based Position and Force Estimates in Coupled Human-Robot Systems: Towards EMG-Controlled Exoskeletons , 2008, ISER.

[12]  Editedby Eleanor Criswell,et al.  Cram's Introduction to Surface Electromyography , 2010 .

[13]  Liu Yan,et al.  A Novel Underactuated Soft Humanoid Hand For Hand Sign Language , 2019, 2019 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[14]  Darwin G. Caldwell,et al.  Force-based variable impedance learning for robotic manipulation , 2018, Robotics Auton. Syst..

[15]  Nikolaos G. Tsagarakis,et al.  Compliance control for stabilizing the humanoid on the changing slope based on terrain inclination estimation , 2016, Auton. Robots.

[16]  Xianmin Zhang,et al.  Estimation of handgrip force from nonlinear SEMG-force relationship during dynamic contraction tasks , 2017, 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[17]  Aude Billard,et al.  Learning object-level impedance control for robust grasping and dexterous manipulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  D. Floreano,et al.  Soft Robotic Grippers , 2018, Advanced materials.

[19]  Tetsuyou Watanabe,et al.  Fluid Pressure Monitoring-Based Strategy for Delicate Grasping of Fragile Objects by A Robotic Hand with Fluid Fingertips , 2019, Sensors.