A Novel Human-Like Control Framework for Mobile Medical Service Robot

Recently, as a highly infectious disease of novel coronavirus (COVID-19) has swept the globe, more and more patients need to be isolated in the rooms of the hospitals, so how to deliver the meals or drugs to these infectious patients is the urgent work. It is a reliable and effective method to transport medical supplies or meals to patients using robots, but how to teach the robot to the destination and to enter the door like a human is an exciting task. In this paper, a novel human-like control framework for the mobile medical service robot is considered, where a Kinect sensor is used to manage human activity recognition to generate a designed teaching trajectory. Meanwhile, the learning technique of dynamic movement primitives (DMP) with the Gaussian mixture model (GMM) is applied to transfer the skill from humans to robots. A neural-based model predictive tracking controller is implemented to follow the teaching trajectory. Finally, some demonstrations are carried out in a hospital room to illustrate the superiority and effectiveness of the developed framework.

[1]  Dawei Shi,et al.  Cooperative attitude control for a wheel-legged robot , 2019, Peer-to-Peer Networking and Applications.

[2]  Nikolaos G. Tsagarakis,et al.  Remote mobile manipulation with the centauro robot: Full‐body telepresence and autonomous operator assistance , 2019, J. Field Robotics.

[3]  Hang Su,et al.  Depth vision guided hand gesture recognition using electromyographic signals , 2020, Adv. Robotics.

[4]  Nima Enayati,et al.  Online human-like redundancy optimization for tele-operated anthropomorphic manipulators , 2018 .

[5]  Xiaoyu Wu,et al.  Cooperative Manipulation of Wearable Dual-Arm Exoskeletons Using Force Communication Between Partners , 2020, IEEE Transactions on Industrial Electronics.

[6]  Guanglin Li,et al.  Development of Sensory-Motor Fusion-Based Manipulation and Grasping Control for a Robotic Hand-Eye System , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  Zhen Kan,et al.  Reference Trajectory Reshaping Optimization and Control of Robotic Exoskeletons for Human–Robot Co-Manipulation , 2020, IEEE Transactions on Cybernetics.

[8]  Yu Kang,et al.  Adaptive Neural Control of a Kinematically Redundant Exoskeleton Robot Using Brain–Machine Interfaces , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Qiang Wei,et al.  Synergy-Based Control of Assistive Lower-Limb Exoskeletons by Skill Transfer , 2020, IEEE/ASME Transactions on Mechatronics.

[10]  Chun-Yi Su,et al.  Vision-Based Model Predictive Control for Steering of a Nonholonomic Mobile Robot , 2016, IEEE Transactions on Control Systems Technology.

[11]  Xiaoli Chu,et al.  A Learning-Based Hierarchical Control Scheme for an Exoskeleton Robot in Human–Robot Cooperative Manipulation , 2020, IEEE Transactions on Cybernetics.

[12]  Hamid Reza Karimi,et al.  Asymptotic Tracking Control for a More Representative Class of Uncertain Nonlinear Systems With Mismatched Uncertainties , 2019, IEEE Transactions on Industrial Electronics.

[13]  Antonio Bicchi,et al.  Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations , 2018, IEEE Transactions on Robotics.

[14]  C. Zheng,et al.  Time Course of Lung Changes at Chest CT during Recovery from Coronavirus Disease 2019 (COVID-19) , 2020 .

[15]  Ying Feng,et al.  Human-Cooperative Control Design of a Walking Exoskeleton for Body Weight Support , 2020, IEEE Transactions on Industrial Informatics.

[16]  Yu Sun,et al.  Guest Editorial Neuro-Robotics Systems: Sensing, Cognition, Learning, and Control , 2019, IEEE Trans. Cogn. Dev. Syst..

[17]  Huixia Yang,et al.  Clinical characteristics and intrauterine vertical transmission potential of COVID-19 infection in nine pregnant women: a retrospective review of medical records , 2020, The Lancet.

[18]  Dawei Shi,et al.  Compound control for energy management of the hybrid ultracapacitor-battery electric drive systems , 2019 .

[19]  Chenguang Yang,et al.  Adaptive Neural Network Based Variable Stiffness Control of Uncertain Robotic Systems Using Disturbance Observer , 2017, IEEE Transactions on Industrial Electronics.

[20]  Li Ma,et al.  Fuzzy Approximation Based Asymptotic Tracking Control for a Class of Uncertain Switched Nonlinear Systems , 2020, IEEE Transactions on Fuzzy Systems.

[21]  Hang Su,et al.  Asymmetric Bimanual Control of Dual-arm Serial Manipulator for Robot-assisted Minimally Invasive Surgeries , 2020 .

[22]  Chun-Yi Su,et al.  Human-Inspired Control of Dual-Arm Exoskeleton Robots With Force and Impedance Adaptation , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Xin Zhang,et al.  Novel Design and Adaptive Fuzzy Control of a Lower-Limb Elderly Rehabilitation , 2020 .

[24]  Hang Su,et al.  Neural Network Enhanced Robot Tool Identification and Calibration for Bilateral Teleoperation , 2019, IEEE Access.

[25]  Hamid Reza Karimi,et al.  Synchronization of Network Systems via Aperiodic Sampled-Data Control With Constant Delay and Application to Unmanned Ground Vehicles , 2020, IEEE Transactions on Industrial Electronics.

[26]  Wei He,et al.  Adaptive Fuzzy Neural Network Control for a Constrained Robot Using Impedance Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Yuping Wang,et al.  A deterministic annealing algorithm for the minimum concave cost network flow problem , 2011, Neural Networks.

[28]  Hang Su,et al.  A Fast and Robust Deep Convolutional Neural Networks for Complex Human Activity Recognition Using Smartphone , 2019, Sensors.

[29]  Hang Su,et al.  Deep Neural Network Approach in Human-Like Redundancy Optimization for Anthropomorphic Manipulators , 2019, IEEE Access.

[30]  Giancarlo Ferrigno,et al.  Collaborative framework for robot-assisted minimally invasive surgery using a 7-DoF anthropomorphic robot , 2018, Robotics Auton. Syst..

[31]  Zhijun Li,et al.  Evolution Strategies Learning With Variable Impedance Control for Grasping Under Uncertainty , 2019, IEEE Transactions on Industrial Electronics.

[32]  Hamid Reza Karimi,et al.  Passivity-based robust sliding mode synthesis for uncertain delayed stochastic systems via state observer , 2020, Autom..

[33]  K. Yuen,et al.  Clinical Characteristics of Coronavirus Disease 2019 in China , 2020, The New England journal of medicine.

[34]  Changyin Sun,et al.  Iterative Learning Control for a Flapping Wing Micro Aerial Vehicle Under Distributed Disturbances , 2019, IEEE Transactions on Cybernetics.

[35]  Hamid Reza Karimi,et al.  Sliding mode control of automotive electronic valve system under weighted try-once-discard protocol , 2020, Inf. Sci..

[36]  Yan Bai,et al.  Presumed Asymptomatic Carrier Transmission of COVID-19. , 2020, JAMA.

[37]  Hang Su,et al.  Neural fuzzy approximation enhanced autonomous tracking control of the wheel-legged robot under uncertain physical interaction , 2020, Neurocomputing.

[38]  Michael Felsberg,et al.  Flexible Disaster Response of Tomorrow: Final Presentation and Evaluation of the CENTAURO System , 2019, IEEE Robotics & Automation Magazine.

[39]  Hang Su,et al.  Improved Human–Robot Collaborative Control of Redundant Robot for Teleoperated Minimally Invasive Surgery , 2019, IEEE Robotics and Automation Letters.

[40]  Hang Su,et al.  Parallel structure of six wheel-legged robot trajectory tracking control with heavy payload under uncertain physical interaction , 2020 .

[41]  Chenguang Yang,et al.  Physical Human–Robot Interaction of a Robotic Exoskeleton By Admittance Control , 2018, IEEE Transactions on Industrial Electronics.