A Learning-Based Hierarchical Control Scheme for an Exoskeleton Robot in Human–Robot Cooperative Manipulation

Exoskeleton robots can assist humans to perform activities of daily living with little effort. In this paper, a hierarchical control scheme is presented which enables an exoskeleton robot to achieve cooperative manipulation with humans. The control scheme consists of two layers. In low-level control of the upper limb exoskeleton robot, an admittance control scheme with an asymmetric barrier Lyapunov function-based adaptive neural network controller is proposed to enable the robot to be back drivable. In order to achieve high-level interaction, a strategy for learning human skills from demonstration is proposed by utilizing Gaussian mixture models, which consists of the learning and reproduction phase. During the learning phase, the robot observes and learns how a demonstrator performs a specific impedance-based task successfully, and in the reproduction phase, the robot can provide the subjects with just enough assistance by extracting human skills from demonstrations to prevent the motion of the robot end-effector deviating far from desired ones, due to variation in the interaction force caused by environmental disturbances. Experimental results of two different tasks show that the proposed control scheme can provide human subjects with assistance as needed during cooperative manipulation.

[1]  Stephen Paul Buerger,et al.  Stable, high-force, low-impedance robotic actuators for human-interactive machines , 2005 .

[2]  David G Lloyd,et al.  Neuromusculoskeletal modeling: estimation of muscle forces and joint moments and movements from measurements of neural command. , 2004, Journal of applied biomechanics.

[3]  Stefan Schaal,et al.  Biologically-inspired dynamical systems for movement generation: Automatic real-time goal adaptation and obstacle avoidance , 2009, 2009 IEEE International Conference on Robotics and Automation.

[4]  Nikolaos G. Tsagarakis,et al.  Statistical dynamical systems for skills acquisition in humanoids , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[5]  Shaocheng Tong,et al.  Neural Network Controller Design for an Uncertain Robot With Time-Varying Output Constraint , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Robert Richardson,et al.  A Control Strategy for Upper Limb Robotic Rehabilitation With a Dual Robot System , 2010, IEEE/ASME Transactions on Mechatronics.

[7]  Jun Kinugawa,et al.  Dance Teaching by a Robot: Combining Cognitive and Physical Human–Robot Interaction for Supporting the Skill Learning Process , 2017, IEEE Robotics and Automation Letters.

[8]  Fuchun Sun,et al.  sEMG-Based Joint Force Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2014, IEEE Journal of Biomedical and Health Informatics.

[9]  Wei He,et al.  Adaptive Neural Network Control of a Vessel with Output Constraints Using the Asymmetric Barrier Lyapunov Function , 2013, ICONS.

[10]  Zhi Liu,et al.  Adaptive Visual Tracking Control for Manipulator With Actuator Fuzzy Dead-Zone Constraint and Unmodeled Dynamic , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Chonhyon Park,et al.  I-Planner: Intention-aware motion planning using learning-based human motion prediction , 2016, Robotics: Science and Systems.

[12]  Xiaoou Li,et al.  Neural PID admittance control of a robot , 2013, 2013 American Control Conference.

[13]  Dmitry Berenson,et al.  A framework for unsupervised online human reaching motion recognition and early prediction , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Francis Eng Hock Tay,et al.  Barrier Lyapunov Functions for the control of output-constrained nonlinear systems , 2009, Autom..

[15]  M. Munih,et al.  Skill transfer from symmetric and asymmetric bimanual training using a robotic system to single limb performance , 2012, Journal of NeuroEngineering and Rehabilitation.

[16]  Vishnu K. Narayanan,et al.  A semi-autonomous framework for human-aware and user intention driven wheelchair mobility assistance , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Dana Kulic,et al.  Incremental learning of full body motion primitives and their sequencing through human motion observation , 2012, Int. J. Robotics Res..

[18]  Ye Gu,et al.  An Integrated Framework for Human–Robot Collaborative Manipulation , 2015, IEEE Transactions on Cybernetics.

[19]  Shuzhi Sam Ge,et al.  Direct Adaptive Neural Control for a Class of Uncertain Nonaffine Nonlinear Systems Based on Disturbance Observer , 2013, IEEE Transactions on Cybernetics.

[20]  Ashwin P. Dani,et al.  Human Intention Inference Using Expectation-Maximization Algorithm With Online Model Learning , 2017, IEEE Transactions on Automation Science and Engineering.

[21]  Carme Torras,et al.  Learning Collaborative Impedance-Based Robot Behaviors , 2013, AAAI.

[22]  Han-Pang Huang,et al.  Bayesian human intention estimator for exoskeleton system , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[23]  Nicola Vitiello,et al.  Intention-Based EMG Control for Powered Exoskeletons , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[25]  Darwin G. Caldwell,et al.  Learning force and position constraints in human-robot cooperative transportation , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[26]  Sandra Hirche,et al.  An experience-driven robotic assistant acquiring human knowledge to improve haptic cooperation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Zoltan-Csaba Marton,et al.  Depth-based tracking with physical constraints for robot manipulation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Keng Peng Tee,et al.  Control of state-constrained nonlinear systems using Integral Barrier Lyapunov Functionals , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[29]  Jun Morimoto,et al.  Human Movement Modeling to Detect Biosignal Sensor Failures for Myoelectric Assistive Robot Control , 2017, IEEE Transactions on Robotics.

[30]  Wei He,et al.  Adaptive Neural Network Control of an Uncertain Robot With Full-State Constraints , 2016, IEEE Transactions on Cybernetics.

[31]  Darwin G. Caldwell,et al.  On improving the extrapolation capability of task-parameterized movement models , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[33]  Xiaoou Li,et al.  PID admittance control for an upper limb exoskeleton , 2011, Proceedings of the 2011 American Control Conference.

[34]  R. Riener,et al.  A Novel Method for Automatic Treadmill Speed Adaptation , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Yasuhisa Hasegawa,et al.  Restoration of Gait for Spinal Cord Injury Patients Using HAL With Intention Estimator for Preferable Swing Speed , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Manfred Morari,et al.  Contractive model predictive control for constrained nonlinear systems , 2000, IEEE Trans. Autom. Control..

[37]  Sandra Hirche,et al.  Grasp pose estimation in human-robot manipulation tasks using wearable motion sensors , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[38]  Youxian Sun,et al.  NN-based asymptotic tracking control for a class of strict-feedback uncertain nonlinear systems with output constraints , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[39]  Ehsan Noohi,et al.  Estimating Human Intention During a Human–Robot Cooperative Task Based on the Internal Force Model , 2017 .

[40]  Affan Pervez,et al.  Learning task-parameterized dynamic movement primitives using mixture of GMMs , 2018, Intell. Serv. Robotics.

[41]  Keng Peng Tee,et al.  Adaptive Neural Control for Output Feedback Nonlinear Systems Using a Barrier Lyapunov Function , 2010, IEEE Transactions on Neural Networks.

[42]  Mahdi Tavakoli,et al.  A Gaussian Mixture Framework for Co-Operative Rehabilitation Therapy in Assistive Impedance-Based Tasks , 2016, IEEE Journal of Selected Topics in Signal Processing.

[43]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[44]  Kazuhiro Kosuge,et al.  Control of a Robot Dancer for Enhancing Haptic Human-Robot Interaction in Waltz , 2012, IEEE Transactions on Haptics.

[45]  Kazuhiro Kosuge,et al.  Dance Step Estimation Method Based on HMM for Dance Partner Robot , 2007, IEEE Transactions on Industrial Electronics.

[46]  Keng Peng Tee,et al.  Control of nonlinear systems with time-varying output constraints , 2009, 2009 IEEE International Conference on Control and Automation.

[47]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..