Upper-Limb Kinematic Parameter Estimation and Localization Using a Compliant Robotic Manipulator

Assistive and rehabilitation robotics have gained momentum over the past decade and are expected to progress significantly in the coming years. Although relevant and promising research advances have contributed to these fields, challenges regarding intentional physical contact with humans remain. Despite being a fundamental component of assistive and rehabilitation tasks, there is an evident lack of work related to robotic manipulators that intentionally manipulate human body parts. Moreover, existing solutions involving end-effector robots are not based on accurate knowledge of human limb dimensions and their current configuration. This knowledge, which is essential for safe human–limb manipulation, depends on the grasping location and human kinematic parameters. This paper addresses the upper-limb manipulation challenge and proposes a pose estimation method using a compliant robotic manipulator. To the best of our knowledge, this is the first attempt to address this challenge. A kinesthetic-based approach enables estimation of the kinematic parameters of the human arm without integrating external sensors. The estimation method relies only on proprioceptive data obtained from a collaborative robot with a Cartesian impedance-based controller to follow a compliant trajectory that depends on human arm kinodynamics. The human arm model is a 2-degree of freedom (DoF) kinematic chain. Thus, prior knowledge of the arm’s behavior and an estimation method enables estimation of the kinematic parameters. Two estimation methods are implemented and compared: i) Hough transform (HT); ii) least squares (LS). Furthermore, a resizable, sensorized dummy arm is designed for experimental validation of the proposed approach. Outcomes from six experiments with different arm lengths demonstrate the repeatability and effectiveness of the proposed methodology, which can be used in several rehabilitation robotic applications.

[1]  Cuntai Guan,et al.  A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaboration , 2019, Biomed. Signal Process. Control..

[2]  Mario Cortese,et al.  Vision-Based Pose Estimation for Robot-Mediated Hand Telerehabilitation , 2016, Sensors.

[3]  Cecilia E. Garcia Cena,et al.  ROAD: domestic assistant and rehabilitation robot , 2011, Medical & Biological Engineering & Computing.

[4]  Robert Riener,et al.  Human arm weight compensation in rehabilitation robotics: efficacy of three distinct methods , 2020, Journal of NeuroEngineering and Rehabilitation.

[5]  Alfonso J. García-Cerezo,et al.  Methods for Autonomous Wristband Placement with a Search-and-Rescue Aerial Manipulator , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  E. Rocon,et al.  Design and Validation of a Rehabilitation Robotic Exoskeleton for Tremor Assessment and Suppression , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Bruno Siciliano,et al.  Cartesian impedance control of redundant manipulators for human-robot co-manipulation , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Alfonso J. García-Cerezo,et al.  Underactuated Gripper with Forearm Roll Estimation for Human Limbs Manipulation in Rescue Robotics , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[10]  Diane J. Cook,et al.  Predicting Functional Independence Measure Scores During Rehabilitation With Wearable Inertial Sensors , 2015, IEEE Access.

[11]  Yue Wang,et al.  Human-Collaborative Schemes in the Motion Control of Single and Multiple Mobile Robots Mobile robot , 2017 .

[12]  Pubudu N. Pathirana,et al.  A constrained nonlinear optimization solution for 3D orientation estimation of the human limb , 2017, 2017 10th Biomedical Engineering International Conference (BMEiCON).

[13]  Fillia Makedon,et al.  MAGNI Dynamics: A Vision-Based Kinematic and Dynamic Upper-Limb Model for Intelligent Robotic Rehabilitation , 2017 .

[14]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Siddhartha S. Srinivasa,et al.  Towards Robotic Feeding: Role of Haptics in Fork-Based Food Manipulation , 2018, IEEE Robotics and Automation Letters.

[16]  Terri L. Moore,et al.  Regression Analysis by Example , 2001, Technometrics.

[17]  Arash Ajoudani,et al.  A Human–Robot Co-Manipulation Approach Based on Human Sensorimotor Information , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Elena De Momi,et al.  Acceleration-based Assistive Strategy to Control a Back-support Exoskeleton for Load Handling: Preliminary Evaluation , 2019, 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR).

[19]  Bo Sheng,et al.  An Industrial Robot-Based Rehabilitation System for Bilateral Exercises , 2019, IEEE Access.

[20]  Aria Alasty,et al.  Human Arm Motion Tracking by Orientation-Based Fusion of Inertial Sensors and Kinect Using Unscented Kalman Filter. , 2016, Journal of biomechanical engineering.

[21]  R. Riener,et al.  Towards more effective robotic gait training for stroke rehabilitation: a review , 2012, Journal of NeuroEngineering and Rehabilitation.

[22]  Pedro Araujo-Gómez,et al.  Design and Kinematic Analysis of a Novel 3UPS/RPU Parallel Kinematic Mechanism With 2T2R Motion for Knee Diagnosis and Rehabilitation Tasks , 2017 .

[23]  Vera Sa-ing,et al.  Stroke Rehabilitation based on Intelligence Interaction System , 2020, 2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[24]  Rahsaan J. Holley,et al.  Development and pilot testing of HEXORR: Hand EXOskeleton Rehabilitation Robot , 2010, Journal of NeuroEngineering and Rehabilitation.

[25]  B. Brewer,et al.  Poststroke Upper Extremity Rehabilitation: A Review of Robotic Systems and Clinical Results , 2007, Topics in stroke rehabilitation.

[26]  H. Harry Asada,et al.  A robot on the shoulder: Coordinated human-wearable robot control using Coloured Petri Nets and Partial Least Squares predictions , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Maxime Gautier,et al.  Extended Kalman Filtering and Weighted Least Squares Dynamic Identification of Robot , 2000 .

[28]  Cosimo Della Santina,et al.  A technical framework for human-like motion generation with autonomous anthropomorphic redundant manipulators , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Hao Wu,et al.  Mechanism design and kinematics analysis of multifunctional waist rehabilitation bed , 2019, Vibroengineering PROCEDIA.

[30]  Alfonso García-Cerezo,et al.  Enhancing Perception with Tactile Object Recognition in Adaptive Grippers for Human–Robot Interaction , 2018, Sensors.

[31]  Christian Ott,et al.  Cartesian Impedance Control of Redundant and Flexible-Joint Robots , 2008, Springer Tracts in Advanced Robotics.

[32]  Sandra Hirche,et al.  Considering Human Behavior Uncertainty and Disagreements in Human–Robot Cooperative Manipulation , 2017 .

[33]  Charles C. Kemp,et al.  Tracking Human Pose During Robot-Assisted Dressing Using Single-Axis Capacitive Proximity Sensing , 2017, IEEE Robotics and Automation Letters.

[34]  Marcia Kilchenman O'Malley,et al.  Design and characterization of the OpenWrist: A robotic wrist exoskeleton for coordinated hand-wrist rehabilitation , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[35]  Yupeng Ren,et al.  Developing a Wearable Ankle Rehabilitation Robotic Device for in-Bed Acute Stroke Rehabilitation , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Vicente Mata,et al.  A 3-PRS parallel manipulator for ankle rehabilitation: towards a low-cost robotic rehabilitation , 2015, Robotica.

[37]  Arash Ajoudani,et al.  A Collaborative Robotic Approach to Autonomous Pallet Jack Transportation and Positioning , 2020, IEEE Access.

[38]  Delphine Périé,et al.  Refinement of the upper limb joint kinematics and dynamics using a subject-specific closed-loop forearm model , 2015 .

[39]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[40]  Arash Ajoudani,et al.  Towards ergonomie control of human-robot co-manipulation and handover , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[41]  D. Feil-Seifer,et al.  Defining socially assistive robotics , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[42]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Seul Jung,et al.  Force tracking impedance control of robot manipulators under unknown environment , 2004, IEEE Transactions on Control Systems Technology.

[44]  Hermano Igo Krebs,et al.  Rehabilitation Robotics: Performance-Based Progressive Robot-Assisted Therapy , 2003, Auton. Robots.

[45]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[46]  Ou Ma,et al.  Human Posture Recognition Using a Hybrid of Fuzzy Logic and Machine Learning Approaches , 2020, IEEE Access.

[47]  A. Ajoudani,et al.  A Visuo-Haptic Guidance Interface for Mobile Collaborative Robotic Assistant (MOCA) , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[48]  Farshid Amirabdollahian,et al.  Training modalities in robot-mediated upper limb rehabilitation in stroke: a framework for classification based on a systematic review , 2014, Journal of NeuroEngineering and Rehabilitation.

[49]  Aref Afsharfard,et al.  Modeling and experimental study of a hand tremor suppression system , 2018 .

[50]  Vladimír Strejc,et al.  Least squares parameter estimation , 1979, Autom..

[51]  Herman van der Kooij,et al.  A Damper Driven Robotic End-Point Manipulator for Functional Rehabilitation Exercises After Stroke , 2014, IEEE Transactions on Biomedical Engineering.

[52]  Duygun Erol Barkana,et al.  Upper-Extremity Rehabilitation Robot RehabRoby: Methodology, Design, Usability and Validation , 2013 .

[53]  Bidyut Baran Chaudhuri,et al.  A survey of Hough Transform , 2015, Pattern Recognit..