Upper Limbs Motion Tracking for Collaborative Robotic Applications

In the perspective of Industry 4.0, the contemporary presence of workers and robots in the same workspace requires the development of human motion prediction algorithms for a safe and efficient interaction. In this context, the purpose of the present study was to perform an operation of sensor fusion, by creating a collection of spatial and inertial variables of human upper limbs kinematics of typical industrial movements. Spatial and inertial data of ten healthy young subjects performing three pick and place gestures at different heights were measured with a stereophotogrammetric system and Inertial Measurement Units, respectively. Elbow and shoulder angles estimated from both instruments according to a multibody approach showed very similar trends. Moreover, two variables of the database were identified as distinctive features able to differentiate among the three gestures of pick and place.

[1]  Sehoon Ha,et al.  Iterative Training of Dynamic Skills Inspired by Human Coaching Techniques , 2014, ACM Trans. Graph..

[2]  Tido Röder,et al.  Documentation Mocap Database HDM05 , 2007 .

[3]  Wenlong Zhang,et al.  Collision-free trajectory planning in human-robot interaction through hand movement prediction from vision , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[4]  Ruzena Bajcsy,et al.  Berkeley MHAD: A comprehensive Multimodal Human Action Database , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[5]  Julie A. Shah,et al.  Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Jessica K. Hodgins,et al.  Realtime style transfer for unlabeled heterogeneous human motion , 2015, ACM Trans. Graph..

[7]  Martin Buss,et al.  Human-Robot Collaboration: a Survey , 2008, Int. J. Humanoid Robotics.

[8]  Otmar Hilliges,et al.  Learning Human Motion Models for Long-Term Predictions , 2017, 2017 International Conference on 3D Vision (3DV).

[9]  Anita Bagley,et al.  A method for determination of upper extremity kinematics. , 2002, Gait & posture.

[10]  Stefano Pastorelli,et al.  Collision Avoidance Algorithm for Collaborative Robotics , 2017, Int. J. Autom. Technol..

[11]  Kazuhiro Kosuge,et al.  Progress and prospects of the human–robot collaboration , 2017, Autonomous Robots.

[12]  Danica Kragic,et al.  Anticipating Many Futures: Online Human Motion Prediction and Generation for Human-Robot Interaction , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Carlo Alberto Avizzano,et al.  A novel 7 degrees of freedom model for upper limb kinematic reconstruction based on wearable sensors , 2013, 2013 IEEE 11th International Symposium on Intelligent Systems and Informatics (SISY).

[14]  Cristian Sminchisescu,et al.  Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Dmitry Berenson,et al.  Human-robot collaborative manipulation planning using early prediction of human motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Stefano Paolo Pastorelli,et al.  Influence of Human Limb Motion Speed in a Collaborative Hand-over Task , 2018, ICINCO.

[17]  Laura Gastaldi,et al.  Human Activity Recognition by Wearable Sensors : Comparison of different classifiers for real-time applications , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[18]  Matthias Althoff,et al.  Overapproximative arm occupancy prediction for human-robot co-existence built from archetypal movements , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Bryan Buchholz,et al.  ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion--Part II: shoulder, elbow, wrist and hand. , 2005, Journal of biomechanics.

[20]  Terrence Fong,et al.  A Survey of Methods for Safe Human-Robot Interaction , 2017, Found. Trends Robotics.

[21]  Taku Komura,et al.  A Deep Learning Framework for Character Motion Synthesis and Editing , 2016, ACM Trans. Graph..

[22]  Jessica K. Hodgins,et al.  Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database , 2008 .

[23]  Stefano Pastorelli,et al.  Tilt-Twist Method Using Inertial Sensors to Assess Spinal Posture During Gait , 2019, RAAD.

[24]  Steve Marschner,et al.  Matching Real Fabrics with Micro-Appearance Models , 2015, ACM Trans. Graph..