An Open-Source 7-DOF Wireless Human Arm Motion-Tracking System for Use in Robotics Research

To extend the choice of inertial motion-tracking systems freely available to researchers and educators, this paper presents an alternative open-source design of a wearable 7-DOF wireless human arm motion-tracking system. Unlike traditional inertial motion-capture systems, the presented system employs a hybrid combination of two inertial measurement units and one potentiometer for tracking a single arm. The sequence of three design phases described in the paper demonstrates how the general concept of a portable human arm motion-tracking system was transformed into an actual prototype, by employing a modular approach with independent wireless data transmission to a control PC for signal processing and visualization. Experimental results, together with an application case study on real-time robot-manipulator teleoperation, confirm the applicability of the developed arm motion-tracking system for facilitating robotics research. The presented arm-tracking system also has potential to be employed in mechatronic system design education and related research activities. The system CAD design models and program codes are publicly available online and can be used by robotics researchers and educators as a design platform to build their own arm-tracking solutions for research and educational purposes.

[1]  Matteo Rubagotti,et al.  Semi-Autonomous Robot Teleoperation With Obstacle Avoidance via Model Predictive Control , 2019, IEEE Robotics and Automation Letters.

[2]  Andrea Maria Zanchettin,et al.  Kinematic analysis and synthesis of the human arm motion during a manipulation task , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Leonardo Meli,et al.  GESTO: A Glove for Enhanced Sensing and Touching Based on Inertial and Magnetic Sensors for Hand Tracking and Cutaneous Feedback , 2017, IEEE Transactions on Human-Machine Systems.

[4]  Zhipei Huang,et al.  Adaptive Information Fusion for Human Upper Limb Movement Estimation , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[6]  Robert B. McGhee,et al.  Design, Implementation, and Experimental Results of a Quaternion-Based Kalman Filter for Human Body Motion Tracking , 2005, IEEE Transactions on Robotics.

[7]  Doik Kim,et al.  Design and implementation of IMU-based human arm motion capture system , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[8]  Jack B. Kuipers,et al.  Quaternions and Rotation Sequences: A Primer with Applications to Orbits, Aerospace and Virtual Reality , 2002 .

[9]  Almas Shintemirov,et al.  A novel low-cost 4-DOF wireless human arm motion tracker , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[10]  Ashish D. Deshpande,et al.  On Integration of Additive Manufacturing During the Design and Development of a Rehabilitation Robot: A Case Study , 2015 .

[11]  Rong Zhu,et al.  A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Robert B. McGhee,et al.  A Simplified Quaternion-Based Algorithm for Orientation Estimation From Earth Gravity and Magnetic Field Measurements , 2008, IEEE Transactions on Instrumentation and Measurement.

[13]  Marcelo H. Ang,et al.  Real-time human-robot interaction in complex environment using kinect v2 image recognition , 2015, 2015 IEEE 7th International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[14]  Gregory J. Pottie,et al.  A simple calibration for upper limb motion tracking and reconstruction , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Peter H. Veltink,et al.  Measuring orientation of human body segments using miniature gyroscopes and accelerometers , 2005, Medical and Biological Engineering and Computing.

[16]  Norbert Schmitz,et al.  Survey of Motion Tracking Methods Based on Inertial Sensors: A Focus on Upper Limb Human Motion , 2017, Sensors.

[17]  Peter Langendörfer,et al.  Detecting Elementary Arm Movements by Tracking Upper Limb Joint Angles With MARG Sensors , 2016, IEEE Journal of Biomedical and Health Informatics.

[18]  Robert F. Kirsch,et al.  Miniature Low-Power Inertial Sensors: Promising Technology for Implantable Motion Capture Systems , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Tao Liu,et al.  How Magnetic Disturbance Influences the Attitude and Heading in Magnetic and Inertial Sensor-Based Orientation Estimation , 2017, Sensors.

[20]  Angelo M. Sabatini,et al.  A Novel Kalman Filter for Human Motion Tracking With an Inertial-Based Dynamic Inclinometer , 2015, IEEE Transactions on Biomedical Engineering.

[21]  Thomas Seel,et al.  Experimental Evaluation of a Novel Inertial Sensor Based Realtime Gait Phase De-tection Algorithm , 2015 .

[22]  D. Roetenberg,et al.  Xsens MVN: Full 6DOF Human Motion Tracking Using Miniature Inertial Sensors , 2009 .

[23]  Guang-Zhong Yang,et al.  Wearable Sensing for Solid Biomechanics: A Review , 2015, IEEE Sensors Journal.

[24]  J.C. Perry,et al.  Design of a 7 Degree-of-Freedom Upper-Limb Powered Exoskeleton , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[25]  Angelo M. Sabatini,et al.  Estimating Three-Dimensional Orientation of Human Body Parts by Inertial/Magnetic Sensing , 2011, Sensors.

[26]  Henry Been-Lirn Duh,et al.  A Wearable Sensing System for Tracking and Monitoring of Functional Arm Movement , 2011, IEEE/ASME Transactions on Mechatronics.

[27]  Almas Shintemirov,et al.  A Low-Cost Open-Source 3-D-Printed Three-Finger Gripper Platform for Research and Educational Purposes , 2015, IEEE Access.

[28]  Almas Shintemirov,et al.  Real-Time Predictive Control of an UR5 Robotic Arm Through Human Upper Limb Motion Tracking , 2017, HRI '17.

[29]  Ryan S McGinnis,et al.  Validation of Novel Relative Orientation and Inertial Sensor-to-Segment Alignment Algorithms for Estimating 3D Hip Joint Angles , 2019, Sensors.

[30]  Gustavo Arechavaleta,et al.  An online inertial sensor-guided motion control for tracking human arm movements by robots , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[31]  James McNames,et al.  Shoulder and Elbow Joint Angle Tracking With Inertial Sensors , 2012, IEEE Transactions on Biomedical Engineering.

[32]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[33]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[34]  J. Borenstein,et al.  Non-GPS Navigation for Security Personnel and First Responders , 2007, Journal of Navigation.

[35]  N. Lovell,et al.  Computationally Efficient Adaptive Error-State Kalman Filter for Attitude Estimation , 2018, IEEE Sensors Journal.

[36]  Zhiqiang Zhang,et al.  A Novel Hierarchical Information Fusion Method for Three-Dimensional Upper Limb Motion Estimation , 2011, IEEE Transactions on Instrumentation and Measurement.

[37]  Yong Yan,et al.  Low Cost Inertial Sensors for the Motion Tracking and Orientation Estimation of Human Upper Limbs in Neurological Rehabilitation , 2020, IEEE Access.

[38]  Angelo M. Sabatini,et al.  Ambulatory Assessment of Instantaneous Velocity during Walking Using Inertial Sensor Measurements , 2016, Sensors.

[39]  Jizhong Xiao,et al.  Keeping a Good Attitude: A Quaternion-Based Orientation Filter for IMUs and MARGs , 2015, Sensors.