Whole-Body Pose Estimation in Human Bicycle Riding Using a Small Set of Wearable Sensors

Tracking whole-body human pose in physical human-machine interactions is challenging because of highly dimensional human motions and lack of inexpensive, nonintrusive motion sensors in outdoor environment. In this paper, we present a computational scheme to estimate the human whole-body pose with application to bicycle riding using a small set of wearable sensors. The estimation scheme is built on the fusion of gyroscopes, accelerometers, force sensors, and physical rider-bicycle interaction constraints through an extended Kalman filter design. The use of physical rider-bicycle interaction constraints helps not only eliminate the integration drifts of inertial sensor measurements but also reduce the number of the needed wearable sensors for pose estimation. For each set of the upper and the lower limb, only one tri-axial gyroscope is needed to accurately obtain the 3-D pose information. The drift-free, reliable estimation performance is demonstrated through both indoor and outdoor riding experiments.

[1]  Bryan Buchholz,et al.  ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion--Part II: shoulder, elbow, wrist and hand. , 2005, Journal of biomechanics.

[2]  B. Espiau,et al.  A Wearable Sensor Network for Gait Analysis: A Six-Day Experiment of Running Through the Desert , 2011, IEEE/ASME Transactions on Mechatronics.

[3]  Pascal Fua,et al.  Estimation and visualization of sagittal kinematics of lower limbs orientation using body-fixed sensors , 2006, IEEE Transactions on Biomedical Engineering.

[4]  Huosheng Hu,et al.  Integration of Vision and Inertial Sensors for 3D Arm Motion Tracking in Home-based Rehabilitation , 2007, Int. J. Robotics Res..

[5]  Kamiar Aminian,et al.  A Novel Approach to Reducing Number of Sensing Units for Wearable Gait Analysis Systems , 2013, IEEE Transactions on Biomedical Engineering.

[6]  Peter H. Veltink,et al.  Measuring orientation of human body segments using miniature gyroscopes and accelerometers , 2005, Medical and Biological Engineering and Computing.

[7]  Yizhai Zhang,et al.  Whole-body pose estimation in physical rider-bicycle interactions with a monocular camera and a set of wearable gyroscopes , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Luis Mejías Alvarez,et al.  Error analysis and attitude observability of a monocular GPS/visual odometry integrated navigation filter , 2012, Int. J. Robotics Res..

[9]  Hartmut Witte,et al.  ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion, I: ankle, hip, and spine , 2002 .

[10]  Peter H. Veltink,et al.  Ambulatory Position and Orientation Tracking Fusing Magnetic and Inertial Sensing , 2007, IEEE Transactions on Biomedical Engineering.

[11]  Yizhai Zhang,et al.  Pose estimation in physical human-machine interactions with application to bicycle riding , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Huosheng Hu,et al.  Reducing Drifts in the Inertial Measurements of Wrist and Elbow Positions , 2010, IEEE Transactions on Instrumentation and Measurement.

[13]  M. Tomizuka,et al.  A Gait Monitoring System Based on Air Pressure Sensors Embedded in a Shoe , 2009, IEEE/ASME Transactions on Mechatronics.

[14]  WF Abdo,et al.  The “bicycle sign” for atypical parkinsonism , 2011, The Lancet.

[15]  Yizhai Zhang,et al.  Rider/bicycle pose estimation with IMU/seat force measurements , 2012, 2012 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[16]  Michael Beetz,et al.  Model-Free Detection, Encoding, Retrieval, and Visualization of Human Poses From Kinect Data , 2015, IEEE/ASME Transactions on Mechatronics.

[17]  B. Bloem,et al.  Images in clinical medicine. Cycling for freezing of gait. , 2010, The New England journal of medicine.

[18]  Simon A. Neild,et al.  Estimation of Upper-Limb Orientation Based on Accelerometer and Gyroscope Measurements , 2008, IEEE Transactions on Biomedical Engineering.

[19]  Kamiar Aminian,et al.  Spatio-temporal parameters of gait measured by an ambulatory system using miniature gyroscopes. , 2002, Journal of biomechanics.

[20]  P.H. Veltink,et al.  A model-based approach to stabilizing crutch supported paraplegic standing by artificial hip joint stiffness , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Chul-Gyu Song,et al.  A new postural balance control system for rehabilitation training based on virtual cycling. , 2004, IEEE transactions on information technology in biomedicine : a publication of the IEEE Engineering in Medicine and Biology Society.

[22]  Yizhai Zhang,et al.  Rider Trunk and Bicycle Pose Estimation With Fusion of Force/Inertial Sensors , 2013, IEEE Transactions on Biomedical Engineering.

[23]  Paolo Bonato,et al.  Robotic Gait Rehabilitation Trainer , 2014, IEEE/ASME Transactions on Mechatronics.

[24]  Dezhen Song,et al.  Kinematic Modeling and Analysis of Skid-Steered Mobile Robots With Applications to Low-Cost Inertial-Measurement-Unit-Based Motion Estimation , 2009, IEEE Transactions on Robotics.

[25]  P H Veltink,et al.  Ambulatory measurement of arm orientation. , 2007, Journal of biomechanics.

[26]  Roman Kamnik,et al.  An inertial and magnetic sensor based technique for joint angle measurement. , 2007, Journal of biomechanics.

[27]  Jingang Yi,et al.  Body-Segment Orientation Estimation in Rider-Bicycle Interactions With an Un-Calibrated Monocular Camera and Wearable Gyroscopes , 2013 .

[28]  Hartmut Witte,et al.  ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion--part I: ankle, hip, and spine. International Society of Biomechanics. , 2002, Journal of biomechanics.

[29]  Hans-Peter Seidel,et al.  Motion reconstruction using sparse accelerometer data , 2011, TOGS.

[30]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, SIGGRAPH 2007.

[31]  Mickaël Begon,et al.  Lower limb contribution in kayak performance: modelling, simulation and analysis , 2010 .