Closing the Gaps in Inertial Motion Tracking

A rich body of work has focused on motion tracking techniques using inertial sensors, namely accelerometers, gyroscopes, and magnetometers. Applications of these techniques are in indoor localization, gesture recognition, inventory tracking, vehicular motion, and many others. This paper identifies room for improvement over today's motion tracking techniques. The core observation is that conventional systems have trusted gravity more than the magnetic North to infer the 3D orientation of the object. We find that the reverse is more effective, especially when the object is in continuous fast motion. We leverage this opportunity to design MUSE, a magnetometer-centric sensor fusion algorithm for orientation tracking. Moreover, when the object's motion is somewhat restricted (e.g., human-arm motion restricted by elbow and shoulder joints), we find new methods of sensor fusion to fully leverage the restrictions. Real experiments across a wide range of uncontrolled scenarios show consistent improvement in orientation and location accuracy, without requiring any training or machine learning. We believe this is an important progress in the otherwise mature field of IMU-based motion tracking.

[1]  Sebastian O. H. Madgwick,et al.  An efficient orientation filter for inertial and inertial / magnetic sensor arrays , 2010 .

[2]  Desney S. Tan,et al.  FingerIO: Using Active Sonar for Fine-Grained Finger Tracking , 2016, CHI.

[3]  Hee-Jun Kang,et al.  A DCM Based Orientation Estimation Algorithm with an Inertial Measurement Unit and a Magnetic Compass , 2009, J. Univers. Comput. Sci..

[4]  Chai Kiat Yeo,et al.  Algorithm for 3D orientation estimation based on Kalman Filter and Gradient Descent , 2016, 2016 IEEE 7th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[5]  He Wang,et al.  MoLe: Motion Leaks through Smartwatch Sensors , 2015, MobiCom.

[6]  He Wang,et al.  I am a Smartwatch and I can Track my User's Arm , 2016, MobiSys.

[7]  Mark Euston,et al.  A complementary filter for attitude estimation of a fixed-wing UAV , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Evangelos Kalogerakis,et al.  RisQ: recognizing smoking gestures with inertial sensors on a wristband , 2014, MobiSys.

[9]  Lili Qiu,et al.  CAT: high-precision acoustic motion tracking , 2016, MobiCom.

[10]  Vadim Bistrov Performance Analysis of Alignment Process of MEMS IMU , 2012 .

[11]  Huosheng Hu,et al.  Inertial measurements of upper limb motion , 2006, Medical and Biological Engineering and Computing.

[12]  Robert E. Mahony,et al.  Nonlinear Complementary Filters on the Special Orthogonal Group , 2008, IEEE Transactions on Automatic Control.

[13]  Swarun Kumar,et al.  Decimeter-Level Localization with a Single WiFi Access Point , 2016, NSDI.

[14]  Seul Jung,et al.  Gyro sensor drift compensation by Kalman filter to control a mobile inverted pendulum robot system , 2009, 2009 IEEE International Conference on Industrial Technology.

[15]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[16]  Xinyu Zhang,et al.  Gyro in the air: tracking 3D orientation of batteryless internet-of-things , 2016, MobiCom.

[17]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[18]  James McNames,et al.  Shoulder and Elbow Joint Angle Tracking With Inertial Sensors , 2012, IEEE Transactions on Biomedical Engineering.

[19]  Youngnam Han,et al.  SmartPDR: Smartphone-Based Pedestrian Dead Reckoning for Indoor Localization , 2015, IEEE Sensors Journal.

[20]  Xin Xu,et al.  Sensor fusion-based attitude estimation using low-cost MEMS-IMU for mobile robot navigation , 2011, 2011 6th IEEE Joint International Information Technology and Artificial Intelligence Conference.

[21]  Mo Li,et al.  Use it free: instantly knowing your phone attitude , 2014, MobiCom.

[22]  Angelo M. Sabatini,et al.  Quaternion-based extended Kalman filter for determining orientation by inertial and magnetic sensing , 2006, IEEE Transactions on Biomedical Engineering.

[23]  R.C. Hayward,et al.  Design of multi-sensor attitude determination systems , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[24]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[25]  Yangquan Chen,et al.  A comparative evaluation of low-cost IMUs for unmanned autonomous systems , 2010, 2010 IEEE Conference on Multisensor Fusion and Integration.

[26]  Michael Zyda,et al.  Inertial and magnetic posture tracking for inserting humans into networked virtual environments , 2001, VRST '01.

[27]  M. Gokasan,et al.  Multi-sensor data fusion of DCM based orientation estimation for land vehicles , 2011, 2011 IEEE International Conference on Mechatronics.

[28]  Piotr Skrzypczynski,et al.  Performance Comparison of EKF-Based Algorithms for Orientation Estimation on Android Platform , 2015, IEEE Sensors Journal.

[29]  Mahmoud El-Gohary,et al.  Joint angle tracking with inertial sensors , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Dong Sun,et al.  A linear fusion algorithm for attitude determination using low cost MEMS-based sensors , 2007 .

[31]  John L. Crassidis,et al.  Survey of nonlinear attitude estimation methods , 2007 .

[32]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[33]  Zimu Zhou,et al.  Enabling Gesture-based Interactions with Objects , 2017, MobiSys.

[34]  Hugh F. Durrant-Whyte,et al.  Inertial navigation systems for mobile robots , 1995, IEEE Trans. Robotics Autom..

[35]  Tor Arne Johansen,et al.  Globally exponentially stable attitude and gyro bias estimation with application to GNSS/INS integration , 2015, Autom..

[36]  Frédo Durand,et al.  Capturing the human figure through a wall , 2015, ACM Trans. Graph..

[37]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[38]  Laura Rocchi,et al.  Ambulatory measurement of shoulder and elbow kinematics through inertial and magnetic sensors , 2008, Medical & Biological Engineering & Computing.

[39]  Sangki Yun,et al.  Turning a Mobile Device into a Mouse in the Air , 2015, MobiSys.

[40]  艾而帝,et al.  Microsoft Kinect 虛擬復健系統設計 , 2013 .

[41]  Antoni Grau,et al.  Attitude and Heading System based on EKF total state configuration , 2011, 2011 IEEE International Symposium on Industrial Electronics.

[42]  Huosheng Hu,et al.  Upper limb motion estimation from inertial measurements , 2007 .

[43]  Eric Foxlin,et al.  Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[44]  Jinling Wang,et al.  Effective Adaptive Kalman Filter for MEMS-IMU/Magnetometers Integrated Attitude and Heading Reference Systems , 2012, Journal of Navigation.

[45]  N. Shantha Kumar,et al.  Estimation of attitudes from a low-cost miniaturized inertial platform using Kalman Filter-based sensor fusion algorithm , 2004 .

[46]  Felipe Espinosa,et al.  UAV Attitude Estimation Using Unscented Kalman Filter and TRIAD , 2012, IEEE Transactions on Industrial Electronics.

[47]  Robert B. McGhee,et al.  An extended Kalman filter for quaternion-based orientation estimation using MARG sensors , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[48]  Gu-Min Jeong,et al.  Step-Detection and Adaptive Step-Length Estimation for Pedestrian Dead-Reckoning at Various Walking Speeds Using a Smartphone , 2016, Sensors.

[49]  Qiang Liu,et al.  Practical Human Sensing in the Light , 2016, GETMBL.

[50]  Y. Manoli,et al.  Efficient orientation estimation algorithm for low cost inertial and magnetic sensor systems , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[51]  Parth H. Pathak,et al.  Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch , 2015, HotMobile.

[52]  Marko Topič,et al.  Calibration and data fusion solution for the miniature attitude and heading reference system , 2007 .

[53]  J. Vanfleteren,et al.  3D orientation tracking based on unscented Kalman filtering of accelerometer and magnetometer data , 2009, 2009 IEEE Sensors Applications Symposium.

[54]  Adam W. Hoover,et al.  A New Method for Measuring Meal Intake in Humans via Automated Wrist Motion Tracking , 2012, Applied Psychophysiology and Biofeedback.

[55]  Michal R. Nowicki,et al.  Simplicity or flexibility? Complementary Filter vs. EKF for orientation estimation on mobile devices , 2015, 2015 IEEE 2nd International Conference on Cybernetics (CYBCONF).

[56]  Otmar Loffeld,et al.  Reduced DCM based attitude estimation using low-cost IMU and magnetometer triad , 2011, 2011 8th Workshop on Positioning, Navigation and Communication.