Motion Control in VR — Real-time Upper Limb Tracking via IMU and Flex Sensor

Real-time limb motion tracking offers a natural and intuitive way to interact with virtual environment in VR head-mounted displays. In this report, we present an affordable while accurate and lowlatency tracker design using a single IMU plus a flex sensor. A kinematically-constrained model is developed to fuse the 7-degree measurement and reconstruct the state of upper limb. We build a prototype together with a third person shooting game to demonstrate the effectiveness of our design.

[1]  James McNames,et al.  Upper limb joint angle tracking with inertial sensors , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Ling Chen,et al.  IMU/GPS based pedestrian localization , 2012, 2012 4th Computer Science and Electronic Engineering Conference (CEEC).

[3]  Michael Zyda,et al.  Design and implementation of MARG sensors for 3-DOF orientation measurement of rigid bodies , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[4]  Saber Mefoued.  A robust adaptive neural control scheme to drive an actuated orthosis for assistance of knee movements , 2014, Neurocomputing.

[5]  Huosheng Hu,et al.  A Novel Sensing and Data Fusion System for 3-D Arm Motion Tracking in Telerehabilitation , 2008, IEEE Transactions on Instrumentation and Measurement.

[6]  Philippe Poignet,et al.  Joint angle estimation in rehabilitation with inertial sensors and its integration with Kinect , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Jinsoo Jeong.  Normalized estimate of adaptive filter for non-minimum phase transfer function component: An illustrative case study , 2014, Neurocomputing.

[8]  Zhipei Huang,et al.  Hierarchical information fusion for human upper limb motion capture , 2009, 2009 12th International Conference on Information Fusion.

[9]  Chen Feng,et al.  Upper limb motion tracking with the integration of IMU and Kinect , 2015, Neurocomputing.

[10]  F. Raab,et al.  Magnetic Position and Orientation Tracking System , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[11]  Mario Gerla,et al.  StrokeTrack: wireless inertial motion tracking of human arms for stroke telerehabilitation , 2011, mHealthSys '11.

[12]  Simon A. Neild,et al.  Estimation of Upper-Limb Orientation Based on Accelerometer and Gyroscope Measurements , 2008, IEEE Transactions on Biomedical Engineering.

[13]  Xiaoping Yun,et al.  Design, Implementation, and Experimental Results of a Quaternion-Based Kalman Filter for Human Body Motion Tracking , 2006, IEEE Trans. Robotics.

[14]  Michael Zyda,et al.  Inertial and magnetic posture tracking for inserting humans into networked virtual environments , 2001, VRST '01.

[15]  D. Roetenberg,et al.  Xsens MVN: Full 6DOF Human Motion Tracking Using Miniature Inertial Sensors , 2009 .

[16]  Michael Harrington,et al.  WearTrack: a self-referenced head and hand tracker for wearable computers and portable VR , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[17]  C. Charalambous.  The Major Determinants in Normal and Pathological Gait , 2014 .

[18]  Huosheng Hu,et al.  Kinematic model aided inertial motion tracking of human upper limb , 2005, 2005 IEEE International Conference on Information Acquisition.

[19]  Greg Welch,et al.  The HiBall Tracker: high-performance wide-area tracking for virtual and augmented environments , 1999, VRST '99.