Real-Time Tracking and Display of Human Limb Segment Motions Using Sourceless Sensors and a Quaternion-Based Filtering Algorithm – Part I : Theory

Tracking and display of human limb segment motions has been the topic of much research and development over many years for purposes as varied as basic human physiological studies, physical rehabilitation, sports training, and the construction of anthropomorphic robots. More recently, a new impetus has been given to such work by the desire to produce a whole body human/computer interface system, which encumbers the wearer to a minimum degree and operates over long distances. The input portion of such an interface can be derived by appropriate processing of signals from a nine-axis sensor package consisting of a three-axis angular rate sensor, a three-axis magnetometer, and a three-axis linear accelerometer. In this paper, such a sensor system is called a MARG (Magnetic field, Angular Rate, and Gravity) sensor. Recent advances in micromachining (MEMS) technology, and magnetometer miniaturization, have allowed the development of MARG sensors of very small size, suitable for attachment to individual human limb segments. At the same time, advances in wearable computers and wireless data communication techniques make it feasible to begin the development of a practical full body tracking system using sourceless MARG sensors. This paper focuses on data processing algorithms for MARG sensors. Since human limb segments are capable of arbitrary motion, Euler angles do not provide an appropriate means for specifying orientation. Instead, quaternions are used for this purpose. Since a quaternion is a four-dimensional vector, and a MARG sensor produces nine signals, this data processing problem is “overspecified”. This fact can be used to discriminate against sensor noise and to reduce the effects of linear acceleration on measurement of the gravity vector by accelerometers. Detailed computer simulation studies and the results of preliminary experiments with a prototype body tracking system confirm the effectiveness of the quaternion body-tracking filter.

[1]  Sudhanshu Kumar Semwal,et al.  Mapping Algorithms for Real-Time Control of an Avatar Using Eight Sensors , 1998, Presence.

[2]  Eric Robert Bachmann,et al.  Inertial and Magnetic Tracking of Limb Segment Orientation for Inserting Humans into Synthetic Environments , 2000 .

[3]  Eric Foxlin,et al.  An inertial head-orientation tracker with automatic drift compensation for use with HMD's , 1994 .

[4]  David R. Ellison Rigid Body Dynamics , Inertial Reference Frames , and Graphics Coordinate Systems : A Resolution of Conflicting Conventions and Terminology , 2000 .

[5]  J. Kuipers Quaternions and Rotation Sequences , 1998 .

[6]  German A. Henault A computer simulation study and component evaluation for a quaternion filter for sourceless tracking of human limb segment motion. , 1997 .

[7]  Robert B. McGhee,et al.  Testing and evaluation of an integrated GPS/INS system for small AUV navigation , 1999 .

[8]  Michael Zyda,et al.  Orientation tracking for humans and robots using inertial sensors , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[9]  L. M. M.-T. Theory of Probability , 1929, Nature.

[10]  Frank Biocca,et al.  A Survey of Position Trackers , 1992, Presence: Teleoperators & Virtual Environments.

[11]  Daniel Thalmann,et al.  Human Motion Capture Driven by Orientation Measurements , 1999, Presence: Teleoperators & Virtual Environments.

[12]  Michael Zyda,et al.  NPSNET: Flight Simulation Dynamic Modeling Using Quaternions , 1992, Presence: Teleoperators & Virtual Environments.

[13]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[14]  W. R. Burrus,et al.  MATHEMATICAL PROGRAMMING AND THE NUMERICAL SOLUTION OF LINEAR EQUATIONS. , 1976 .

[15]  H. Hartley The Modified Gauss-Newton Method for the Fitting of Non-Linear Regression Functions by Least Squares , 1961 .

[16]  Brian Everitt Introduction to Optimization Methods and Their Application in Statistics. , 1989 .

[17]  William. Frey Application of inertial sensors and flux-gate magnetometer to real-time human body motion capture , 1996 .

[18]  Anthony Lawrence,et al.  Modern Inertial Technology , 1993 .

[19]  G. A. Bekey,et al.  Computing methods in optimization problems - Gradient methods for the optimization of dynamic system parameters by hybrid computation , 1963 .

[20]  D. Teegarden,et al.  How to model and simulate microgyroscope systems , 1998 .