Random-Forest-Based Initializer for Real-time Optimization-based 3D Motion Tracking Problems

Many motion tracking systems require solving inverse problem to compute the tracking result from original sensor measurements, such as images from cameras and signals from receivers. For real-time motion tracking, such typical solutions as the Gauss-Newton method for solving their inverse problems need an initial value to optimize the cost function through iterations. A powerful initializer is crucial to generate a proper initial value for every time instance and, for achieving continuous accurate tracking without errors and rapid tracking recovery even when it is temporally interrupted. An improper initial value easily causes optimization divergence, and cannot always lead to reasonable solutions. Therefore, we propose a new initializer based on random-forest to obtain proper initial values for efficient real-time inverse problem computation. Our method trains a random-forest model with varied massive inputs and corresponding outputs and uses it as an initializer for runtime optimization. As an instance, we apply our initializer to IM3D, which is a real-time magnetic 3D motion tracking system with multiple tiny, identifiable, wireless, occlusion-free passive markers (LC coils). During run-time, a proper initial value is obtained from the initializer based on sensor measurements, and the system computes each position of the actual markers and poses by solving the inverse problem through an optimization process in real-time. We conduct four experiments to evaluate reliability and performance of the initializer. Compared with traditional or naive initializers (i.e., using a static value or random values), our results show that our proposed method provides recovery from tracking loss in a wider range of tracking space, and the entire process (initialization and optimization) can run in real-time.

[1]  Yoshifumi Kitamura,et al.  IM3D: magnetic motion tracking system for dexterous 3D interactions , 2014, SIGGRAPH '14.

[2]  Jinxiang Chai,et al.  Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data , 2012, SCA '12.

[3]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[4]  Andrew W. Fitzgibbon,et al.  Accurate, Robust, and Flexible Real-time Hand Tracking , 2015, CHI.

[5]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[6]  William Stafford Noble,et al.  Support vector machine , 2013 .

[7]  Weida Tong,et al.  Decision Forest: Combining the Predictions of Multiple Independent Decision Tree Models , 2003, J. Chem. Inf. Comput. Sci..

[8]  Mike Fraser,et al.  DeskWave: Desktop Interactions using Low-cost Microwave Doppler Arrays , 2017, CHI Extended Abstracts.

[9]  Yoshifumi Kitamura,et al.  6-DOF computation and marker design for magnetic 3D dexterous motion-tracking system , 2016, VRST.

[10]  Yasuo Okazaki,et al.  Wireless magnetic motion capture system using multiple LC resonant magnetic markers with high accuracy , 2008 .

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  F. Raab,et al.  Magnetic Position and Orientation Tracking System , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Yoshifumi Kitamura,et al.  IM6D: magnetic tracking system with 6-DOF passive markers for dexterous 3D interaction and motion , 2015, ACM Trans. Graph..

[14]  T. Pintaric,et al.  Affordable Infrared-Optical Pose-Tracking for Virtual and Augmented Reality , 2007 .