Skeleton Tracking Based on Kinect Camera and the Application in Virtual Reality System

Human-computer interaction is one of the key problems in virtual reality systems, and many remarkable solutions using Kinect camera have already been proposed, such as virtual try-on system, sign language translation system, etc. In this paper, we use HTC VIVE device and Kinect camera as the hardware platform to build a Han Chang'an city virtual reality system. In this system, we made models for the main buildings of Han Chang'an City, and also reconstructed reality scenes in HTC VIVE head mounted display. We get position information of skeleton joint by using the Kinect SDK and use quaternion to describe the rotation of joints. The 3D role model is automatically skinned by using dual quaternion linear blending skinning algorithm. Finally, through body posture recognition algorithm, the interactive control in the Han Chang'an City is realized.