A real-time collision detection between virtual and real objects based on three-dimensional tracking of hand

In the working environment of argument reality, users interact with virtual objects by hands. Making real-time collision detection between virtual and real objects is very essential to enhance the immersion and authenticity of the environment. In this paper, the key points of hand are marked by color block. We use a pair of common web cameras to collect images and track the points. Then the stereo vision calibration algorithm is achieved. We get hand positioning by calculating the disparity of key points between two images and restoring the three-dimensional position. At the same time, the virtual object models are divided to a binary tree and pretreated by the OBB bounding box. At last, the accurate collision detection is achieved by calculating the relative position between real hand and virtual objects real-time.

[1]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[2]  Roger Moret Gabarró Interactive augmented reality , 2010 .

[3]  Carme Torras,et al.  3D collision detection: a survey , 2001, Comput. Graph..

[4]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[5]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Christopher M. Brown,et al.  Interactive Augmented Reality , 1998 .

[8]  Carlo Tomasi,et al.  Mean shift is a bound optimization , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Takeo Kanade,et al.  Visual hull alignment and refinement across time: a 3D reconstruction algorithm combining shape-from-silhouette with stereo , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.