Twins: A Practical Vision-based 3D Mouse

Abstract A novel scheme is introduced that uses a mirror and a single camera to restore the 3D position of a finger tip. The camera is positioned in such a way that it captures both the hand as well as its mirror image. The captured images are then processed to extract the contour of the hand. This extraction process is done using a fast algorithm that integrates Bayesian estimation in the traditional chain code generation algorithm. The algorithm works well with a complex, albeit fixed, background. In addition, we have integrated the smoothness assumption into the algorithm so as to obtain a smoother hand contour, thus improving the accuracy of our tracking process. Tolerance to noise can be improved by utilizing the constraints imposed by our system setting to eliminate false signals. A prototype system has been implemented and the performance of the 3D mouse before different backgrounds has been analysed.

[1]  T. S. Huang,et al.  Human computer interaction via the human hand: a hand model , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[2]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[3]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[4]  Pietro Perona,et al.  Monocular tracking of the human arm in 3D , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  DANIEL K. SCHOLTEN,et al.  Chain Coding with a Hexagonal Lattice , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Michael Isard,et al.  Learning to Track the Visual Motion of Contours , 1995, Artif. Intell..

[7]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[8]  A. Dale Magoun,et al.  Decision, estimation and classification , 1989 .

[9]  Guanrong Chen,et al.  Kalman Filtering with Real-time Applications , 1987 .

[10]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Steven D. Pieper,et al.  Hands-on interaction with virtual environments , 1989, UIST '89.

[12]  Takeo Kanade,et al.  DigitEyes: vision-based hand tracking for human-computer interaction , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[13]  Thomas S. Huang,et al.  Virtual Gun, A Vision Based Human Computer Interface Using the Human Hand , 1994, MVA.

[14]  Takeo Kanade,et al.  DigitEyes: Vision-Based Human Hand Tracking , 1993 .

[15]  Michael Gleicher,et al.  The challenges of 3D interaction , 1994, CHI Conference Companion.