Virtual Gun, A Vision Based Human Computer Interface Using the Human Hand

Herein, we present an unique vision based computer interface entitled Virtual Gun. In Virtual Gun, a person sits at a computer and points his index finger toward the screen with his thumb pointing up (similar to using one's hand as a gun). Movement of the hand and index finger moves the cursor on the screen. In order to click down on the cursor, one gestures as if he were shooting a gun (e.g., bringing his thumb down to the palm). Releasing the mouse button is equivalent to bringing the thumb back up and away from the palm. The uniqueness in the presented tracking system is in the use of the entire 3-D hand model. This method is in contrast to tracking methods which use only a set of features of the model such as finger edges and tips or other methods which use an internal representation of the hand as is done in neural networks. In addition, there is no need for the user to wear a special glove or other physical items, which allows complete freedom to the user.