Game interface using hand gesture recognition

In this paper, we propose a real-time hand gesture recognition system based on difference image entropy using a stereo camera. Existing systems use hand detection primarily with some type of marker. Our system, however, uses a real-time hand image recognition system. In the detection step, we implement a depth map using a sum of absolute differences based on the acquired right-left image using a stereo camera. This system detects a foreground object and perceives it as a hand. The hand gesture recognition system uses the difference image entropy of the input image and the average image. To evaluate the performance of the proposed technology, we implement a recognition experiment using the hand gesture 240 database. The proposed method shows an average recognition rate of 85%. Using the proposed method, we implement a Chinese chess game based on hand gesture recognition.

[1]  Jinhai Cai Fast Stereo Matching: Coarser to Finer with Selective Updating , 2007 .

[2]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  Ayoub Al-Hamadi,et al.  Hand Gesture Recognition Based on Combined Features Extraction , 2009 .

[4]  A. Al-Hamadi,et al.  Gesture Recognition for Alphabets from Hand Motion Trajectory Using Hidden Markov Models , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[5]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[6]  Pierre Cubaud,et al.  Supporting 3D window manipulation with a yawing mouse , 2006, NordiCHI '06.

[7]  Stamatis Vassiliadis,et al.  A sum of absolute differences implementation in FPGA hardware , 2002, Proceedings. 28th Euromicro Conference.

[8]  Lionel Delphin-Poulat,et al.  From a Wizard of Oz experiment to a real time speech and gesture multimodal interface , 2006, Signal Process..

[9]  Emanuele Trucco,et al.  A compact algorithm for rectification of stereo pairs , 2000, Machine Vision and Applications.