Curvature based hand shape recognition for a virtual wheelchair control interface

This paper presents a curvature based hand shape recognition method using images of a hand. The curvatures extracted from hand shape contours are converted to a non-dimensional quantity. Combining the contour geometry with the non-dimensional quantities, signatures are generated for template hand shapes. These template signatures are used to recognize hand shapes embedded in newly acquired image contours. The method provides a means of identifying a hand shape in a position and orientation independent manner. Nevertheless, the position and orientation of the hand gesture can still be obtained. The paper then presents a way to use hand shapes in an efficient virtual interface for a wheelchair. The presented system uses only four ergonomically chosen hand shapes to effect command inputs. The wheelchair operates in two different modes: the manual mode and the autonomous mode. The hand shapes used are arranged in a hierarchy taking into account the safety, ergonomics and reliability of operation. Results are presented to show the behavior of the wheelchair in both modes.

[1]  Chung-Lin Huang,et al.  The model-based dynamic hand posture identification using genetic algorithm , 1998, Machine Vision and Applications.

[2]  Paul A. Beardsley,et al.  Computer Vision for Interactive Computer Graphics , 1998, IEEE Computer Graphics and Applications.

[3]  Kazuo Kyuma,et al.  Computer vision for computer games , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[4]  Vijay Kumar,et al.  Human robot interaction: application to smart wheelchairs , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[5]  Jayantha Katupitiya,et al.  Geometric parameters of hand gesture images for wheelchair control , 2003, Proceedings of the 2003 IEEE International Symposium on Intelligent Control.

[6]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Tomoichi Takahashi,et al.  A hand gesture recognition method and its application , 1992, Systems and Computers in Japan.

[8]  Mubarak Shah,et al.  Visual gesture recognition , 1994 .