Computer Interface to Use Eye and Mouse Movement

In this paper, an interface using eye and mouse for the handicapped people is proposed. The eye regions are localized using neural network (NN)-based texture classifier that discriminates the facial region into eye class and non-eye class, and then are tracked using mean-shift procedure. The mouse region is detected based on edge information and then tracked using template matching. To assess the validity of the proposed system, it was applied to the interface system and was tested on a group of 25 users. The results show that our system has the accuracy of 99%.

[1]  Vladimir Pavlovic,et al.  Toward multimodal human-computer interface , 1998, Proc. IEEE.

[2]  Anthony J. Hornof,et al.  Eyedraw: a system for drawing pictures with eye movements , 2003, ASSETS.

[3]  Yang Jie,et al.  Real-time detecting system of the driver's fatigue , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[4]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Clark F. Olson,et al.  Maximum-likelihood template matching , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Eun Yi Kim,et al.  Eye Tracking Using Neural Network and Mean-Shift , 2006, ICCSA.

[7]  Alex Waibel,et al.  Gaze Tracking Based on Face‐Color , 1995 .

[8]  David Taniar,et al.  Computational Science and Its Applications - ICCSA 2006, International Conference, Glasgow, UK, May 8-11, 2006, Proceedings, Part I , 2006, ICCSA.

[9]  Michael J. Lyons.  Facial gesture interfaces for expression and communication , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[10]  B. Hudgins,et al.  Hidden Markov model classification of myoelectric signals in speech , 2002 .

[11]  Brian Scassellati,et al.  Eye Finding via Face Detection for a Foveated Active Vision System , 1998, AAAI/IAAI.