Control of mouse movements using human facial expressions

In this paper, a method to create an application which is competent of replacing the traditional input device (mouse) by using human facial features is proposed. Distinctively, using real time videos of the user's face extracted from the video sequence obtained using an off-the-shelf web-camera. It can be applied as an optional input source for those who cannot use their hands due to disabilities or patients who cannot use their hands. In the proposed technique, a method that combines both feature-based and image-based approach is used. The fundamental approach for detection is fast extraction of face candidates using Six-Segmented Rectangular (SSR) filter and then pass them to Support Vector Machine for face verification. In face tracking, the patterns of between-the-eyes are tracked with update template matching. A window that has the feature's template size is scanned over the Region of Interest (ROI) and then calculates the Sum of Squared Difference between a frame that has the feature's template and the current frame. Experiments show that 90% of the system behaves satisfactory for a web-camera at frame rate of 15 fps with the image resolution of 320 times 240 frame size. The system consumes little amount of CPU resources allowing other processors to run smoothly.

[1]  Shinjiro Kawato,et al.  Scale-Adaptive Face Detection and Tracking in Real Time with SSR Filters and Support Vector Machine , 2005, IEICE Trans. Inf. Syst..

[2]  K. Oguri,et al.  Support Vector Machine Based Error Filtering for Holter Electrocardiogram Analysis , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[3]  Xiuwen Liu,et al.  Face detection using spectral histograms and SVMs , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Jean-Christophe Terrillon,et al.  Comparative Performance of Different Chrominance Spaces for Color Segmentation and Detection of Human Faces in Complex Scene Images , 1999 .

[5]  J. Ohya,et al.  Automatic skin-color distribution extraction for face detection and tracking , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[6]  Jacob Str.  Model-Based Real-Time Head Tracking , 2002 .

[7]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[8]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[9]  Jacob Ström.  Model-Based Real-Time Head Tracking , 2002, EURASIP J. Adv. Signal Process..

[10]  Anil K. Jain,et al.  Multimodal Facial Feature Extraction for Automatic 3D Face Recognition , 2005 .

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Martin A. Riedmiller,et al.  Line Based Robot Localization under Natural Light Conditions , 2004 .