Vision based human interaction system for disabled

This research work is related to the application of machine vision technique to develop a robust assistive human computer interaction technology for those with physical accessibility problem of controlling mouse and keyboard with hand. Paper's main motif is inferring information about planer movement of the head using a video camera and transforming this motion to the pixel coordinate system of the display so as to control the position of mouse pointer. Iterative sparse optical flow algorithm computes the pattern of apparent motion between sequential facial image frames captured by the webcam. Adaboost based Cascaded Harr classifier is used to detect face and eye across frames and we have given special attention towards the issues involving drawback regarding misdetection of tilted faces in the image frame inspite of training our datasets with tilted facial images. Left/Right eye blink is used to control the clicking event of mouse. Blink of eye is modelled by fitting the trained data using Spline and Gaussian curve which determines the likelihood function to determine the posterior probability. This work is motivated by the need to design an affordable real-time system in the interest of a large serving community.

[1]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  M. Betke,et al.  The Camera Mouse: visual tracking of body features to provide computer access for people with severe disabilities , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Yiannis Aloimonos,et al.  A Roadmap to the Integration of Early Visual Modules , 2007, International Journal of Computer Vision.

[5]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Su Ruan,et al.  A robust agorithm for eye detection on gray intensity face without spectacles , 2005 .

[7]  Youngwook Kim,et al.  A novel development of head-set type computer mouse using gyro sensors for the handicapped , 2002, 2nd Annual International IEEE-EMBS Special Topic Conference on Microtechnologies in Medicine and Biology. Proceedings (Cat. No.02EX578).

[8]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[9]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Youngwook Kim.  Development of headset-type computer mouse using gyro sensors for the handicapped , 2002 .

[11]  James Gips,et al.  Direct Control of the Computer Through Electrodes Placed Around the Eyes , 1993, HCI.

[12]  Yu-Luen Chen,et al.  Application of tilt sensors in human-computer mouse interface for people with disabilities. , 2001, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  Margrit Betke,et al.  THE CAMERA MOUSE: PRELIMINARY INVESTIGATION OF AUTOMATED VISUAL TRACKING FOR COMPUTER ACCESS , 2000 .

[14]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Yu-Luen Chen.  Application of tilt sensors in human-computer mouse interface for people with disabilities , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  P Blenkhorn,et al.  Controlling mouse pointer position using an infrared head-operated joystick. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[17]  Marcel Tresanchez,et al.  Using the Optical Flow to Implement a Relative Virtual Mouse Controlled by Head Movements , 2008, J. Univers. Comput. Sci..

[18]  Frédéric Maire,et al.  Hands-free mouse-pointer manipulation using motion-tracking and speech recognition , 2007, OZCHI '07.

[19]  Yiannis Aloimonos,et al.  Shape and the Stereo Correspondence Problem , 2005, International Journal of Computer Vision.

[20]  Jyh-Horng Chen,et al.  Webcam Mouse Using Face and Eye Tracking in Various Illumination Environments , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.