Motion-Tracking and Speech Recognition for Hands-Free Mouse-Pointer Manipulation

The design of traditional interfaces relies on the use of mouse and keyboard. For people with certain disabilities, however, using these devices presents a real problem. In this chapter we describe a graphical user interface navigation utility, similar in functionality to the traditional mouse pointing device. Movement of the pointer is achieved by tracking the motion of the head, while button-actions can be initiated by issuing a voice command. Foremost in our mind was the goal to make our system easy to use and affordable, and provide users with disabilities with a tool that promotes their independence and social interaction.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  M. J. Easton,et al.  Cross-Platform .NET Development: Using Mono, Portable.NET, and Microsoft .NET , 2004, Apress.

[3]  Walter H. Chang,et al.  The new design of an infrared-controlled human-computer interface for the disabled. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[4]  P Blenkhorn,et al.  Controlling mouse pointer position using an infrared head-operated joystick. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  Frédéric Maire,et al.  A Head-Tracker Based on the Lucas-Kanade Optical Flow Algorithm , 2006, AMT.

[6]  R. Cole,et al.  Survey of the State of the Art in Human Language Technology , 2010 .

[7]  M. Mokhtari,et al.  Notice of Violation of IEEE Publication Principles The Webcam Mouse: Visual 3D Tracking of Body Features to Provide Computer Access for People with Severe Disabilities , 2006, 2006 Annual IEEE India Conference.

[8]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Ta Camus,et al.  Real-Time Optical Flow , 1995 .

[11]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.