Natural Mouse-a novel human computer interface

Face tracking allows hands-free human computer interactions. In spite of advances in computer hardware and efficient and robust vision algorithms for tracking, the requirement of face and facial tracking in particular situations remains unclear. This paper considers the problems of building a human computer interface via face tracking and describes an architecture for a novel tool-Natural Mouse. Natural Mouse allows the merger of state-of-art face-related techniques and human demands. The advantage of the Natural Mouse is that people can dynamically configure it and control it by facial gestures and face motion without the need to wear any accessory. A mouse icon displayed on the computer monitor visualizes the Natural Mouse and helps people to control it. An immediate application of the Natural Mouse will be as a device that enables people with hand and speech disabilities to communicate with a computer.

[1]  Alex Pentland,et al.  Bayesian face recognition using deformable intensity surfaces , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Michael J. Black,et al.  Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Saburo Tsuji,et al.  Recognizing human facial expressions in a potential field , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[5]  Thomas S. Huang,et al.  Face Detection and Recognition , 1998 .

[6]  Thomas S. Huang,et al.  3D head pose computation from 2D images: templates versus features , 1995, Proceedings., International Conference on Image Processing.

[7]  Koichiro Deguchi,et al.  Head pose determination from one image using a generic model , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[8]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Qian Chen,et al.  3D head pose estimation without feature tracking , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[10]  Takeo Kanade,et al.  Automated facial expression recognition based on FACS action units , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[11]  Alexander Zelinsky,et al.  3-D facial pose and gaze point estimation using a robust real-time tracking paradigm , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[12]  Dimitris N. Metaxas,et al.  The integration of optical flow and deformable models with applications to human face shape and motion estimation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Thomas S. Huang,et al.  Explanation-based facial motion tracking using a piecewise Bezier volume deformation model , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).