Eye-based head gestures

A novel method for video-based head gesture recognition using eye information by an eye tracker has been proposed. The method uses a combination of gaze and eye movement to infer head gestures. Compared to other gesture-based methods a major advantage of the method is that the user keeps the gaze on the interaction object while interacting. This method has been implemented on a head-mounted eye tracker for detecting a set of predefined head gestures. The accuracy of the gesture classifier is evaluated and verified for gaze-based interaction in applications intended for both large public displays and small mobile phone screens. The user study shows that the method detects a set of defined gestures reliably.

[1]  C. Darwin,et al.  The Expression of the Emotions in Man and Animals , 1956 .

[2]  Albrecht Schmidt,et al.  Interacting with the Computer Using Gaze Gestures , 2007, INTERACT.

[3]  Ashish Kapoor,et al.  A real-time head nod and shake detector , 2001, PUI '01.

[4]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[5]  Fangmin Shi,et al.  Eye-centric ICT control , 2006 .

[6]  Giulio Sandini,et al.  Oculo-motor stabilization reflexes: integration of inertial and visual information , 1998, Neural Networks.

[7]  Emilie Møllenbach Selection strategies in gaze interaction , 2010 .

[8]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[9]  Rick Kjeldsen,et al.  Head gestures for computer control , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[10]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.

[11]  James W. Davis,et al.  A perceptual user interface for recognizing head gesture acknowledgements , 2001, PUI '01.

[12]  Heiko Drewes,et al.  Eye gaze tracking for human computer interaction , 2010 .

[13]  Jacob O. Wobbrock,et al.  Not Typing but Writing: Eye-based Text Entry Using Letter-like Gestures , 2007 .

[14]  Howell O. Istance,et al.  Designing gaze gestures for gaming: an investigation of performance , 2010, ETRA.

[15]  Poika Isokoski,et al.  Text input methods for eye trackers using off-screen targets , 2000, ETRA.

[16]  Kentaro Toyama,et al.  “Look, Ma – No Hands!” Hands-Free Cursor Control with Real-Time 3D Face Tracking , 1998 .

[17]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[18]  Elisabeth André,et al.  Writing with Your Eye: A Dwell Time Free Writing System Adapted to the Nature of Human Eye Gaze , 2008, PIT.

[19]  Dan Witzner Hansen,et al.  Mobile gaze-based screen interaction in 3D environments , 2011, NGCA '11.

[20]  Hidetoshi Nonaka Communication Interface with Eye-Gaze and Head Gesture Using Successive DP Matching and Fuzzy Inference , 2004, Journal of Intelligent Information Systems.

[21]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[22]  Alastair G. Gale Attention responsive technology and ergonomics , 2005 .

[23]  Marco Porta,et al.  Eye-S: a full-screen input modality for pure eye-based communication , 2008, ETRA.

[24]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.