Wink Detection on the Eye Image as a Control Tool in Multimodal Interaction

The selected problem of multimodal interaction for multimedia is discussed. The application for visual analysis of eye winking is presented. The proposed algorithm allows interpreting “eye gestures” as appropriate system events, which corresponds to executing system commands. The main aim of this paper is to develop replacing the usage of mouse keys by eye winking. Such a solution can work in multimodal interaction for many different applications. The work of surgeon in the operating room is a good example of situation, where busy hands do not allow controlling the computer system by traditional devices. Introduced interaction based on eye winking can help to communicate with system. The prototype has been built and set of experiments have been carried out in a group of 30 people. Tests have shown high acceptance of the proposed solution.

[1]  Julie Dorsey,et al.  Digital Modeling of Material Appearance , 2007 .

[2]  Pawel Strumillo,et al.  A vision-based head movement tracking system for human-computer interfacing , 2012, 2012 Joint Conference New Trends In Audio & Video And Signal Processing: Algorithms, Architectures, Arrangements And Applications (NTAV/SPA).

[3]  Gladimir V. G. Baranoski,et al.  Light & Skin Interactions: Simulations for Computer Graphics Applications , 2010 .

[4]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[5]  Ashish Kapoor,et al.  A real-time head nod and shake detector , 2001, PUI '01.

[6]  Hari Singh Dhillon,et al.  Human Eye Tracking and Related Issues: A Review , 2012 .

[7]  Haiping Lu,et al.  Non-intrusive head movement analysis of videotaped seizures of epileptic origin , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[9]  Miad Faezipour,et al.  Eye Tracking and Head Movement Detection: A State-of-Art Survey , 2013, IEEE Journal of Translational Engineering in Health and Medicine.

[10]  Z. Muda,et al.  Adaptive User Interface Design In Multimedia Courseware , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[11]  Saverio Perugini,et al.  Pointing Devices for Wearable Computers , 2014, Adv. Hum. Comput. Interact..

[12]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[13]  Kenton O'Hara,et al.  Touchless interaction in surgery , 2014, CACM.

[14]  Ling Shao,et al.  Multimedia Interaction and Intelligent User Interfaces , 2010 .