Controlling Mouse Motions Using Eye Tracking Using Computer Vision

This paper introduces an algorithm to carry out the functions of a mouse by providing a hands-free interaction between humans and computers. It provi des an alternative to the traditional mouse computer. By using different expressions of a face using computer vision and matching it with already stored expression and execute actions as per the move. This algorithm will help physically disabled people to perform the functions of a mouse using their face and eye movement. It allows them to left-click, right-click, scroll up and down, move the cursor up, down, left, right. The system has a very basic need like webcam, NumPy, dlib, and a few other basic libraries.

[1]  G. C. Stockman,et al.  Computer operation via face orientation , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[2]  Margrit Betke,et al.  Real Time Eye Tracking and Blink Detection with USB Cameras , 2005 .

[3]  J. Jacko,et al.  The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications , 2002 .

[4]  Tereza Soukupová,et al.  Eye-Blink Detection Using Facial Landmarks , 2016 .

[5]  A. Barreto,et al.  Enhanced Hybrid Electromyogram / Eye Gaze Tracking Cursor Control System for Hands-Free Computer Interaction , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Stefanos Zafeiriou,et al.  300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[7]  Arpita Jadhav Bhatt,et al.  Real-Time Driver Drowsiness Detection System Using Eye Aspect Ratio and Eye Closure Ratio , 2019, SSRN Electronic Journal.

[8]  Peter Robinson,et al.  OpenFace: An open source facial behavior analysis toolkit , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[9]  G. Arulkumaran,et al.  HAND MOTION BASED MOUSE CURSOR CONTROL USING IMAGE PROCESSING TECHNIQUE , 2020 .

[10]  Jiahong Su,et al.  A real-time face detection and tracking , 2008, 2008 International Conference on Audio, Language and Image Processing.

[11]  Shashidhar,et al.  Human computer interaction based eye controlled mouse , 2019, 2019 3rd International conference on Electronics, Communication and Aerospace Technology (ICECA).

[12]  Dhaval S. Pimplaskar,et al.  Real Time Eye Blinking Detection and Tracking Using Opencv , 2013 .