Design and Development of a Low-Cost Eye Tracking System for the Rehabilitation of the Completely Locked-In Patient

This article describes the design and development process of an eye tracking-based computer system that benefits from the intact ocular motor control of the completely locked-in patient to provide him or her with an alternative means of communication. A completely locked-in patient is an individual who has lost all types of motor control and communication ability with people in his or her environment. This developed system uses a head-mounted web camera to capture real-time images of the patient's eye. These images are then passed to a program, developed using Matlabreg, which processes them and computes the coordinates of the pupil position. The program then sends commands to an interactive JAVAtrade-based interface, which provides the patient with a matrix of pictograms representing the most essential daily communication activities. When a pictogram is activated (clicked), the system plays back an audible statement, recorded in any language, reflecting the desired activity. Ten healthy adult volunteers, free from any musculoskeletal or neurological disorders, participated in the validation of the system. Validation results revealed a system accuracy of 96.11plusmn5.58 % and repeatability of 94.44plusmn2.51 %. The rehabilitative system developed in this project offers the locked-in patient, of any social class, the ability of simple yet effective communication. The advantages of this system over existing systems are low cost, low processing power, ease of operation, little training requirements, minimal disturbance to the patient, and ease of customization to any mother tongue

[1]  P.R. Kennedy,et al.  A decision tree for brain-computer interface devices , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  H.L. Galiana,et al.  An internally switched model of ocular tracking with prediction , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Gernot R. Müller-Putz,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3152–3155 c ○ 2005 Hindawi Publishing Corporation EEG-Based Asynchronous BCI Controls Functional Electrical Stimulation in a Tetraplegic Patient , 2004 .

[4]  Z. O. Abu-Faraj,et al.  Surgical rehabilitation of the planovalgus foot in cerebral palsy , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  M. Mazo,et al.  System for assisted mobility using eye movements based on electrooculography , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Amarnag Subramanya,et al.  Real time eye tracking for human computer interfaces , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[7]  Yu-Luen Chen,et al.  Application of tilt sensors in human-computer mouse interface for people with disabilities. , 2001, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[8]  Dongheng Li,et al.  Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[9]  John G. Webster,et al.  Medical Instrumentation: Application and Design , 1997 .

[10]  P. Brodal.  The Central Nervous System , 1992 .

[11]  Moshe Eizenman,et al.  A new methodology for determining point-of-gaze in head-mounted eye tracking systems , 2004, IEEE Transactions on Biomedical Engineering.

[12]  Walter H. Chang,et al.  The new design of an infrared-controlled human-computer interface for the disabled. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  M. Betke,et al.  The Camera Mouse: visual tracking of body features to provide computer access for people with severe disabilities , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.