Eye tracking based communication system for patient with major neoro-locomotor disabilites

This paper presents a new technology used for communicating with people with major neuro-locomotor disability by determining gaze direction on a monitor screen. Gaze direction is determined by pupil position through image analysis. The proposed communication technology ensures communication with the patient as follows: (1) on a monitor screen divided in four sections are displayed key words and corresponding ideograms; (2) the patient sees the key words and focuses his/her gaze on a certain section - a pointer allows the control of gaze direction; (3) an infra-red mini/micro video camera placed on the patient's head sends the image of the eye to a computer; (4) the focusing of the patient's gaze on a certain key word i.e. a certain section of the screen is identified by image analysis; (5) voluntary blinking, also objectified by image analysis, shows the selection of a certain word. The patient's wish or need, represented by the key word, is then sent to a server and from there to a caretaker by means of a wire or a wireless transmission system. The absence of a selection within a certain time period causes the displaying of a new set of ideograms. The new technology is useful in the case of the patients who cannot communicate verbally, through signs or in writing and is based on their ability to control eye movement, which is often the case with people with major locomotor disabilities.