Study and Application of Detecting Blinks for Communication Assistant Tool

Abstract We try to develop a support application for physically handicapped children to communicate with others by blinks. Because of limited body movements and mental disorders, many of them cannot communicate with their families or caregivers. If they can use applications in smart phones by blinks, they will be able to tell what they really need or want. Fist, we try to detect an eye area by using OpenCv. Then we develop the way to detect opening and closing of eyes. We combine the method using saturation and using complexity of image to get more accurate results to detect blinks. Then we develop the technique into a communication application that has the accurate and high-precision blink determination system to detect letters and put them into sound.

[1]  Naohiro Ishii,et al.  Development and Study of Support Applications for Autistic Children , 2013, 2013 14th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing.

[2]  Kenryu Nakamura.  Use of VOCA in Children with Intellectual Disabilities and/or Autistic Tendencies : Observations of VOCA Play Settings and Speech Abilities in Two Special Schools , 1997 .

[3]  Kenryu Nakamura,et al.  Effects and limitations of communication aids The use of communication aids for people with cognitive disabilities , 2001 .

[4]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[5]  Naohiro Ishii,et al.  Study and Development of Support Tool with Blinks for Physically Handicapped Children , 2013, 2013 IEEE 25th International Conference on Tools with Artificial Intelligence.

[6]  Naohiro Ishii,et al.  Study and Development of Schedule Application for Autistic Children , 2013, 2013 Second IIAI International Conference on Advanced Applied Informatics.

[7]  Donald P. Greenberg,et al.  Color spaces for computer graphics , 1978, SIGGRAPH.

[8]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Naohiro Ishii,et al.  Augmentative and alternative communication with digital assistant for autistic children , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[10]  Naohiro Ishii,et al.  Voice output communication aid application for personal digital assistant for autistic children , 2012, 2012 IEEE/ACIS 11th International Conference on Computer and Information Science.