A Method for Predicting Words by Interpreting Labial Movements

The study of lips movements is relevant for a series of interesting applications in real world to enhance the communication means and in medical applications. In the present paper we illustrate a method we implemented with the purpose of helping Amyotrophic Lateral Schlerosys (ALS) patients to communicate, once the progress of the disease requires to intubate the patient and the voice is lost.

[1]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[2]  Osvaldo Gervasi,et al.  A Brain Computer Interface for Enhancing the Communication of People with Severe Impairment , 2014, ICCSA.

[3]  Osvaldo Gervasi,et al.  Mixed Reality for Improving Tele-rehabilitation Practices , 2015, ICCSA.

[4]  Piero Cosi,et al.  Italian consonantal visemes: relationships between spatial/ temporal articulatory characteristics and coproduced acoustic signal , 1997, AVSP.

[5]  Ulrich Canzler,et al.  Extraction of Non Manual Features for Videobased Sign Language Recognition , 2002, MVA.

[6]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[7]  Patrice Delmas,et al.  Automatic lip tracking: Bayesian segmentation and active contours in a cooperative scheme , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[8]  Osvaldo Gervasi,et al.  The AES Implantation Based on OpenCL for Multi/many Core Architecture , 2010, 2010 International Conference on Computational Science and Its Applications.

[9]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[10]  Jean-Luc Dugelay,et al.  Combining Edge Detection and Region Segmentation for Lip Contour Extraction , 2010, AMDO.

[11]  Osvaldo Gervasi,et al.  Nu!RehaVR: virtual reality in neuro tele-rehabilitation of patients with traumatic brain injury and stroke , 2009, Virtual Reality.

[12]  Kenneth Ward Church,et al.  A Program for Aligning Sentences in Bilingual Corpora , 1993, CL.

[13]  P. Mahalanobis.  On the generalized distance in statistics , 1936 .