Classical Flexible Lip Model Based Relative Weight Finder for Better Lip Reading Utilizing Multi Aspect Lip Geometry

Problem statement: Deaf and dumb needs assistance from a technical box that takes movements of lips to identify the words. This technical article provided appropriate model implementation of flexible lip model for better visual lip reading system. Approach: From the frame sequence of words, Active Shape Model (ASM) based lip model provided local tracking and extraction of geometric lip-feature. Two geometric criteria define required geometric features and its variations in the sequence. Results: The feature established machine classification using Analytic Hierarchy Process (AHP), a relative weight finder. AHP presents weight vector to fuzzy classifier to decide the video frame sequence belonging to a respective word. Conclusion: The suggested model tested on a total of 5 different sample databases results in 83.2% accuracy over the other combinational algorithms.

[1]  Thomas L. Saaty,et al.  Multicriteria Decision Making: The Analytic Hierarchy Process: Planning, Priority Setting, Resource Allocation , 1990 .

[2]  Joonki Paik,et al.  Color active shape models for tracking non-rigid objects , 2003, Pattern Recognit. Lett..

[3]  Paul W. Fieguth,et al.  Color-based tracking of heads and other mobile objects at video frame rates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Kirti Peniwati,et al.  Aggregating individual judgments and priorities with the analytic hierarchy process , 1998, Eur. J. Oper. Res..

[5]  Ludmil Mikhailov,et al.  Evaluation of services using a fuzzy analytic hierarchy process , 2004, Appl. Soft Comput..

[6]  T. Santhanam,et al.  A Novel Approach Integrating Geometric and Gabor Wavelet Approaches to Improvise Visual Lipreading , 2010 .

[7]  T. Saaty Relative measurement and its generalization in decision making why pairwise comparisons are central in mathematics for the measurement of intangible factors the analytic hierarchy/network process , 2008 .

[8]  C. Peota Novel approach. , 2011, Minnesota medicine.

[9]  Witold Pedrycz,et al.  An Introduction to Fuzzy Sets , 1998 .

[10]  Shu Hung Leung,et al.  Lip features selection with application to person authentication , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Boaz Golany,et al.  Deriving weights from pairwise comparison matrices: The additive case , 1990 .

[12]  L. Venkata Subramaniam,et al.  Large vocabulary audio-visual speech recognition using active shape models , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  Timothy F. Cootes,et al.  Extraction of Visual Features for Lipreading , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Timothy F. Cootes,et al.  Active Shape Models: Evaluation of a Multi-Resolution Method for Improving Image Search , 1994, BMVC.

[15]  M. Bohanec,et al.  The Analytic Hierarchy Process , 2004 .

[16]  Alan Wee-Chung Liew,et al.  A new optimization procedure for extracting the point-based lip contour using active shape model , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[17]  W. Pedrycz,et al.  An introduction to fuzzy sets : analysis and design , 1998 .

[18]  Jim Graham Image Processing and Analysis: A Practical Approach , 2000 .

[19]  Timothy F. Cootes,et al.  Model-based methods in analysis of Biomedical images. , 1999 .

[20]  Timothy F. Cootes,et al.  Active Shape Model Search using Local Grey-Level Models: A Quantitative Evaluation , 1993, BMVC.