Linguistic descriptors in face recognition: A literature survey and the perspectives of future development

People are highly efficient in recognizing faces. However, it is almost impossible for them to cope with huge datasets of facial images without any computational support. On the other hand, the way people describe the facial features using quite commonly encountered descriptors such as “long nose”, “small eyes” and also allude to their feelings according to a specific person like “seems to be nice”, may be utilized to enhance automatic face recognition systems. This offers an interesting possibility to incorporate human perception of faces and relations between facial features into machine-made computations. To address this aspect, one can engage the linguistic descriptors and the linguistic modeling. In this study, we present a comprehensive survey of the state-of-the-art studies and elaborate on some promising perspectives of the developments in this area.

[1]  P. Jonathon Phillips,et al.  Support Vector Machines Applied to Face Recognition , 1998, NIPS.

[2]  Takeo Kanade,et al.  Computer recognition of human faces , 1980 .

[3]  Gleb Beliakov,et al.  Aggregation Functions: A Guide for Practitioners , 2007, Studies in Fuzziness and Soft Computing.

[4]  A. A. Alattab,et al.  Semantic Features Selection and Representation for Facial Image Retrieval System , 2013, 2013 4th International Conference on Intelligent Systems, Modelling and Simulation.

[5]  D. Navon Forest before trees: The precedence of global features in visual perception , 1977, Cognitive Psychology.

[6]  Takehisa Onisawa,et al.  Drawing human faces using words and conceptual fuzzy sets , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[7]  Lotfi A. Zadeh,et al.  The concept of a linguistic variable and its application to approximate reasoning-III , 1975, Inf. Sci..

[8]  Zeshui Xu,et al.  Linguistic Decision Making , 2019 .

[9]  Thomas L. Saaty What is the analytic hierarchy process , 1988 .

[10]  P. Forczmański,et al.  Two-dimensional LDA approach to image compression and recognition , 2006 .

[11]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[12]  M. M. Sufyan Beg,et al.  Face sketch recognition using sketching with words , 2015, Int. J. Mach. Learn. Cybern..

[13]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[14]  Jian-Kang Wu,et al.  Fuzzy Content-based Retrieval in Image Databases , 1998, Inf. Process. Manag..

[15]  Maciej Smiatacz,et al.  Eigenfaces, Fisherfaces, Laplacianfaces, Marginfaces - How to Face the Face Verification Task , 2013, CORES.

[16]  Andrea Bottino,et al.  Detecting siblings in image pairs , 2013, The Visual Computer.

[17]  Anca L. Ralescu,et al.  Improved retrieval in a fuzzy database from adjusted user input , 1995, Journal of Intelligent Information Systems.

[18]  Alphonse Bertillon,et al.  Identification anthropométrique : instructions signalétiques , 1893 .

[19]  B Julesz,et al.  Masking in Visual Recognition: Effects of Two-Dimensional Filtered Noise , 1973, Science.

[20]  Witold Pedrycz,et al.  Granular Computing: Analysis and Design of Intelligent Systems , 2013 .

[21]  Thomas L. Saaty,et al.  Models, Methods, Concepts & Applications of the Analytic Hierarchy Process , 2012 .

[22]  J. Gregory Trafton,et al.  Identifying people with soft-biometrics at Fleet Week , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  The handbook of eyewitness psychology: volume II—memory for people. R. C. L. Lindsay, D. F. Ross, J. D. Read, and M. P. Toglia. Lawrence Erlbaum Associates, Mahwah, NJ, 2007. No. of pages 601. ISBN 978‐0‐8058‐5152‐6 , 2008 .

[24]  A. A. Alattab,et al.  Efficient Method of Visual Feature Extraction for Facial Image Detection and Retrieval , 2012, 2012 Fourth International Conference on Computational Intelligence, Modelling and Simulation.

[25]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[26]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Anca L. Ralescu,et al.  Towards a multimedia model-based image retrieval system using fuzzy logic , 1993 .

[28]  Pawan Sinha,et al.  Role of color in face recognition , 2010 .

[29]  Takehisa Onisawa,et al.  Interactive Face Generation from Verbal Description Using Conceptual Fuzzy Sets , 2008, J. Multim..

[30]  Toshio Norita Fuzzy Theory in an Image Understanding Retrieval System , 1994 .

[31]  Adam Schmidt,et al.  The put face database , 2008 .

[32]  Pawan Sinha,et al.  Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About , 2006, Proceedings of the IEEE.

[33]  Hiroyasu Koshimizu,et al.  Keyword and face image retrieval based on latent semantic indexing , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[34]  J. R. Pomerantz,et al.  A century of Gestalt psychology in visual perception: II. Conceptual and theoretical foundations. , 2012, Psychological bulletin.

[35]  Lotfi A. Zadeh,et al.  From Computing with Numbers to Computing with Words - from Manipulation of Measurements to Manipulation of Perceptions , 2005, Logic, Thought and Action.

[36]  Witold Pedrycz,et al.  Linguistic models and linguistic modeling , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[37]  Dianhui Wang,et al.  Fuzzy Approach for Semantic Face Image Retrieval , 2012, Comput. J..

[38]  Elisabeth Rakus-Andersson,et al.  Face Classification Based on Linguistic Description of Facial Features , 2014, ICAISC.

[39]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[41]  H. Ellis,et al.  Face recognition accuracy as a function of mode of representation. , 1978 .

[42]  Witold Pedrycz,et al.  Face recognition: A study in information fusion using fuzzy integral , 2005, Pattern Recognit. Lett..

[43]  Gerald Schaefer,et al.  Semantic features for face recognition , 2010, Proceedings ELMAR-2010.

[44]  Witold Pedrycz,et al.  Local descriptors and similarity measures for frontal face recognition: A comparative analysis , 2013, J. Vis. Commun. Image Represent..

[45]  Toshirō Terano,et al.  Fuzzy engineering toward human friendly systems , 1992 .

[46]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[47]  Tzu-Chuan Chou,et al.  Semantic-based facial expression recognition using analytical hierarchy process , 2007, Expert Syst. Appl..

[48]  I. Fraser,et al.  Reaction Time Measures of Feature Saliency in Schematic Faces , 1990, Perception.

[49]  Maja Pantic,et al.  Expert system for automatic analysis of facial expressions , 2000, Image Vis. Comput..

[50]  Shree K. Nayar,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Describable Visual Attributes for Face Verification and Image Search , 2022 .

[51]  Lotfi A. Zadeh,et al.  Toward extended fuzzy logic - A first step , 2009, Fuzzy Sets Syst..

[52]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[53]  Charlie D. Frowd,et al.  EvoFIT: A holistic, evolutionary facial imaging technique for creating composites , 2004, TAP.

[54]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[55]  P. Sinha,et al.  Contribution of Color to Face Recognition , 2002, Perception.

[56]  Zeshui Xu,et al.  Linguistic Decision Making: Theory and Methods , 2013 .

[57]  M. Bohanec,et al.  The Analytic Hierarchy Process , 2004 .

[58]  Witold Pedrycz,et al.  A study in facial features saliency in face recognition: an analytic hierarchy process approach , 2016, Soft Computing.

[59]  Witold Pedrycz,et al.  A study in facial regions saliency: a fuzzy measure approach , 2014, Soft Comput..

[60]  Venu Govindaraju,et al.  A Probabilistic Approach to Semantic Face Retrieval System , 2005, AVBPA.

[61]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[62]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[63]  Julian Fierrez,et al.  Identification using face regions: application and assessment in forensic scenarios. , 2013, Forensic science international.

[64]  Gleb Beliakov,et al.  How to build aggregation operators from data , 2003, Int. J. Intell. Syst..

[65]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[66]  Witold Pedrycz,et al.  Local descriptors in application to the aging problem in face recognition , 2013, Pattern Recognit..

[67]  K. Laughery,et al.  Sketch artist and Identi-kit procedures for recalling faces. , 1980 .

[68]  Maja Pantic,et al.  An Expert System for Recognition of Facial Actions and their Intensity , 2000, AAAI/IAAI.

[69]  Alice J. O'Toole,et al.  Fusing Face-Verification Algorithms and Humans , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[70]  Adnan Yazici,et al.  Fuzzy Content-Based Retrieval in Image Databases , 2000, ADVIS.

[71]  Witold Pedrycz,et al.  Chain Code-Based Local Descriptor for Face Recognition , 2015, CORES.

[72]  Rae-Hong Park,et al.  Recognition of human front faces using knowledge-based feature extraction and neurofuzzy algorithm , 1996, Pattern Recognit..

[73]  Sameem Abdul Kareem,et al.  Facial Image Retrieval based on Eigenfaces and Semantic Features , 2012, CIT 2012.

[74]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[75]  Nicole A. Spaun Face Recognition in Forensic Science , 2011, Handbook of Face Recognition.

[76]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[77]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[78]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[79]  Hiroyasu Koshimizu,et al.  Some Experiments of Face Annotation Based on Latent Semantic Indexing in FIARS , 2006, KES.