Human identification after plastic surgery using region based score level fusion of local facial features

Abstract Plastic surgery alters original facial features of an individual thereby making Face Recognition after plastic surgery difficult. Cosmetic procedures introduce geometrical deviations which are difficult to analyze by state of the art facial identification procedures. Here a region based score level fusion approach for local facial features is proposed to equalize former and latter surgery images. Steps involved in the recognition process are; firstly identifying the ROIs (areas/regions of interest/concern) of before and after surgery images. ROIs are eyes, nose and mouth regions; feature extraction from identified regions via Speeded Up Robust Features and K Nearest Neighbour techniques; region wise and full face geometrical distance calculation between matched feature vectors of pre and post surgery image samples by a distance metric (sum of squared differences); final recognition rate calculation by weighted score level fusion. The projected procedure gives recognition of 89.7% for local surgical treatment and 87% for global surgery.

[1]  Michele Nappi,et al.  Deceiving faces: When plastic surgery challenges face recognition , 2016, Image Vis. Comput..

[2]  Arun Ross,et al.  Mitigating effects of plastic surgery: Fusing face and ocular biometrics , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[3]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[4]  Hemant Mehta,et al.  On innovations in plastic surgery. , 2009, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[5]  Himanshu S. Bhatt,et al.  Recognizing Surgically Altered Face Images Using Multiobjective Evolutionary Algorithm , 2013, IEEE Transactions on Information Forensics and Security.

[6]  Rajiv Kapoor,et al.  Comparison of graph-based methods for non-linear dimensionality reduction , 2012 .

[7]  Shaimaa Ahmed El-Said,et al.  Geometrical face recognition after plastic surgery , 2014, Int. J. Comput. Appl. Technol..

[8]  Himanshu S. Bhatt,et al.  Evolutionary granular approach for recognizing faces altered due to plastic surgery , 2011, Face and Gesture 2011.

[9]  Karl Ricanek,et al.  The Next Biometric Challenge: Medical Alterations , 2013, Computer.

[10]  Peyman Dodangeh,et al.  A biometric security scheme for wireless body area networks , 2018, J. Inf. Secur. Appl..

[11]  Himanshu S. Bhatt,et al.  Plastic Surgery: A New Dimension to Face Recognition , 2010, IEEE Transactions on Information Forensics and Security.

[12]  N. S. Lakshmiprabha,et al.  Face recognition using multimodal biometric features , 2011, 2011 International Conference on Image Information Processing.

[13]  Xin Liu,et al.  Face Recognition after Plastic Surgery: A Comprehensive Study , 2012, ACCV.

[14]  Prachi Punyani,et al.  Human age-estimation system based on double-level feature fusion of face and gait images , 2018 .

[15]  Rajiv Kapoor,et al.  Non-linear dimensionality reduction using fuzzy lattices , 2013, IET Comput. Vis..

[16]  Patrick J. Flynn,et al.  A sparse representation approach to face matching across plastic surgery , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[17]  Michele Nappi,et al.  Robust Face Recognition after Plastic Surgery Using Local Region Analysis , 2011, ICIAR.