Eyeglasses removal based on attributes detection and improved TV restoration model

Eyeglasses are common occlusions on face images. The detection of eyeglasses attributes and eyeglasses removal are key factors for correct automatic face recognition. A method for eyeglasses removal based on attributes detection and improved Total Variation (TV) restoration model is proposed in this paper. First, existence of eyeglasses frames is determined based on the width-length ratio after location of the eyeglasses; second, color coefficient and skin likelihood ratio are defined and color information is determined; third, bright index is defined and the reflective areas are detected based on luminance information. Finally, for rimmed, colorless and non-reflective eyeglasses, influence function based on gray difference ratio is defined to improve TV restoration model for eyeglasses removal. Experimental results show that our proposed method can not only discriminate the existence of the frame, but also detect color information and reflective areas accurately. In addition, the eyeglasses removal effect is superior to the traditional methods.

[1]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Tony F. Chan,et al.  High-Order Total Variation-Based Image Restoration , 2000, SIAM J. Sci. Comput..

[3]  Harry Shum,et al.  Automatic eyeglasses removal from face images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Guangda Su,et al.  Eyeglasses removal from facial images , 2005, Pattern Recognit. Lett..

[5]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[6]  Mei Yu,et al.  A micro-image fusion algorithm based on region growing , 2013 .

[7]  Hu Linyun.  Adaptive image inpainting algorithm based on CDD model , 2013 .

[8]  Fei Yang,et al.  A fast and efficient mesh segmentation method based on improved region growing , 2014 .

[9]  刘仲民 Liu Zhongmin,et al.  The research of glasses removal based on PCA/ICA and error compensation , 2014 .

[10]  P. Nagabhushan,et al.  Object removal by depth-wise image inpainting , 2015, Signal Image Video Process..

[11]  Xuesong Wang,et al.  Single-Sample Face Recognition Based on LPP Feature Transfer , 2016, IEEE Access.

[12]  Zhen Yang,et al.  Image inpainting algorithm based on TV model and evolutionary algorithm , 2014, Soft Computing - A Fusion of Foundations, Methodologies and Applications.

[13]  Wang Bailing,et al.  Methods of eyeglasses detection and frame removal for face image , 2016 .

[14]  Xin Zhang,et al.  Eyeglasses detection, location and frame discriminant based on edge information projection , 2017, Multimedia Tools and Applications.