Cross-Spectral Face Matching Based on Phase Correlation

One way to identify human faces is by using facial features or facial patterns based on visible images. However, this approach depends on the lighting conditions. In a poor illumination environment, it is difficult to recognize the face images. Thermal images do not rely on the illumination condition; thus can overcome this problem. Unlike the visible image, the thermal images lack visual information. Therefore, matching between the thermal and visible images (cross-spectral matching) is vital in face recognition. This paper proposed a phase correlation method, namely phase-only correlation (POC) and band-limited POC (BLPOC), for a cross-spectral matching of face images. First, the Fourier transform was applied to face images in both spectral domains, and the phase correlation between the two images was calculated. The experimental results showed that, from 100 visible and thermal image (acquired by FLIR C2 camera) pairs, the BLPOC resulted in significant correlation values compared to POC.

[1]  Kalaiarasi Sonai Muthu,et al.  Face recognition with Symmetric Local Graph Structure (SLGS) , 2014, Expert Syst. Appl..

[2]  Robert Koprowski,et al.  Automatic analysis of the trunk thermal images from healthy subjects and patients with faulty posture , 2015, Comput. Biol. Medicine.

[3]  Mongi A. Abidi,et al.  An Indoor and Outdoor, Multimodal, Multispectral and Multi-Illuminant Database for Face Recognition , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[4]  Sébastien Marcel,et al.  Cross-eyed 2017: Cross-spectral iris/periocular recognition competition , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[5]  Khairul Munadi,et al.  Features for Cross Spectral Image Matching: A Survey , 2018 .

[6]  R. Raghavendra,et al.  Low-cost multi-spectral face imaging for robust face recognition , 2016, 2016 IEEE International Conference on Imaging Systems and Techniques (IST).

[7]  Sergio Escalera,et al.  Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Fitri Arnia,et al.  Enhancement of Iris Recognition System Based on Phase Only Correlation , 2011 .

[9]  Benjamin S. Riggan,et al.  Thermal to Visible Synthesis of Face Images Using Multiple Regions , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[10]  Ngai-Man Cheung,et al.  Smartphone and Mobile Image Processing for Assisted Living: Health-monitoring apps powered by advanced mobile imaging algorithms , 2016, IEEE Signal Processing Magazine.

[11]  Tsuyoshi Isshiki,et al.  Fingerprint authentication on touch sensor using Phase-Only Correlation method , 2016, 2016 7th International Conference of Information and Communication Technology for Embedded Systems (IC-ICTES).

[12]  Baohua Yuan,et al.  Combining Local Binary Pattern and Local Phase Quantization for Face Recognition , 2012, 2012 International Symposium on Biometrics and Security Technologies.

[13]  Heesung Kwon,et al.  Estimation of visible spectrum faces from polarimetric thermal faces , 2016, 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[14]  Koichi Ito,et al.  Face recognition using phase-based correspondence matching , 2011, Face and Gesture 2011.

[15]  Muthukumar Arunachalam,et al.  An efficient ear recognition system using DWT & BLPOC , 2017, 2017 International Conference on Inventive Communication and Computational Technologies (ICICCT).

[16]  Gabriel Hermosilla Vigneau,et al.  Thermal Face Recognition Under Temporal Variation Conditions , 2017, IEEE Access.

[17]  Abdullah Gubbi,et al.  New Fuzzy LBP Features for Face Recognition , 2015, ArXiv.

[18]  Khairul Munadi,et al.  Improved Cross-Spectral Iris Matching Using Multi-Scale Weberface and Gabor Local Binary Pattern , 2018, 2018 10th International Conference on Electronics, Computers and Artificial Intelligence (ECAI).

[19]  Marcin Kowalski,et al.  Face re-identification in thermal infrared spectrum based on ThermalFaceNet neural network , 2018, 2018 22nd International Microwave and Radar Conference (MIKON).

[20]  Fitri Arnia,et al.  Metode Band-Limited Phase Only Correlation (BLPOC) untuk Identifikasi Plat Kendaraan , 2012 .

[21]  Larry S. Davis,et al.  Thermal to visible face recognition , 2012, Defense + Commercial Sensing.