From Grayscale to Color: Quaternion Linear Regression for Color Face Recognition

Linear regression has shown an effective tool for face recognition in recent years. Most existing linear regression based methods are devised for grayscale image based face recognition and fail to exploit the color information of color face images. To extend linear regression for color images, we propose a novel color face recognition method by formulating the color face recognition problem as a quaternion linear regression model. The proposed quaternion linear regression classification (QLRC) algorithm models each color facial image as a quaternion signal and codes multiple channels of each query color image in a holistic manner. Thus, the correlation among distinct channels of each color image is well preserved and leveraged by QLRC to further improve the recognition performance. To further improve QLRC, we propose a quaternion collaborative representation optimized classifier (QCROC) which integrates QLRC and quaternion collaborative representation based classifier into a unified framework. The experiments on benchmark datasets demonstrate the efficacy of the proposed approaches for color face recognition.

[1]  Xiaoli Zhang,et al.  Quaternion Based Maximum Margin Criterion Method for Color Face Recognition , 2017, Neural Processing Letters.

[2]  Licheng Yu,et al.  Quaternion-based sparse representation of color image , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[3]  Lei Zhang,et al.  A Probabilistic Collaborative Representation Based Approach for Pattern Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  C. L. Philip Chen,et al.  Quaternion Locality-Constrained Coding for Color Face Hallucination , 2018, IEEE Transactions on Cybernetics.

[5]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[6]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Hong Chen,et al.  Kernel-based sparse regression with the correntropy-induced loss , 2018 .

[8]  Yicong Zhou,et al.  Prior Knowledge-Based Probabilistic Collaborative Representation for Visual Recognition , 2020, IEEE Transactions on Cybernetics.

[9]  Ling Li,et al.  Face recognition against occlusions via colour fusion using 2D-MCF model and SRC , 2017, Pattern Recognit. Lett..

[10]  Xiangyang Luo,et al.  Quaternion Convolutional Neural Network for Color Image Classification and Forensics , 2019, IEEE Access.

[11]  Cuiming Zou,et al.  Quaternion Collaborative and Sparse Representation With Application to Color Face Recognition. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[12]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Akira Hirose,et al.  Quaternion Neural-Network-Based PolSAR Land Classification in Poincare-Sphere-Parameter Space , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Quentin Barthelemy,et al.  Color Sparse Representations for Image Processing: Review, Models, and Prospects , 2015, IEEE Transactions on Image Processing.

[15]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[16]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[17]  Rama Chellappa,et al.  Joint Sparse Representation for Robust Multimodal Biometrics Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  William Rowan Hamilton,et al.  ON QUATERNIONS, OR ON A NEW SYSTEM OF IMAGINARIES IN ALGEBRA , 1847 .

[19]  Yi Xu,et al.  Quaternion Convolutional Neural Networks , 2018, ECCV.

[20]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[21]  Danilo P. Mandic,et al.  The Theory of Quaternion Matrix Derivatives , 2014, IEEE Transactions on Signal Processing.

[22]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Fatih Murat Porikli,et al.  Classification and Boosting with Multiple Collaborative Representations , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Licheng Yu,et al.  Vector Sparse Representation of Color Image Using Quaternion Matrix Analysis , 2015, IEEE Transactions on Image Processing.

[25]  Orly Yadid-Pecht,et al.  Quaternion Structural Similarity: A New Quality Index for Color Images , 2012, IEEE Transactions on Image Processing.

[26]  Xiaogang Wang,et al.  Deeply learned face representations are sparse, selective, and robust , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Wanquan Liu,et al.  Two directional multiple colour fusion for face recognition , 2015, 2015 International Conference on Computers, Communications, and Systems (ICCCS).

[28]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[29]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Alan L. Yuille,et al.  Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples , 2016, IEEE Transactions on Image Processing.

[31]  Yuan Yan Tang,et al.  Modal Regression-Based Atomic Representation for Robust Face Recognition and Reconstruction , 2020, IEEE Transactions on Cybernetics.

[32]  Mislav Grgic,et al.  SCface – surveillance cameras face database , 2011, Multimedia Tools and Applications.