Local directional relation pattern for unconstrained and robust face retrieval

Face recognition is still a very demanding area of research. This problem becomes more challenging in unconstrained environment and in the presence of several variations like pose, illumination, expression, etc. Local descriptors are widely used for this task. The most of the existing local descriptors consider only few immediate local neighbors and not able to utilize the wider local information to make the descriptor more discriminative. The wider local information based descriptors mainly suffer due to the increased dimensionality. In this paper, this problem is solved by encoding the relationship among directional neighbors in an efficient manner. The relationship between the center pixel and the encoded directional neighbors is utilized further to form the proposed local directional relation pattern (LDRP). The descriptor is inherently uniform illumination invariant. The multi-scale mechanism is also adapted to further boost the discriminative ability of the descriptor. The proposed descriptor is evaluated under the image retrieval framework over face databases. Very challenging databases like PaSC, LFW, PubFig, ESSEX, FERET, AT&T, and FaceScrub are used to test the discriminative ability and robustness of LDRP descriptor. Results are also compared with the recent state-of-the-art face descriptors such as LBP, LTP, LDP, LDN, LVP, DCP, LDGP and LGHP. Very promising performance is observed using the proposed descriptor over very appealing face databases as compared to the existing face descriptors. The proposed LDRP descriptor also outperforms the pre-trained ImageNet CNN models over large-scale FaceScrub face dataset. Moreover, it also outperforms the deep learning based DLib face descriptor in many scenarios.

[1]  Shiv Ram Dubey,et al.  Local SVD based NIR face retrieval , 2017, J. Vis. Commun. Image Represent..

[2]  Ognjen Arandjelovic,et al.  Gradient Edge Map Features for Frontal Face Recognition under Extreme Illumination Changes , 2012, BMVC.

[3]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[4]  Jian Sun,et al.  Face recognition with learning-based descriptor , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Shiv Ram Dubey,et al.  Rotation and Illumination Invariant Interleaved Intensity Order-Based Local Descriptor , 2014, IEEE Transactions on Image Processing.

[7]  Stan Z. Li,et al.  Enhanced Local Gradient Order Features and Discriminant Analysis for Face Recognition , 2016, IEEE Transactions on Cybernetics.

[8]  Jiwen Lu,et al.  Learning Compact Binary Face Descriptor for Face Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Shiv Ram Dubey,et al.  Local Bit-Plane Decoded Pattern: A Novel Feature Descriptor for Biomedical Image Retrieval , 2016, IEEE Journal of Biomedical and Health Informatics.

[10]  Guoying Zhao,et al.  BRINT: Binary Rotation Invariant and Noise Tolerant Texture Classification , 2014, IEEE Transactions on Image Processing.

[11]  Shiv Ram Dubey,et al.  Boosting local binary pattern with bag-of-filters for content based image retrieval , 2015, 2015 IEEE UP Section Conference on Electrical Computer and Electronics (UPCON).

[12]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[13]  Shiv Ram Dubey,et al.  Local Diagonal Extrema Pattern: A New and Efficient Feature Descriptor for CT Image Retrieval , 2015, IEEE Signal Processing Letters.

[14]  Matti Pietikäinen,et al.  Learning Discriminant Face Descriptor , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Kuo-Chin Fan,et al.  A Novel Local Pattern Descriptor—Local Vector Pattern in High-Order Derivative Space for Face Recognition , 2014, IEEE Transactions on Image Processing.

[17]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[18]  Stefan Winkler,et al.  A data-driven approach to cleaning large face datasets , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[19]  Jian Su,et al.  A novel hierarchical approach for multispectral palmprint recognition , 2015, Neurocomputing.

[20]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[23]  Frédéric Jurie,et al.  Face Recognition using Local Quantized Patterns , 2012, BMVC.

[24]  Brian C. Lovell,et al.  Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference , 2009, ICB.

[25]  Shiv Ram Dubey,et al.  Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval , 2016, IEEE Transactions on Image Processing.

[26]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Ira Kemelmacher-Shlizerman,et al.  The MegaFace Benchmark: 1 Million Faces for Recognition at Scale , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Timo Ahonen,et al.  Recognition of blurred faces using Local Phase Quantization , 2008, 2008 19th International Conference on Pattern Recognition.

[29]  Dacheng Tao,et al.  Multi-Task Pose-Invariant Face Recognition , 2015, IEEE Transactions on Image Processing.

[30]  Oksam Chae,et al.  Facial expression recognition using Local Directional Pattern (LDP) , 2010, 2010 IEEE International Conference on Image Processing.

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[33]  Jiwen Lu,et al.  Simultaneous Local Binary Feature Learning and Encoding for Face Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[34]  Shiv Ram Dubey,et al.  Novel local bit-plane dissimilarity pattern for computed tomography image retrieval , 2016 .

[35]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Ngoc-Son Vu,et al.  Exploring Patterns of Gradient Orientations and Magnitudes for Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[37]  Shiv Ram Dubey,et al.  Local Wavelet Pattern: A New Feature Descriptor for Image Retrieval in Medical CT Databases , 2015, IEEE Transactions on Image Processing.

[38]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[39]  Bruce A. Draper,et al.  The challenge of face recognition from digital point-and-shoot cameras , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[40]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[42]  P. V. S. S. R. Chandra Mouli,et al.  Dimensionality reduced local directional pattern (DR-LDP) for face recognition , 2016, Expert Syst. Appl..

[43]  Satish Kumar Singh,et al.  Local directional gradient pattern: a local descriptor for face recognition , 2022, Multimedia Tools and Applications.

[44]  Loris Nanni,et al.  Ensemble of texture descriptors and classifiers for face recognition , 2017 .

[45]  Wen Gao,et al.  Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[46]  Matti Pietikäinen,et al.  Local Binary Patterns for Still Images , 2011 .

[47]  M. Bennamoun,et al.  3-D Face Recognition Using Curvelet Local Features , 2014, IEEE Signal Processing Letters.

[48]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[49]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[50]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[51]  R. Chellappa,et al.  Face Recognition Across Non-Uniform Motion Blur, Illumination, and Pose , 2015, IEEE Transactions on Image Processing.

[52]  Tal Hassner,et al.  Effective Unconstrained Face Recognition by Combining Multiple Descriptors and Learned Background Statistics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[54]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[55]  Byungyong Ryu,et al.  Local Directional Ternary Pattern for Facial Expression Recognition. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[56]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Chi Fang,et al.  Continuous Pose Normalization for Pose-Robust Face Recognition , 2012, IEEE Signal Processing Letters.

[58]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[59]  Dacheng Tao,et al.  A Comprehensive Survey on Pose-Invariant Face Recognition , 2015, ACM Trans. Intell. Syst. Technol..

[60]  Satish Kumar Singh,et al.  Local Gradient Hexa Pattern: A Descriptor for Face Recognition and Retrieval , 2022, IEEE Transactions on Circuits and Systems for Video Technology.

[61]  Bo Yang,et al.  A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image , 2013, Neurocomputing.

[62]  Yanfeng Sun,et al.  3D face recognition using local binary patterns , 2013, Signal Process..

[63]  R. Schroeder LITERATURE SURVEY , 1981 .

[64]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Jie Chen,et al.  Fusing Local Patterns of Gabor Magnitude and Phase for Face Recognition , 2010, IEEE Transactions on Image Processing.

[66]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[67]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[69]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Shiv Ram Dubey,et al.  Local neighbourhood-based robust colour occurrence descriptor for colour image retrieval , 2015, IET Image Process..

[71]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[72]  Ling Shao,et al.  Learning View-Model Joint Relevance for 3D Object Retrieval , 2015, IEEE Transactions on Image Processing.

[73]  Matti Pietikäinen,et al.  Multiscale Local Phase Quantization for Robust Component-Based Face Recognition Using Kernel Fusion of Multiple Descriptors , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[74]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[75]  Jonghyun Choi,et al.  Multi-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[76]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[77]  Shengcai Liao,et al.  Learning Multi-scale Block Local Binary Patterns for Face Recognition , 2007, ICB.

[78]  Li Liu,et al.  Recognizing Complex Activities by a Probabilistic Interval-Based Model , 2016, AAAI.