Cross-sensor iris recognition using adversarial strategy and sensor-specific information

Due to the growing demand of iris biometrics, lots of new sensors are being developed for high-quality image acquisition. However, upgrading the sensor and re-enrolling for users is expensive and time-consuming. This leads to a dilemma where enrolling on one type of sensor but recognizing on the others. For this cross-sensor matching, the large gap between distributions of enrolling and recognizing images usually results in degradation in recognition performance. To alleviate this degradation, we propose Cross-sensor iris network (CSIN) by applying the adversarial strategy and weakening interference of sensor-specific information. Specifically, there are three valuable efforts towards learning discriminative iris features. Firstly, the proposed CSIN adds extra feature extractors to generate residual components containing sensor-specific information and then utilizes these components to narrow the distribution gap. Secondly, an adversarial strategy is borrowed from Generative Adversarial Networks to align feature distributions and further reduce the discrepancy of images caused by sensors. Finally, we extend triplet loss and propose instance-anchor loss to pull the instances of the same class together and push away from others. It is worth mentioning that the proposed method doesn’t need pair-same data or triplet, which reduced the cost of data preparation. Experiments on two real-world datasets validate the effectiveness of the proposed method in cross-sensor iris recognition.

[1]  Abhishek Kumar Gangwar,et al.  DeepIrisNet: Deep iris representation with applications in iris recognition and cross-sensor iris recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[2]  Tieniu Tan,et al.  Margin Based Feature Selection for Cross-Sensor Iris Recognition via Linear Programming , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[3]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Rama Chellappa,et al.  Secure and Robust Iris Recognition Using Random Projections and Sparse Representations , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Tieniu Tan,et al.  A Code-Level Approach to Heterogeneous Iris Recognition , 2017, IEEE Transactions on Information Forensics and Security.

[6]  Jan Lukás,et al.  Determining digital image origin using sensor imperfections , 2005, IS&T/SPIE Electronic Imaging.

[7]  Arun Ross,et al.  A preliminary study on identifying sensors from iris images , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Wenwu Zhu,et al.  Deep Asymmetric Transfer Network for Unbalanced Domain Adaptation , 2018, AAAI.

[9]  Alejandro Alvaro Ramírez-Acosta,et al.  Cross-sensor iris verification applying robust fused segmentation algorithms , 2015, 2015 International Conference on Biometrics (ICB).

[10]  Alejandro Alvaro Ramírez-Acosta,et al.  Optimized robust multi-sensor scheme for simultaneous video and image iris recognition , 2018, Pattern Recognit. Lett..

[11]  Tieniu Tan,et al.  A Light CNN for Deep Face Representation With Noisy Labels , 2015, IEEE Transactions on Information Forensics and Security.

[12]  Zhenan Sun,et al.  Disentangled Variational Representation for Heterogeneous Face Recognition , 2018, AAAI.

[13]  Richa Singh,et al.  Iris sensor identification in multi-camera environment , 2019, Inf. Fusion.

[14]  Michael I. Jordan,et al.  Conditional Adversarial Domain Adaptation , 2017, NeurIPS.

[15]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[19]  Philip S. Yu,et al.  Transfer Joint Matching for Unsupervised Domain Adaptation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Ran He,et al.  Learning Gabor Magnitude Features for Palmprint Recognition , 2007, ACCV.

[21]  Fouad Khelifi,et al.  Weighted averaging-based sensor pattern noise estimation for source camera identification , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[22]  Luisa Verdoliva,et al.  A deep learning approach for iris sensor model identification , 2017, Pattern Recognit. Lett..

[23]  Mo Chen,et al.  Digital imaging sensor identification (further study) , 2007, Electronic Imaging.

[24]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[25]  Tieniu Tan,et al.  Deep Feature Fusion for Iris and Periocular Biometrics on Mobile Devices , 2018, IEEE Transactions on Information Forensics and Security.

[26]  Patrick J. Flynn,et al.  Factors that degrade the match distribution in iris biometrics , 2009, Identity in the Information Society.

[27]  Rama Chellappa,et al.  Cross-Sensor Iris Recognition through Kernel Learning , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Sridha Sridharan,et al.  Iris Recognition With Off-the-Shelf CNN Features: A Deep Learning Perspective , 2018, IEEE Access.

[29]  Ajay Kumar,et al.  Toward More Accurate Iris Recognition Using Cross-Spectral Matching , 2017, IEEE Transactions on Image Processing.

[30]  Arun Ross,et al.  Identifying sensors from fingerprint images , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[31]  Patrick J. Flynn,et al.  Variation in accuracy of textured contact lens detection based on sensor and lens pattern , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[32]  Tieniu Tan,et al.  Coupled feature selection for cross-sensor iris recognition , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).