Demographic Bias in Biometrics: A Survey on an Emerging Challenge

Systems incorporating biometric technologies have become ubiquitous in personal, commercial, and governmental identity management applications. Both cooperative (e.g., access control) and noncooperative (e.g., surveillance and forensics) systems have benefited from biometrics. Such systems rely on the uniqueness of certain biological or behavioral characteristics of human beings, which enable for individuals to be reliably recognized using automated algorithms. Recently, however, there has been a wave of public and academic concerns regarding the existence of systemic bias in automated decision systems (including biometrics). Most prominently, face recognition algorithms have often been labeled as “racist” or “biased” by the media, nongovernmental organizations, and researchers alike. The main contributions of this article are: 1) an overview of the topic of algorithmic bias in the context of biometrics; 2) a comprehensive survey of the existing literature on biometric bias estimation and mitigation; 3) a discussion of the pertinent technical and social matters; and 4) an outline of the remaining challenges and future work items, both from technological and social points of view.

[1]  Sixue Gong,et al.  Jointly De-Biasing Face Recognition and Demographic Attribute Estimation , 2019, ECCV.

[2]  Sixue Gong,et al.  DebFace: De-biasing Face Recognition , 2019, ArXiv.

[3]  Kevin W. Bowyer,et al.  Critical examination of the IREX VI results , 2015, IET Biom..

[4]  Tobias D. Krafft,et al.  On Chances and Risks of Security Related Algorithmic Decision Making Systems , 2018, European Journal for Security Research.

[5]  Arun Ross,et al.  Semi-adversarial Networks: Convolutional Autoencoders for Imparting Privacy to Face Images , 2017, 2018 International Conference on Biometrics (ICB).

[6]  Naser Damer,et al.  Post-Comparison Mitigation of Demographic Bias in Face Recognition Using Fair Score Normalization , 2020, Pattern Recognit. Lett..

[7]  Christoph Busch,et al.  Detection of Glasses in Near-Infrared Ocular Images , 2018, 2018 International Conference on Biometrics (ICB).

[8]  Yuhang Liu,et al.  FingerNet: An unified deep network for fingerprint minutiae extraction , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[9]  Harry Wechsler,et al.  Face Verification Subject to Varying (Age, Ethnicity, and Gender)Demographics Using Deep Learning , 2016 .

[10]  Samarth Bharadwaj,et al.  Biometric quality: a review of fingerprint, iris, and face , 2014, EURASIP Journal on Image and Video Processing.

[11]  Andrew Zisserman,et al.  Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddings , 2018, ECCV Workshops.

[12]  George W. Quinn,et al.  Report on the Evaluation of 2D Still-Image Face Recognition Algorithms , 2011 .

[13]  Naser Damer,et al.  Comparison-Level Mitigation of Ethnic Bias in Face Recognition , 2020, 2020 8th International Workshop on Biometrics and Forensics (IWBF).

[14]  Christoph Busch,et al.  Impact and Detection of Facial Beautification in Face Recognition: An Overview , 2019, IEEE Access.

[15]  Kevin Bowyer,et al.  Characterizing the Variability in Face Recognition Accuracy Relative to Race , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  Timnit Gebru,et al.  Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification , 2018, FAT.

[17]  Javier Galbally,et al.  Fingerprint Quality: a Lifetime Story , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[18]  Yun Fu,et al.  Face Recognition: Too Bias, or Not Too Bias? , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[19]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[20]  Patrick J. Flynn,et al.  Degradation of iris recognition performance due to non-cosmetic prescription contact lenses , 2010, Comput. Vis. Image Underst..

[21]  Ajay Kumar,et al.  Comparison and combination of iris matchers for reliable personal authentication , 2010, Pattern Recognit..

[22]  Ferrara Pasquale,et al.  Study on Face Identification Technology for its implementation in the Schengen Information System , 2019 .

[23]  Douglas A. Reynolds,et al.  SHEEP, GOATS, LAMBS and WOLVES A Statistical Analysis of Speaker Performance in the NIST 1998 Speaker Recognition Evaluation , 1998 .

[24]  Karl Ricanek,et al.  Mitigating Algorithmic Bias: Evolving an Augmentation Policy that is Non-Biasing , 2020, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[25]  Hakil Kim,et al.  Impact of Age Groups on Fingerprint Recognition Performance , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[26]  Tony Doyle,et al.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2017, Inf. Soc..

[27]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[28]  Arun Ross,et al.  What Else Does Your Biometric Data Reveal? A Survey on Soft Biometrics , 2016, IEEE Transactions on Information Forensics and Security.

[29]  Alice J. O'Toole,et al.  An other-race effect for face recognition algorithms , 2011, TAP.

[30]  Carlos Eduardo Scheidegger,et al.  Certifying and Removing Disparate Impact , 2014, KDD.

[31]  P. Drozdowski,et al.  Demographic Bias: A Challenge for Fingervein Recognition Systems? , 2021, 2020 28th European Signal Processing Conference (EUSIPCO).

[32]  Jörg Krüger,et al.  The Harms of Demographic Bias in Deep Face Recognition Research , 2019, 2019 International Conference on Biometrics (ICB).

[33]  Arun Ross,et al.  Some Research Problems in Biometrics: The Future Beckons , 2019, 2019 International Conference on Biometrics (ICB).

[34]  Nikola Pavesic,et al.  De-identification for privacy protection in biometrics , 2017 .

[35]  Julia Macke,et al.  European Union Agency for Fundamental Rights , 2006 .

[36]  Alexei A. Efros,et al.  Unbiased look at dataset bias , 2011, CVPR 2011.

[37]  L J Skitka,et al.  Automation bias: decision making and performance in high-tech cockpits. , 1997, The International journal of aviation psychology.

[38]  Bernhard Egger,et al.  Analyzing and Reducing the Damage of Dataset Bias to Face Recognition With Synthetic Data , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[39]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[40]  John J. Howard,et al.  The Effect of Broad and Specific Demographic Homogeneity on the Imposter Distributions and False Match Rates in Face Recognition Algorithm Performance , 2019, 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[41]  J. Reidenberg,et al.  Accountable Algorithms , 2016 .

[42]  Data quality and artificial intelligence – mitigating bias and error to protect fundamental rights , 2019 .

[43]  Vishnu Naresh Boddeti,et al.  Mitigating Information Leakage in Image Representations: A Maximum Entropy Approach , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Julian Fiérrez,et al.  SensitiveNets: Learning Agnostic Representations with Application to Face Recognition , 2019, ArXiv.

[45]  J. Eberhardt,et al.  Discrimination and Implicit Bias in a Racially Unequal Society , 2006 .

[46]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[47]  Kush R. Varshney,et al.  An End-To-End Machine Learning Pipeline That Ensures Fairness Policies , 2017, ArXiv.

[48]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  J. New,et al.  How Policymakers Can Foster Algorithmic Accountability , 2018 .

[50]  Hee Jung Ryu,et al.  InclusiveFaceNet: Improving Face Attribute Detection with Race and Gender Diversity , 2017 .

[51]  Esube Bekele,et al.  Multi-attribute Residual Network (MAResNet) for Soft-Biometrics Recognition in Surveillance Scenarios , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[52]  S. Modi,et al.  Impact of Image Quality on Performance: Comparison of Young and Elderly Fingerprints , 2006 .

[53]  Xi Zhang,et al.  Automated Inference on Criminality using Face Images , 2016, ArXiv.

[54]  I. Kohane,et al.  Framing the challenges of artificial intelligence in medicine , 2018, BMJ Quality & Safety.

[55]  Naser Damer,et al.  Demographic Bias in Presentation Attack Detection of Iris Recognition Systems , 2021, 2020 28th European Signal Processing Conference (EUSIPCO).

[56]  Mei Wang,et al.  Racial Faces in the Wild: Reducing Racial Bias by Information Maximization Adaptation Network , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[57]  Alice J. O'Toole,et al.  Demographic effects on estimates of automatic face recognition performance , 2011, Face and Gesture 2011.

[58]  #BigData: Discrimination in data-supported decision making , 2018 .

[59]  Orsolya Salát,et al.  Privacy and Data Protection , 2016 .

[60]  George Azzopardi,et al.  Gender recognition from face images with trainable COSFIRE filters , 2016, 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[61]  Raymond N. J. Veldhuis,et al.  A high quality finger vascular pattern dataset collected using a custom designed capturing device , 2013, 2013 International Conference on Biometrics (ICB).

[62]  Chengshan Qian,et al.  Palmprint gender classification by convolutional neural network , 2018, IET Comput. Vis..

[63]  Javier Preciozzi,et al.  Fingerprint Biometrics From Newborn to Adult: A Study From a National Identity Database System , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[64]  Miroslav Dudík,et al.  Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need? , 2018, CHI.

[65]  Weihong Deng,et al.  Mitigate Bias in Face Recognition using Skewness-Aware Reinforcement Learning , 2019, ArXiv.

[66]  Richa Singh,et al.  Anonymizing k-Facial Attributes via Adversarial Perturbations , 2018, IJCAI.

[67]  Joanna Bryson,et al.  Standardizing Ethical Design for Artificial Intelligence and Autonomous Systems , 2017, Computer.

[68]  Carlos D. Castillo,et al.  Accuracy comparison across face recognition algorithms: Where are we on measuring race bias? , 2019, ArXiv.

[69]  Stephen Elliott,et al.  Impact of Gender on Fingerprint Recognition Systems , 2008 .

[70]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[71]  Liming Chen,et al.  von Mises-Fisher Mixture Model-based Deep learning: Application to Face Verification , 2017, ArXiv.

[72]  Dana Michalski,et al.  The Impact of Age and Threshold Variation on Facial Recognition Algorithm Performance Using Images of Children , 2018, 2018 International Conference on Biometrics (ICB).

[73]  Xi Zhang,et al.  Responses to Critiques on Machine Learning of Criminality Perceptions (Addendum of arXiv:1611.04135) , 2017 .

[74]  Kimmo Kärkkäinen,et al.  FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age , 2019, ArXiv.

[75]  Bruce A. Draper,et al.  A meta-analysis of face recognition covariates , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[76]  Frank A. Pasquale,et al.  [89WashLRev0001] The Scored Society: Due Process for Automated Predictions , 2014 .

[77]  Avi Feller,et al.  Algorithmic Decision Making and the Cost of Fairness , 2017, KDD.

[78]  Elie Dolgin,et al.  The myopia boom , 2015, Nature.

[79]  Hugo Proença,et al.  FaceGenderID: Exploiting Gender Information in DCNNs Face Recognition Systems , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[80]  Keith Kirkpatrick,et al.  Battling algorithmic bias , 2016, Commun. ACM.

[81]  Anil K. Jain,et al.  Longitudinal Study of Child Face Recognition , 2017, 2018 International Conference on Biometrics (ICB).

[82]  Neil Yager,et al.  Worms, Chameleons, Phantoms and Doves: New Additions to the Biometric Menagerie , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[83]  Kristina Lerman,et al.  A Survey on Bias and Fairness in Machine Learning , 2019, ACM Comput. Surv..

[84]  Esther Rolf,et al.  Delayed Impact of Fair Machine Learning , 2018, ICML.

[85]  Inioluwa Deborah Raji,et al.  Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products , 2019, AIES.

[86]  John R. Smith,et al.  Diversity in Faces , 2019, ArXiv.

[87]  John Daugman,et al.  Searching for doppelgängers: assessing the universality of the IrisCode impostors distribution , 2016, IET Biom..

[88]  Bruce A. Draper,et al.  Computational Statistics and Data Analysis Introduction to Face Recognition and Evaluation of Algorithm Performance , 2022 .

[89]  Lei Zhang,et al.  One-shot Face Recognition by Promoting Underrepresented Classes , 2017, ArXiv.

[90]  Christoph Busch,et al.  Iris Recognition in Visible Wavelength: Impact and Automated Detection of Glasses , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[91]  Karl Ricanek,et al.  Exploring Automatic Face Recognition on Match Performance and Gender Bias for Children , 2019, 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[92]  Claus Vielhauer,et al.  User-Centric Privacy and Security in Biometrics , 2017 .

[93]  Richa Singh,et al.  Deep Learning for Face Recognition: Pride or Prejudiced? , 2019, ArXiv.

[94]  Axel Munk,et al.  Modeling the Growth of Fingerprints Improves Matching for Adolescents , 2011, IEEE Transactions on Information Forensics and Security.

[95]  Toniann Pitassi,et al.  Learning Fair Representations , 2013, ICML.

[96]  Ben Hutchinson,et al.  50 Years of Test (Un)fairness: Lessons for Machine Learning , 2018, FAT.

[97]  Kevin W. Bowyer,et al.  Issues Related to Face Recognition Accuracy Varying Based on Race and Skin Tone , 2020, IEEE Transactions on Technology and Society.

[98]  George W. Quinn,et al.  IREX VI: mixed-effects longitudinal models for iris ageing: response to Bowyer and Ortiz , 2015, IET Biom..

[99]  C. Busch,et al.  Investigating performance and impacts on fingerprint recognition systems , 2005, Proceedings from the Sixth Annual IEEE SMC Information Assurance Workshop.

[100]  Andrew M. Cuomo,et al.  New York State COMPAS-Probation Risk and Need Assessment Study: Examining the Recidivism Scale's Effectiveness and Predictive Accuracy , 2012 .

[101]  Ben Green,et al.  The Myth in the Methodology: Towards a Recontextualization of Fairness in Machine Learning , 2018, ICML 2018.

[102]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[103]  Carlos D. Castillo,et al.  An Experimental Evaluation of Covariates Effects on Unconstrained Face Verification , 2018, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[104]  Blake Lemoine,et al.  Mitigating Unwanted Biases with Adversarial Learning , 2018, AIES.

[105]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[106]  Alberto Botana López,et al.  Deep Learning in Biometrics: A Survey , 2019, ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal.

[107]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[108]  Guodong Guo,et al.  Human age estimation: What is the influence across race and gender? , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[109]  Vidya Muthukumar,et al.  Color-Theoretic Experiments to Understand Unequal Gender Classification Accuracy From Face Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[110]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[111]  Andreas Krause,et al.  Advances in Neural Information Processing Systems (NIPS) , 2014 .

[112]  Anil K. Jain,et al.  Longitudinal study of fingerprint recognition , 2015, Proceedings of the National Academy of Sciences.

[113]  D. Citron Technological Due Process , 2007 .

[114]  Satoshi Kaneko,et al.  Development of 2,400ppi Fingerprint Sensor for Capturing Neonate Fingerprint within 24 Hours after Birth , 2019, 2019 International Conference of the Biometrics Special Interest Group (BIOSIG).

[115]  Anne L. Washington,et al.  How to Argue with an Algorithm: Lessons from the COMPAS ProPublica Debate , 2019 .

[116]  Jonathan S. Evans,et al.  Bias in human reasoning , 1990 .

[117]  Jieyu Zhao,et al.  Balanced Datasets Are Not Enough: Estimating and Mitigating Gender Bias in Deep Image Representations , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[118]  Naser Damer,et al.  Face Quality Estimation and Its Correlation to Demographic and Non-Demographic Bias in Face Recognition , 2020, 2020 IEEE International Joint Conference on Biometrics (IJCB).

[119]  John J. Howard,et al.  Demographic Effects in Facial Recognition and Their Dependence on Image Acquisition: An Evaluation of Eleven Commercial Systems , 2019, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[120]  Lauren Rhue,et al.  Racial Influence on Automated Perceptions of Emotions , 2018 .

[121]  Helen Nissenbaum,et al.  Bias in computer systems , 1996, TOIS.

[122]  Emanuela Marasco,et al.  Biases in Fingerprint Recognition Systems: Where Are We At? , 2019, 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[123]  Michael Fairhurst,et al.  Age Factors in Biometric Processing , 2013 .

[124]  Bruce A. Draper,et al.  Factors that influence algorithm performance in the Face Recognition Grand Challenge , 2009, Comput. Vis. Image Underst..

[125]  Andreas Uhl,et al.  Comparing verification performance of kids and adults for Fingerprint, Palmprint, Hand-geometry and Digitprint biometrics , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[126]  Xia Hu,et al.  Fairness in Deep Learning: A Computational Perspective , 2019, IEEE Intelligent Systems.

[127]  Emily Denton,et al.  Detecting Bias with Generative Counterfactual Face Attribute Augmentation , 2019, ArXiv.

[128]  Os Keyes,et al.  The Misgendering Machines , 2018, Proc. ACM Hum. Comput. Interact..

[129]  Mohan Mahadevan,et al.  Reducing Geographic Performance Differentials for Face Recognition , 2020, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[130]  Javier Galbally,et al.  Fingerprint growth model for mitigating the ageing effect on children's fingerprints matching , 2019, Pattern Recognit..

[131]  S.J. Elliott,et al.  An evaluation of fingerprint image quality across an elderly population vis-a-vis an 18-25 year old population , 2005, Proceedings 39th Annual 2005 International Carnahan Conference on Security Technology.

[132]  Naser Damer,et al.  Suppressing Gender and Age in Face Templates Using Incremental Variable Elimination , 2019, 2019 International Conference on Biometrics (ICB).

[133]  Anil K. Jain,et al.  Face Recognition Performance: Role of Demographic Information , 2012, IEEE Transactions on Information Forensics and Security.

[134]  Javier Galbally,et al.  A Study of Age and Ageing in Fingerprint Biometrics , 2019, IEEE Transactions on Information Forensics and Security.

[135]  Nicholas Diakopoulos,et al.  Accountability in algorithmic decision making , 2016, Commun. ACM.

[136]  Anil K. Jain,et al.  Face Recognition Performance under Aging , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[137]  David S. Bolme,et al.  Face Recognition Algorithm Bias: Performance Differences on Images of Children and Adults , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[138]  Sarah Desmarais Jay Singh,et al.  Risk Assessment Instruments Validated and Implemented in Correctional Settings in the United States , 2013 .

[139]  Karl Ricanek,et al.  A Review of Face Recognition against Longitudinal Child Faces , 2015, BIOSIG.

[140]  Kevin W. Bowyer,et al.  Analysis of Gender Inequality In Face Recognition Accuracy , 2020, 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[141]  Matti Pietikäinen,et al.  From BoW to CNN: Two Decades of Texture Representation for Texture Classification , 2018, International Journal of Computer Vision.

[142]  Sébastien Marcel,et al.  Handbook of Vascular Biometrics , 2019 .

[143]  Seth Flaxman,et al.  European Union Regulations on Algorithmic Decision-Making and a "Right to Explanation" , 2016, AI Mag..

[144]  K. Bowyer,et al.  Handbook of Iris Recognition , 2016, Advances in Computer Vision and Pattern Recognition.

[145]  Anil K. Jain,et al.  Encyclopedia of Biometrics , 2015, Springer US.

[146]  Anil K. Jain,et al.  A longitudinal study of automatic face recognition , 2015, 2015 International Conference on Biometrics (ICB).

[147]  Andrey Kuehlkamp,et al.  Gender-from-Iris or Gender-from-Mascara? , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[148]  Julia Rubin,et al.  Fairness Definitions Explained , 2018, 2018 IEEE/ACM International Workshop on Software Fairness (FairWare).

[149]  Isabelle Hupont,et al.  DemogPairs: Quantifying the Impact of Demographic Imbalance in Deep Face Recognition , 2019, 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019).

[150]  Christopher T. Marsden,et al.  Privacy and data protection , 2013 .

[151]  Arun Ross,et al.  Handbook of Biometrics , 2007 .

[152]  Bruce A. Draper,et al.  Report on the FG 2015 Video Person Recognition Evaluation , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[153]  Rafael A. Calvo,et al.  Advancing impact assessment for intelligent systems , 2020, Nature Machine Intelligence.

[154]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[155]  J. Henrich,et al.  The Moral Machine experiment , 2018, Nature.

[156]  Julian Fiérrez,et al.  Measuring the Gender and Ethnicity Bias in Deep Models for Face Recognition , 2018, CIARP.

[157]  Tieniu Tan,et al.  Demographic Analysis from Biometric Data: Achievements, Challenges, and New Frontiers , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[158]  Aythami Morales,et al.  SensitiveNets: Learning Agnostic Representations with Application to Face Images. , 2020, IEEE transactions on pattern analysis and machine intelligence.

[159]  Arun Ross,et al.  Soft biometric privacy: Retaining biometric utility of face images while perturbing gender , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[160]  Antitza Dantcheva,et al.  Mitigating Bias in Gender, Age and Ethnicity Classification: A Multi-task Convolution Neural Network Approach , 2018, ECCV Workshops.

[161]  Understanding algorithmic decision-making : Opportunities and challenges , 2019 .

[162]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[163]  Daniela Rus,et al.  Uncovering and Mitigating Algorithmic Bias through Learned Latent Structure , 2019, AIES.

[164]  Naser Damer,et al.  Unsupervised privacy-enhancement of face representations using similarity-sensitive noise transformations , 2019, Applied Intelligence.

[165]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[166]  Julius Adebayo,et al.  CREDIT SCORING IN THE ERA OF BIG DATA , 2017 .

[167]  Els J. Kindt,et al.  Privacy and Data Protection Issues of Biometric Applications , 2013 .

[168]  Sistema político,et al.  Unique Identification Authority of India , 2011 .

[169]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[170]  Arun Ross,et al.  Privacy of Facial Soft Biometrics: Suppressing Gender But Retaining Identity , 2014, ECCV Workshops.

[171]  Salina Abdul Samad,et al.  Review on the effects of age, gender, and race demographics on automatic face recognition , 2018, The Visual Computer.

[172]  Suresh Venkatasubramanian,et al.  On the (im)possibility of fairness , 2016, ArXiv.

[173]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[174]  William Welser,et al.  An Intelligence in Our Image: The Risks of Bias and Errors in Artificial Intelligence , 2017 .

[175]  Francisco Herrera,et al.  Learning from Imbalanced Data Sets , 2018, Springer International Publishing.

[176]  Rayid Ghani,et al.  Aequitas: A Bias and Fairness Audit Toolkit , 2018, ArXiv.

[177]  David Danks,et al.  Algorithmic Bias in Autonomous Systems , 2017, IJCAI.

[178]  Bernhard Egger,et al.  Empirically Analyzing the Effect of Dataset Biases on Deep Face Recognition Systems , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[179]  Wen Gao,et al.  High-Resolution Face Fusion for Gender Conversion , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[180]  Alice J. O'Toole,et al.  Face recognition algorithms and the other-race effect: computational mechanisms for a developmental contact hypothesis , 2002, Cogn. Sci..

[181]  Frank A. Pasquale The Black Box Society: The Secret Algorithms That Control Money and Information , 2015 .

[182]  Sridha Sridharan,et al.  Iris Recognition With Off-the-Shelf CNN Features: A Deep Learning Perspective , 2018, IEEE Access.

[183]  Rachel K. E. Bellamy,et al.  AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias , 2018, ArXiv.

[184]  Alexandra Chouldechova,et al.  Fair prediction with disparate impact: A study of bias in recidivism prediction instruments , 2016, Big Data.

[185]  Schumacher Guenter,et al.  Fingerprint Recognition for Children , 2013 .

[186]  Martim Brandao,et al.  Age and gender bias in pedestrian detection algorithms , 2019, ArXiv.

[187]  Iyad Rahwan,et al.  Algorithmic Discrimination: Formulation and Exploration in Deep Learning-based Face Biometrics , 2020, SafeAI@AAAI.

[188]  Raja Parasuraman,et al.  Complacency and Bias in Human Use of Automation: An Attentional Integration , 2010, Hum. Factors.