Auth ‘n’ Scan

Recent commodity smartphones have biometric sensing capabilities, allowing their daily use for authentication and identification. This increasing use of biometric systems motivates us to design an opportunistic way to sense user's additional physiological or behavioral data. We define this concurrent physiological or behavioral data sensing during biometric authentication or identification as dual-purpose biometrics. As an instance of dual-purpose biometrics, we develop photoplethysmography (PPG) sensing during mobile fingerprint authentication, called Auth ‘n’ Scan. Our system opportunistically extracts cardiovascular information, such as a heart rate and its variability, while users perform phone unlock of a smartphone. To achieve this sensing, our Auth ‘n’ Scan system attaches four PPG units around a fingerprint sensor. The system also performs noise removal and signal selection to accurately estimate cardiovascular information. This paper presents the hardware implementation and signal processing algorithm of our Auth ‘n’ Scan prototype. We also report our system evaluations with 10 participants, showing that, despite a little low precision (a standard deviation of 3--7), estimation of heart rates with high accuracy (under a mean error of 1) is possible from PPG data of five seconds and longer if their baseline information is given. We discuss the feasibility of opportunistic PPG sensing in mobile fingerprint authentication.

[1]  Arun Ross,et al.  Multimodal biometrics: An overview , 2004, 2004 12th European Signal Processing Conference.

[2]  Moustafa Youssef,et al.  Zephyr demo: Ubiquitous accurate multi-sensor fusion-based respiratory rate estimation using smartphones , 2016, INFOCOM Workshops.

[3]  Fumiharu Togo,et al.  Diurnal 24-Hour Rhythm in Ambulatory Heart Rate Variability during the Day Shift in Rotating Shift Workers , 2013, Journal of biological rhythms.

[4]  Ivan Flechais,et al.  Usable Security: Why Do We Need It? How Do We Get It? , 2005 .

[5]  Moustafa Youssef,et al.  Zephyr: Ubiquitous accurate multi-sensor fusion-based respiratory rate estimation using smartphones , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[6]  Ilkka Korhonen,et al.  Health monitoring in the home of the future. , 2003, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[7]  E. Chan,et al.  Pulse oximetry: understanding its basic principles facilitates appreciation of its limitations. , 2013, Respiratory medicine.

[8]  Tridib Mukherjee,et al.  Mauka-Mauka : Measuring and Predicting Opportunities for Webcam-based Heart Rate Sensing in Workplace Environment , 2015, BODYNETS.

[9]  Mi Zhang,et al.  BodyScan: Enabling Radio-based Sensing on Wearable Devices for Contactless Activity and Vital Sign Monitoring , 2016, MobiSys.

[10]  Daniel J. Wigdor,et al.  Slide to X: unlocking the potential of smartphone unlocking , 2014, CHI.

[11]  Christian Holz,et al.  Glabella: Continuously Sensing Blood Pressure Behavior using an Unobtrusive Wearable Device , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[12]  R. Acharya U,et al.  Comprehensive analysis of cardiac health using heart rate signals , 2004, Physiological measurement.

[13]  Heinrich Hußmann,et al.  I Feel Like I'm Taking Selfies All Day!: Towards Understanding Biometric Authentication on Smartphones , 2015, CHI.

[14]  Anil K. Jain,et al.  Fingerprint Matching , 2010, Computer.

[15]  Lunji Qiu,et al.  Fingerprint sensor technology , 2014, 2014 9th IEEE Conference on Industrial Electronics and Applications.

[16]  Rosalind W. Picard,et al.  Cardiovascular Monitoring Using Earphones and a Mobile Device , 2012, IEEE Pervasive Computing.

[17]  Farinaz Koushanfar,et al.  Heart-to-heart (H2H): authentication for implanted medical devices , 2013, CCS.

[18]  Katarzyna Wac,et al.  Getting closer: an empirical investigation of the proximity of user to their smart phones , 2011, UbiComp '11.

[19]  Atsushi Sugiura,et al.  A user interface using fingerprint recognition: holding commands and data objects on fingers , 1998, UIST '98.

[20]  Scott E. Hudson,et al.  Using visualizations to increase compliance in experience sampling , 2008, UbiComp.

[21]  Nalini K. Ratha,et al.  Enhancing security and privacy in biometrics-based authentication systems , 2001, IBM Syst. J..

[22]  Blase Ur,et al.  Biometric authentication on iPhone and Android: Usability, perceptions, and influences on adoption , 2015 .

[23]  Youngki Lee,et al.  Sinabro: opportunistic and unobtrusive mobile electrocardiogram monitoring system , 2014, HotMobile.

[24]  N. Selvaraj,et al.  Assessment of heart rate variability derived from finger-tip photoplethysmography as compared to electrocardiography , 2008, Journal of medical engineering & technology.

[25]  Martin Wolf,et al.  An Efficient Algorithm for Automatic Peak Detection in Noisy Periodic and Quasi-Periodic Signals , 2012, Algorithms.

[26]  Dale R. Setlak Advances in Fingerprint Sensors Using RF Imaging Techniques , 2004 .

[27]  A M Tonkin,et al.  Application of the Poincaré plot to heart rate variability: a new measure of functional status in heart failure. , 1995, Australian and New Zealand journal of medicine.

[28]  Frank Bentley,et al.  On-Demand Biometrics: Fast Cross-Device Authentication , 2016, CHI.

[29]  John Allen Photoplethysmography and its application in clinical physiological measurement , 2007, Physiological measurement.

[30]  Moustafa Youssef,et al.  HeartSense , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[31]  Stefan Sammito,et al.  The circadian rhythm of heart rate variability , 2016 .

[32]  Akimichi Tanaka,et al.  Heart rate monitoring through the surface of a drinkware , 2014, UbiComp.

[33]  Michael S. Bernstein,et al.  Twitch crowdsourcing: crowd contributions in short bursts of time , 2014, CHI.

[34]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[35]  Martin Pielot,et al.  When attention is not scarce - detecting boredom from mobile phone usage , 2015, UbiComp.

[36]  Daniel McDuff,et al.  A medical mirror for non-contact health monitoring , 2011, SIGGRAPH '11.

[37]  Patrick Baudisch,et al.  The generalized perceived input point model and how to double touch accuracy by extracting fingerprints , 2010, CHI.

[38]  Patrick Baudisch,et al.  Fiberio: a touchscreen that senses fingerprints , 2013, UIST.

[39]  Kristof Van Laerhoven,et al.  Wear is Your Mobile? Investigating Phone Carrying and Use Habits with a Wearable Device , 2015, Front. ICT.

[40]  Rob Miller,et al.  Smart Homes that Monitor Breathing and Heart Rate , 2015, CHI.

[41]  Jose L. Contreras-Vidal,et al.  Understanding One-Handed Use of Mobile Devices , 2008 .

[42]  A. J. Bernheim Brush,et al.  Health chair: implicitly sensing heart and respiratory rate , 2014, UbiComp.

[43]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[44]  Anne Roudaut,et al.  Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones , 2017, CHI.