SpecEye: Towards Pervasive and Privacy-Preserving Screen Exposure Detection in Daily Life

Digital devices have become a necessity in our daily life, with digital screens acting as a gateway to access a plethora of information present in the underlying device. However, these devices emit visible light through screens where long-term use can lead to significant screen exposure, further influencing users' health. Conventional methods on screen exposure detection (\textite.g., photo logger) are usually privacy-invasive and expensive, further, require ideal light conditions, which are unattainable in real practice. Considering the light intensity and spectrum vary among different light sources, an effective screen spectrum estimation can provide vital information about screen exposure. To this end, we first investigate the characteristics of the junction between p-type and n-type semiconductor (i.e., PN junction) to sense the spectrum under various conditions. Empirically, we design and implement, \textsfSpecEye, an end-to-end, low cost, wearable, and privacy-preserving screen exposure detection system with a mobile application. For validating the performance of our system, we conduct comprehensive experiments with $54$ commodity digital screens, at $43$ distinct locations, with results showing a base accuracy of $99$%, and an equal error rate (EER) approaching $0.80$% under the controlled lab setup. Moreover, we assess the reliability, robustness, and performance variation of \textsfSpecEye under various real-world circumstances to observe a stable accuracy of $95$%. Our real-world study indicates \textsfSpecEye is a promising system for screen exposure detection in everyday life.

[1]  Ryan J. Halter,et al.  A wearable system that knows who wears it , 2014, MobiSys.

[2]  Sailing He,et al.  A mobile device-based imaging spectrometer for environmental monitoring by attaching a lightweight small module to a commercial digital camera , 2017, Scientific Reports.

[3]  Maurizio Ardito Studies of the Influence of Display Size and Picture Brightness on the Preferred Viewing Distance for HDTV Programs , 1994 .

[4]  Oliver Amft,et al.  Computer Screen Use Detection Using Smart Eyeglasses , 2017, Front. ICT.

[5]  Song Liu,et al.  SmartLight: Light-weight 3D Indoor Localization Using a Single LED Lamp , 2017, SenSys.

[6]  R. Nelson,et al.  Timing of light exposure affects mood and brain circuits , 2017, Translational Psychiatry.

[7]  Jun Luo,et al.  ReflexCode: Coding with Superposed Reflection Light for LED-Camera Communication , 2017, MobiCom.

[8]  B. Jalali,et al.  Two-Photon Photovoltaic Effect in Silicon , 2007, IEEE Journal of Quantum Electronics.

[9]  L. Hale,et al.  Screen time and sleep among school-aged children and adolescents: a systematic literature review. , 2015, Sleep medicine reviews.

[10]  Ida Alzira Gomes Duarte,et al.  Ultraviolet radiation emitted by lamps, TVs, tablets and computers: are there risks for the population? , 2015, Anais brasileiros de dermatologia.

[11]  Chi Zhang,et al.  Automating Visual Privacy Protection Using a Smart LED , 2017, MobiCom.

[12]  Xinbing Wang,et al.  iBlink: Smart Glasses for Facial Paralysis Patients , 2017, MobiSys.

[13]  Pan Hu,et al.  iShadow: design of a wearable, real-time mobile gaze tracker , 2014, MobiSys.

[14]  Neil Charness,et al.  Monitor Viewing Distance for Younger and Older Workers , 2008 .

[15]  Melanie Hartmann,et al.  Design Of Analog Cmos Integrated Circuits , 2016 .

[16]  Zhou Wang,et al.  Progressive switching median filter for the removal of impulse noise from highly corrupted images , 1999 .

[17]  Darren Leigh,et al.  Very Low-Cost Sensing and Communication Using Bidirectional LEDs , 2003, UbiComp.

[18]  Tianjiao Wang,et al.  LuBan: Low-Cost and In-Situ Droplet Micro-Sensing for Inkjet 3D Printing Quality Assurance , 2017, SenSys.

[19]  Joshua R. Smith,et al.  LoRa Backscatter , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[20]  Alfio V. Parisi,et al.  Smartphone Spectrometers , 2018, Sensors.

[21]  Sasan Fathpour,et al.  Two-photon photovoltaic effect in gallium arsenide , 2014, 2014 Conference on Lasers and Electro-Optics (CLEO) - Laser Science to Photonic Applications.

[22]  Yu-ichi Hayashi,et al.  A Threat for Tablet PCs in Public Space: Remote Visualization of Screen Images Using EM Emanation , 2014, CCS.

[23]  Baigang Zhang,et al.  Smartphone based optical spectrometer for diffusive reflectance spectroscopic measurement of hemoglobin , 2017, Scientific Reports.

[24]  M. Mimura,et al.  Smartphone viewing distance and sleep: an experimental study utilizing motion capture technology , 2017, Nature and science of sleep.

[25]  Andrew Harvey,et al.  Forecasting, Structural Time Series Models and the Kalman Filter , 1990 .

[26]  Sharath Pankanti,et al.  Guide to Biometrics , 2003, Springer Professional Computing.

[27]  Shin-Tson Wu,et al.  Fundamentals of Liquid Crystal Devices , 2006 .

[28]  H. Lei,et al.  Abnormal White Matter Integrity in Adolescents with Internet Addiction Disorder: A Tract-Based Spatial Statistics Study , 2012, PloS one.

[29]  Klaus David,et al.  A new context: Screen to face distance , 2014, 2014 8th International Symposium on Medical Information and Communication Technology (ISMICT).

[30]  David J. Crandall,et al.  Enhancing Lifelogging Privacy by Detecting Screens , 2016, CHI.

[31]  Carolyn M. Sommerich,et al.  Effects of Computer Monitor Viewing Angle and Related Factors on Strain, Performance, and Preference Outcomes , 2001, Hum. Factors.

[32]  Kang G. Shin,et al.  Continuous Authentication for Voice Assistants , 2017, MobiCom.

[33]  A. Wirz-Justice,et al.  Evening Exposure to a Light Emitting Diodes (led)-backlit Computer Screen Affects Circadian Physiology and Cognitive Performance 2 3 4 , 2022 .

[34]  Helena Curtis,et al.  Invitation to Biology , 1972 .

[35]  S. Tasoglu,et al.  Smart-phone attachable, flow-assisted magnetic focusing device , 2016 .

[36]  Abbas Jamalipour,et al.  Optical fiber smartphone spectrometer. , 2016, Optics letters.

[37]  Thomas J. Bruno,et al.  CRC Handbook of Fundamental Spectroscopic Correlation Charts , 2005 .

[38]  J. R. Macdonald,et al.  The Charging and Discharging of Nonlinear Capacitors , 1955, Proceedings of the IRE.

[39]  Kaigui Bian,et al.  Look into My Eyes: Fine-Grained Detection of Face-Screen Distance on Smartphones , 2016, 2016 12th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN).

[40]  A. Rabl,et al.  The average distribution of solar radiation-correlations between diffuse and hemispherical and between daily and hourly insolation values , 1979 .

[41]  Xia Zhou,et al.  Self-Powered Gesture Recognition with Ambient Light , 2018, UIST.

[42]  David Erickson,et al.  Nutrilyzer: A Mobile System for Characterizing Liquid Food with Photoacoustic Effect , 2016, SenSys.

[43]  Robert W. G. Hunt,et al.  The Reproduction of Colour: Sixth Edition , 2004 .

[44]  Xia Zhou,et al.  The darkLight rises: visible light communication in the dark , 2016, MobiCom.

[45]  Stefan Schmid,et al.  An LED-to-LED Visible Light Communication system with software-based synchronization , 2012, 2012 IEEE Globecom Workshops.

[46]  David J. Crandall,et al.  Deepdiary: Lifelogging image captioning and summarization , 2018, J. Vis. Commun. Image Represent..

[47]  Ramesh Raskar,et al.  Ultra-portable, wireless smartphone spectrometer for rapid, non-destructive testing of fruit ripeness , 2016, Scientific Reports.

[48]  Wenyao Xu,et al.  Ultra-Low Power Dynamic Knob in Adaptive Compressed Sensing Towards Biosignal Dynamics , 2016, IEEE Transactions on Biomedical Circuits and Systems.

[49]  Xia Zhou,et al.  Battery-Free Eye Tracker on Glasses , 2018, S3@MobiCom.

[50]  Steven M. Bellovin,et al.  A Privacy Analysis of Cross-device Tracking , 2017, USENIX Security Symposium.

[51]  J. L. Moll,et al.  P-N Junction Charge-Storage Diodes , 1962, Proceedings of the IRE.