Visible Light Knows Who You Are

We examine the feasibility of human identification using purely the ubiquitous visible light. Empowered by the Visible Light Communication (VLC), the identification system consists of VLC-enabled LED lights on the ceiling emitting light beacons, and photodiodes on the floor capturing a continuous stream of shadow maps each corresponding to an LED light. We leverage these shadow maps to localize a user's key boy joints in the 3D space and recognize the user based on the estimated body parameters (e.g., shoulder width, arm length). Preliminary results with 10 participants show 80\% success rate, i.e., correctly identifying 8 participants out of 10. The mean error of the body parameter estimation is 0.03 m. To extend the system to diverse practical settings, we discuss the our plan of incorporating advanced behavioral features to enhance the identification accuracy and robustness.

[1]  TanTieniu,et al.  Fusion of static and dynamic body biometrics for gait recognition , 2004 .

[2]  Rama Chellappa,et al.  Fusion of gait and face for human identification , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Zachary Weinberg,et al.  I Still Know What You Visited Last Summer: Leaking Browsing History via User Interaction and Side Channel Attacks , 2011, 2011 IEEE Symposium on Security and Privacy.

[4]  Jason I. Hong,et al.  Wave to me: user identification using body lengths and natural gestures , 2014, CHI.

[5]  Xia Zhou,et al.  Human Sensing Using Visible Light Communication , 2015, MobiCom.

[6]  Aaron F. Bobick,et al.  Gait recognition using static, activity-specific parameters , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Darren Leigh,et al.  Very Low-Cost Sensing and Communication Using Bidirectional LEDs , 2003, UbiComp.

[8]  Jian-Shuen Fang,et al.  Real-time human identification using a pyroelectric infrared detector array and hidden Markov models. , 2006, Optics express.

[9]  Tieniu Tan,et al.  Fusion of static and dynamic body biometrics for gait recognition , 2004, IEEE Trans. Circuits Syst. Video Technol..

[10]  Marco Gruteser,et al.  Distinguishing users with capacitive touch communication , 2012, Mobicom '12.

[11]  Kamin Whitehouse,et al.  Using Height Sensors for Biometric Identification in Multi-resident Homes , 2010, Pervasive.

[12]  Lama Nachman,et al.  Unobtrusive gait verification for mobile phones , 2014, SEMWEB.

[13]  Perli. Samuel David Pixnet : designing interference-free wireless links using LCD-camera pairs , 2010 .

[14]  Mohsen Kavehrad,et al.  Comparison of VLC-based indoor positioning techniques , 2013, Photonics West - Optoelectronic Materials and Devices.

[15]  Yumi Iwashita,et al.  Gait Recognition Using Shadow Analysis , 2009, 2009 Symposium on Bio-inspired Learning and Intelligent Systems for Security.

[16]  Kaigui Bian,et al.  Strata: layered coding for scalable visual communication , 2014, MobiCom.

[17]  Jaeseok Yun,et al.  Human Movement Detection and Idengification Using Pyroelectric Infrared Sensors , 2014, Sensors.

[18]  Jun Yang,et al.  SenGuard: Passive user identification on smartphones using multiple sensors , 2011, 2011 IEEE 7th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[19]  TanTieniu,et al.  Automatic gait recognition based on statistical shape analysis , 2003 .

[20]  Ryan J. Halter,et al.  A wearable system that knows who wears it , 2014, MobiSys.

[21]  Tieniu Tan,et al.  Fusion of static and dynamic body biometrics for gait recognition , 2003, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Dina Katabi,et al.  PixNet: interference-free wireless links using LCD-camera pairs , 2010, MobiCom '10.

[23]  Vivek Sarkar,et al.  Automatic detection of inter-application permission leaks in Android applications , 2013, IBM J. Res. Dev..

[24]  Prabal Dutta,et al.  Luxapose: indoor positioning with mobile phones and visible light , 2014, MobiCom.

[25]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[26]  H. Haas,et al.  A 3-Gb/s Single-LED OFDM-Based Wireless VLC Link Using a Gallium Nitride $\mu{\rm LED}$ , 2014, IEEE Photonics Technology Letters.

[27]  Sang-Kook Han,et al.  An Indoor Visible Light Communication Positioning System Using a RF Carrier Allocation Technique , 2013, Journal of Lightwave Technology.

[28]  Guobin Shen,et al.  Epsilon: A Visible Light Based Positioning System , 2014, NSDI.

[29]  Fadel Adib,et al.  Multi-Person Localization via RF Body Reflections , 2015, NSDI.

[30]  Xia Zhou,et al.  Visible light networking and sensing , 2014, HotWireless@MobiCom.

[31]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[32]  Ashwin Ashok,et al.  Challenge: mobile optical networks through visual MIMO , 2010, MobiCom.

[33]  Guoliang Xing,et al.  COBRA: color barcode streaming for smartphone systems , 2012, MobiSys '12.

[34]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[35]  He Wang,et al.  Visually Fingerprinting Humans without Face Recognition , 2015, MobiSys.

[36]  Masao Nakagawa,et al.  Fundamental analysis for visible-light communication system using LED lights , 2004, IEEE Transactions on Consumer Electronics.

[37]  Chunming Hu,et al.  Enhancing reliability to boost the throughput over screen-camera links , 2014, MobiCom.

[38]  Wenjun Hu,et al.  LightSync: unsynchronized visual communication over screen-camera links , 2013, MobiCom.

[39]  Neil Gershenfeld,et al.  E-broidery: Design and fabrication of textile-based computing , 2000, IBM Syst. J..

[40]  Tieniu Tan,et al.  Automatic gait recognition based on statistical shape analysis , 2003, IEEE Trans. Image Process..

[41]  Marina Ruggieri,et al.  WIBECAM: Device Free Human Activity Recognition Through WiFi Beacon-Enabled Camera , 2015, WPA@MobiSys.

[42]  Stefan Schmid,et al.  LED-to-LED visible light communication networks , 2013, MobiHoc '13.