Visual light landmarks for mobile devices

The omnipresence of indoor lighting makes it an ideal vehicle for pervasive communication with mobile devices. In this paper, we present a communication scheme that enables interior ambient LED lighting systems to send data to mobile devices using either cameras or light sensors. By exploiting rolling shutter camera sensors that are common on tablets, laptops and smartphones, it is possible to detect high-frequency changes in light intensity reflected off of surfaces and in direct line-of-sight of the camera. We present a demodulation approach that allows smartphones to accurately detect frequencies as high as 8kHz with 0.2kHz channel separation. In order to avoid humanly perceivable flicker in the lighting, our system operates at frequencies above 2kHz and compensates for the non-ideal frequency response of standard LED drivers by adjusting the light's duty-cycle. By modulating the PWM signal commonly used to drive LED lighting systems, we are able to encode data that can be used as localization landmarks. We show through experiments how a binary frequency shift keying modulation scheme can be used to transmit data at 1.25 bytes per second (fast enough to send an ID code) from up to 29 unique light sources simultaneously in a single collision domain. We also show how tags can demodulate the same signals using a light sensor instead of a camera for low-power applications.

[1]  K. Langer,et al.  Wireless High-Speed Data Transmission with Phosphorescent White-Light LEDs , 2011 .

[2]  Toshiya Tanaka,et al.  New Position Detection Method Using Image Sensor and Visible Light LEDs , 2009, 2009 Second International Conference on Machine Vision.

[3]  Andy Hopper,et al.  A new location technique for the active office , 1997, IEEE Wirel. Commun..

[4]  B.W. Parkinson,et al.  NAVSTAR: Global positioning system—Ten years later , 1983, Proceedings of the IEEE.

[5]  Masao Nakagawa,et al.  Indoor visible communication utilizing plural white LEDs as lighting , 2001, 12th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications. PIMRC 2001. Proceedings (Cat. No.01TH8598).

[6]  Hari Balakrishnan,et al.  6th ACM/IEEE International Conference on on Mobile Computing and Networking (ACM MOBICOM ’00) The Cricket Location-Support System , 2022 .

[7]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[8]  Joachim Walewski,et al.  High-Speed Wireless Indoor Communication via Visible Light , 2007 .

[9]  Lothar Thiele,et al.  Efficient network flooding and time synchronization with Glossy , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[10]  Richard D. Roberts,et al.  Undersampled frequency shift ON-OFF keying (UFSOOK) for camera communications (CamCom) , 2013, 2013 22nd Wireless and Optical Communication Conference.

[11]  Guoliang Xing,et al.  COBRA: color barcode streaming for smartphone systems , 2012, MobiSys '12.

[12]  John D. Bullough,et al.  Effects of flicker characteristics from solid-state lighting on detection, acceptability and comfort , 2011 .

[13]  Matt Welsh,et al.  MoteTrack: A Robust, Decentralized Approach to RF-Based Location Tracking , 2005, LoCA.

[14]  Wenjun Hu,et al.  LightSync: unsynchronized visual communication over screen-camera links , 2013, MobiCom.

[15]  Anthony Rowe,et al.  Indoor pseudo-ranging of mobile devices using ultrasonic chirps , 2012, SenSys '12.

[16]  Shuvra S. Bhattacharyya,et al.  Embedded Computer Vision , 2008 .

[17]  Ramesh Raskar,et al.  VRCodes: Unobtrusive and active visual codes for interaction by exploiting rolling shutter , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[18]  Harald Haas,et al.  Using a CMOS camera sensor for visible light communication , 2012, 2012 IEEE Globecom Workshops.

[19]  John D. Bullough,et al.  Detection and acceptability of stroboscopic effects from flicker , 2012 .

[20]  Masao Nakagawa,et al.  Fundamental analysis for visible-light communication system using LED lights , 2004, IEEE Transactions on Consumer Electronics.

[21]  Junichi Nakamura,et al.  Image Sensors and Signal Processing for Digital Still Cameras , 2005 .

[22]  Harald Haas,et al.  Indoor broadcasting via white LEDs and OFDM , 2009, IEEE Transactions on Consumer Electronics.