Luxapose: indoor positioning with mobile phones and visible light

We explore the indoor positioning problem with unmodified smartphones and slightly-modified commercial LED luminaires. The luminaires-modified to allow rapid, on-off keying-transmit their identifiers and/or locations encoded in human-imperceptible optical pulses. A camera-equipped smartphone, using just a single image frame capture, can detect the presence of the luminaires in the image, decode their transmitted identifiers and/or locations, and determine the smartphone's location and orientation relative to the luminaires. Continuous image capture and processing enables continuous position updates. The key insights underlying this work are (i) the driver circuits of emerging LED lighting systems can be easily modified to transmit data through on-off keying; (ii) the rolling shutter effect of CMOS imagers can be leveraged to receive many bits of data encoded in the optical transmissions with just a single frame capture, (iii) a camera is intrinsically an angle-of-arrival sensor, so the projection of multiple nearby light sources with known positions onto a camera's image plane can be framed as an instance of a sufficiently-constrained angle-of-arrival localization problem, and (iv) this problem can be solved with optimization techniques. We explore the feasibility of the design through an analytical model, demonstrate the viability of the design through a prototype system, discuss the challenges to a practical deployment including usability and scalability, and demonstrate decimeter-level accuracy in both carefully controlled and more realistic human mobility scenarios.

[1]  Nadarajah Narendran,et al.  A driving scheme to reduce AC LED flicker , 2013, Optics & Photonics - Optical Engineering + Applications.

[2]  Venkata N. Padmanabhan,et al.  Indoor localization without the pain , 2010, MobiCom.

[3]  Thomas D. C. Little,et al.  A two phase hybrid RSS/AoA algorithm for indoor device localization using visible light , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[4]  Yunhao Liu,et al.  Locating in fingerprint space: wireless indoor localization with little human intervention , 2012, Mobicom '12.

[5]  Matt Welsh,et al.  MoteTrack: a robust, decentralized approach to RF-based location tracking , 2006, Personal and Ubiquitous Computing.

[6]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[7]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[8]  Sridhar Rajagopal,et al.  IEEE 802.15.7 visible light communication: modulation schemes and dimming support , 2012, IEEE Communications Magazine.

[9]  Sang-Kook Han,et al.  Indoor three-dimensional location estimation based on LED visible light communication , 2013 .

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Edwin Olson,et al.  AprilCal: Assisted and repeatable camera calibration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[13]  Mohsen Kavehrad,et al.  Indoor positioning algorithm using light-emitting diode visible light communications , 2012 .

[14]  S. Haruyama,et al.  High-accuracy positioning system using visible LED lights and image sensor , 2008, 2008 IEEE Radio and Wireless Symposium.

[15]  Ig-Jae Kim,et al.  Indoor location sensing using geo-magnetism , 2011, MobiSys '11.

[16]  Ruzena Bajcsy,et al.  Precise indoor localization using smart phones , 2010, ACM Multimedia.

[17]  Harald Haas,et al.  Using a CMOS camera sensor for visible light communication , 2012, 2012 IEEE Globecom Workshops.

[18]  Anthony Rowe,et al.  Visual light landmarks for mobile devices , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[19]  Junyi Li,et al.  Visible light communication: opportunities, challenges and the path to market , 2013, IEEE Communications Magazine.

[20]  Prabal Dutta,et al.  GATD : A Robust , Extensible , Versatile Swarm Dataplane , 2014 .

[21]  Yin Chen,et al.  FM-based indoor localization , 2012, MobiSys '12.

[22]  Gang Chen,et al.  Line-of-sight visible light communication system design and demonstration , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[23]  Adrian Neild,et al.  Visible light positioning: a roadmap for international standardization , 2013, IEEE Commun. Mag..

[24]  Jie Xiong,et al.  ArrayTrack: A Fine-Grained Indoor Location System , 2011, NSDI.

[25]  Masao Nakagawa,et al.  Fundamental analysis for visible-light communication system using LED lights , 2004, IEEE Transactions on Consumer Electronics.

[26]  Moustafa Youssef,et al.  The Horus WLAN location determination system , 2005, MobiSys '05.

[27]  Martial Hebert,et al.  Bearings-only localization and mapping , 2005 .

[28]  Guobin Shen,et al.  Epsilon: A Visible Light Based Positioning System , 2014, NSDI.

[29]  Ki-Doo Kim,et al.  Indoor Positioning by LED Visible Light Communication and Image Sensors , 2011 .