Learning to Recognize Unmodified Lights with Invisible Features

To enable accurate indoor localization at low cost, recent research in visible light positioning (VLP) proposed to employ existing ceiling lights as location landmarks, and use smartphone cameras or light sensors to identify the different lights using statistical visual/optical features. Despite the potential, we find such solutions are unreliable: the features are easily corrupted with a slight rotation of the smartphone, and are not discriminative enough for many practical light models with different size/shape/intensity. In this work, we propose Auto-Litell to resolve these critical challenges and make VLP truly robust. Auto-Litell builds a customized deep-learning neural network model to automatically distill the "invisible" visual features from the lights, which are resilient to smartphone orientation and light models. Moreover, Auto-Litell introduces a Light-CycleGAN to generate "fake" light images to augment the training data, so as to relieve human labors in data collection and labeling. We have implemented Auto-Litell as a real-time localization and navigation system on Android. Our experiments demonstrate Auto-Litell's high accuracy in discriminating the lights in the same building, and high reliability across a variety of practical usage scenarios.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Han Cheng,et al.  Nonlinear compensation for optical vignetting in vision systems , 2017 .

[3]  Xiang Li,et al.  Dynamic-MUSIC: accurate device-free indoor localization , 2016, UbiComp.

[4]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[5]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[6]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[7]  Kang G. Shin,et al.  Gap Sense: Lightweight coordination of heterogeneous wireless devices , 2013, 2013 Proceedings IEEE INFOCOM.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Prabal Dutta,et al.  Luxapose: indoor positioning with mobile phones and visible light , 2014, MobiCom.

[10]  Yann LeCun,et al.  Disentangling factors of variation in deep representation using adversarial training , 2016, NIPS.

[11]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[12]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Philip Bachman,et al.  Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data , 2018, ICML.

[14]  Hany Farid,et al.  Blind inverse gamma correction , 2001, IEEE Trans. Image Process..

[15]  A.J.-W. Whang,et al.  Designing Uniform Illumination Systems by Surface-Tailored Lens and Configurations of LED Arrays , 2009, Journal of Display Technology.

[16]  Ray Sarch,et al.  From the Associate Editor , 1995, Int. J. Netw. Manag..

[17]  Adrian Neild,et al.  Visible light positioning: a roadmap for international standardization , 2013, IEEE Commun. Mag..

[18]  Yunhao Liu,et al.  Widar2.0: Passive Human Tracking with a Single Wi-Fi Link , 2018, MobiSys.

[19]  Bo Zhao,et al.  Modular Generative Adversarial Networks , 2018, ECCV.

[20]  Shih-Fu Chang,et al.  Image Splicing Detection using Camera Response Function Consistency and Automatic Segmentation , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[21]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[22]  Jana Kosecka,et al.  Qualitative image based localization in indoors environments , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[23]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Kang G. Shin,et al.  NEMOx: scalable network MIMO for wireless networks , 2013, MobiCom.

[25]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[26]  Fang Zhao,et al.  Dual-Agent GANs for Photorealistic and Identity Preserving Profile Face Synthesis , 2017, NIPS.

[27]  Wei Liu,et al.  Improved camera calibration method based on perpendicularity compensation for binocular stereo vision measurement system. , 2015, Optics express.

[28]  P. Yager,et al.  Optical measurement of transverse molecular diffusion in a microchannel. , 2001, Biophysical journal.

[29]  S. Pizer,et al.  The Image Processing Handbook , 1994 .

[30]  Chi Zhang,et al.  Towards a visible light network architecture for continuous communication and localization , 2016, VLCS '16.

[31]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[32]  Swarun Kumar,et al.  Decimeter-Level Localization with a Single WiFi Access Point , 2016, NSDI.

[33]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[34]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Yunhao Liu,et al.  Widar: Decimeter-Level Passive Tracking via Velocity Monitoring with Commodity Wi-Fi , 2017, MobiHoc.

[36]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Yin Chen,et al.  FM-based indoor localization , 2012, MobiSys '12.

[38]  Yunhao Liu,et al.  Indoor localization via multi-modal sensing on smartphones , 2016, UbiComp.

[39]  Cheng-Lun Chen,et al.  Intelligent color temperature estimation using fuzzy neural network with application to automatic white balance , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[40]  Guobin Shen,et al.  Epsilon: A Visible Light Based Positioning System , 2014, NSDI.

[41]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[43]  Chi Zhang,et al.  Pulsar: Towards Ubiquitous Visible Light Localization , 2017, MobiCom.

[44]  Rong Zheng,et al.  IDyLL: indoor localization using inertial and light sensors on smartphones , 2015, UbiComp.

[45]  Jun Zhu,et al.  Triple Generative Adversarial Nets , 2017, NIPS.

[46]  Adam Finkelstein,et al.  PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[49]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[51]  Zhen Wang,et al.  Multi-class Generative Adversarial Networks with the L2 Loss Function , 2016, ArXiv.

[52]  Sachin Katti,et al.  SpotFi: Decimeter Level Localization Using WiFi , 2015, SIGCOMM.

[53]  Qian Zhang,et al.  Wearables Can Afford: Light-weight Indoor Positioning with Visible Light , 2015, MobiSys.

[54]  Jie Xiong,et al.  ArrayTrack: A Fine-Grained Indoor Location System , 2011, NSDI.

[55]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[56]  Dan B. Goldman,et al.  Vignette and exposure calibration and compensation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[57]  Tian He,et al.  SpinLight: A High Accuracy and Robust Light Positioning System for Indoor Applications , 2015, SenSys.

[58]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[59]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[60]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[61]  Yunhuai Liu,et al.  LIPS: A Light Intensity Based Positioning System For Indoor Environments , 2014, ACM Trans. Sens. Networks.

[62]  Kang G. Shin,et al.  Exploiting Spectrum Heterogeneity in Dynamic Spectrum Market , 2012, IEEE Transactions on Mobile Computing.

[63]  Narendra Ahuja,et al.  Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Xinyu Zhang,et al.  Enabling High-Precision Visible Light Localization in Today's Buildings , 2017, MobiSys.

[65]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[66]  et al,et al.  The European Photon Imaging Camera on XMM-Newton: The MOS cameras : The MOS cameras , 2000, astro-ph/0011498.

[67]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[68]  Panlong Yang,et al.  Lightitude , 2018, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies.

[69]  Xinyu Zhang,et al.  Beam-forecast: Facilitating mobile 60 GHz networks via model-driven beam steering , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[70]  Chi Zhang,et al.  LiTell: robust indoor localization using unmodified light fixtures , 2016, MobiCom.

[71]  Dhruv Batra,et al.  LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation , 2016, ICLR.

[72]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).