Visible light positioning system based on CMOS image sensor using particle filter tracking and detecting algorithm

Abstract Positioning accuracy, robustness and real-time ability are the three critical elements in visible light positioning (VLP) system. While only a few exiting studies take these three critical elements into consideration at the same time to judge a practical VLP system, causing positioning and tracking method cannot be applied into real situation with different interferences. Therefore, to further improve the three aspects in the round and make it more feasible, a novel VLP method based on image sensor using particle filter tracking algorithm is proposed in this paper. The proposed positioning method locates the position of the terminal equipment with the proportional relationship of world coordinate, image coordinate and camera coordinate. The particle filter is utilized for the fast detection of LED in the image to improve the robustness of VLP system, which is not used for positioning What is more, particle filter algorithm uses HSV (hue, saturation, value) color histogram of signal source as features to realize tracking through importance sampling, weight updating, state estimation and resampling. All three components of HSV are considered and various processing steps of particle filter enhance tracking accuracy and robustness simultaneously. Experimental results show that the particle filter can provide an accuracy of 2.95 cm, which are acceptable in practical application scenarios, demonstrating that the LED detection is so accurate that the positioning accuracy of the positioning algorithm is not affected by the tracking algorithm. At the same time, the proposed algorithm maintains good stability when interference occurs and average computational time for each frame is only 0.021 s, which denotes that the computational cost required for particle filter is so small that the positioning algorithm is not affected by the tracking algorithm and can still have good real-time performance. All these data and performance confirm that the proposed tracking detection algorithm possess practical value and can handle background interference and shielding effect in traditional VLP system based on image sensor.

[1]  Yunhao Liu,et al.  ANDMARC: Indoor Location Sensing Using Active RFID , 2003, PerCom.

[2]  Jue Wang,et al.  Dude, where's my card?: RFID positioning that works with multipath and non-line of sight , 2013, SIGCOMM.

[3]  Gee-Kung Chang,et al.  Accurate Indoor Visible Light Positioning System utilizing Machine Learning Technique with Height Tolerance , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[4]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[5]  Aaron Striegel,et al.  Face-to-Face Proximity EstimationUsing Bluetooth On Smartphones , 2014, IEEE Transactions on Mobile Computing.

[6]  Badri N. Vellambi,et al.  Indoor Position Tracking Using Multiple Optical Receivers , 2016, Journal of Lightwave Technology.

[7]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[8]  Ki-Doo Kim,et al.  Performance improvement of indoor positioning using light-emitting diodes and an image sensor for light-emitting diode communication , 2015 .

[9]  Xin Chen,et al.  High-Speed Robust Dynamic Positioning and Tracking Method Based on Visual Visible Light Communication Using Optical Flow Detection and Bayesian Forecast , 2018, IEEE Photonics Journal.

[10]  S. Haruyama,et al.  High-accuracy positioning system using visible LED lights and image sensor , 2008, 2008 IEEE Radio and Wireless Symposium.

[11]  Shilin Xiao,et al.  Visible light indoor positioning based on camera with specular reflection cancellation , 2017, 2017 Conference on Lasers and Electro-Optics Pacific Rim (CLEO-PR).

[12]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[13]  Hideo Makino,et al.  LED-tracking and ID-estimation for indoor positioning using visible light communication , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[14]  Mohsen Kavehrad,et al.  VLC-based indoor positioning system with tracking capability using Kalman and particle filters , 2014, 2014 IEEE International Conference on Consumer Electronics (ICCE).

[15]  Parth H. Pathak,et al.  Visible Light Communication, Networking, and Sensing: A Survey, Potential and Challenges , 2015, IEEE Communications Surveys & Tutorials.

[16]  Liu Xiaowei,et al.  Performance analysis and enhancement for visible light communication using CMOS sensors , 2018 .

[17]  Ran Zhang,et al.  A Single LED Positioning System Based on Circle Projection , 2017, IEEE Photonics Journal.

[18]  Lei Yang,et al.  Tagoram: real-time tracking of mobile RFID tags to high precision using COTS devices , 2014, MobiCom.

[19]  Yong Ren,et al.  Does BTLE measure up against WiFi? A comparison of indoor location performance , 2014 .

[20]  Myungsik Yoo,et al.  An in-Depth Survey of Visible Light Communication Based Positioning Systems , 2016, Sensors.

[21]  Shueng-Han Gary Chan,et al.  Wi-Fi Fingerprint-Based Indoor Positioning: Recent Advances and Comparisons , 2016, IEEE Communications Surveys & Tutorials.

[22]  Junbin Fang,et al.  High-Speed Indoor Navigation System based on Visible Light and Mobile Phone , 2017, IEEE Photonics Journal.

[23]  Myungsik Yoo,et al.  TDoA based indoor visible light positioning systems , 2013, 2013 Fifth International Conference on Ubiquitous and Future Networks (ICUFN).

[24]  Ye Cai,et al.  The LED-ID Detection and Recognition Method Based on Visible Light Positioning Using Proximity Method , 2018, IEEE Photonics Journal.

[25]  Zhou Fa,et al.  Moving Target Localization and Tracking Algorithms:A Particle Filter Based Method , 2013 .

[26]  Edward Y. Chang,et al.  Error Modeling and Estimation Fusion for Indoor Localization , 2012, 2012 IEEE International Conference on Multimedia and Expo.