Display Light Panel and Rolling Shutter Image Sensor Based Optical Camera Communication (OCC) Using Frame-Averaging Background Removal and Neural Network

Optical wireless communication (OWC) has emerged as a complementary or alternative technology to the radio-frequency (RF) communication. OWC based on image sensor, which is also called optical camera communication (OCC) has attracted much attention from industrial and academic societies. Here, we discuss several recent OCC technologies. We propose and demonstrate a light emitting diode (LED) light panel and rolling shutter image sensor based OCC system using frame-averaging background removal (FABR) technique, Z-score normalization, and neural network (NN). Here, a driver circuit for the LED display panel based on a bipolar-junction-transistor (BJT) and a metal-oxide-semiconductor field-effect-transistor (MOSFET) is also discussed. It can provide low enough driving frequency from a few Hz to kHz and high bias current for the LED light panel. Experimental results show that the proposed scheme can mitigate the inter-symbol interference (ISI) observed in the rolling shutter pattern produced by the high noise-ratio (NR) of the display contents.

[1]  Chi-Wai Chow,et al.  Visible light communication and positioning using positioning cells and machine learning algorithms. , 2019, Optics express.

[2]  Chi-Wai Chow,et al.  RGB visible light communication using mobile-phone camera and multi-input multi-output. , 2016, Optics express.

[3]  Chien-Hung Yeh,et al.  Secure Mobile-Phone Based Visible Light Communications With Different Noise-Ratio Light-Panel , 2018, IEEE Photonics Journal.

[4]  Anthony Rowe,et al.  Visual light landmarks for mobile devices , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[5]  Trang Nguyen,et al.  Current Status and Performance Analysis of Optical Camera Communication Technologies for 5G Networks , 2017, IEEE Access.

[6]  Richard D. Roberts,et al.  Undersampled frequency shift ON-OFF keying (UFSOOK) for camera communications (CamCom) , 2013, 2013 22nd Wireless and Optical Communication Conference.

[7]  M. S. Islim,et al.  Towards 10 Gb/s orthogonal frequency division multiplexing-based visible light communication using a GaN violet micro-LED , 2017 .

[8]  Chi-Wai Chow,et al.  20.231 Gbit/s tricolor red/green/blue laser diode based bidirectional signal remodulation visible-light communication system , 2018 .

[9]  Chi-Wai Chow,et al.  Enabling Techniques for Optical Wireless Communication Systems , 2020, 2020 Optical Fiber Communications Conference and Exhibition (OFC).

[10]  Masao Nakagawa,et al.  Fundamental analysis for visible-light communication system using LED lights , 2004, IEEE Transactions on Consumer Electronics.

[11]  Lih Chieh Png,et al.  Experimental Demonstration of RGB LED-Based Optical Camera Communications , 2015, IEEE Photonics Journal.

[12]  Yen-Ting Chen,et al.  Beacon Jointed Packet Reconstruction Scheme for Mobile-Phone Based Visible Light Communications Using Rolling Shutter , 2017, IEEE Photonics Journal.

[13]  Meng Shi,et al.  10.72Gb/s Visible Light Communication System Based On Single Packaged RGBYC LED Utilizing QAM-DMT Modulation With Hardware Pre-Equalization , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[14]  Hideki Aoyama,et al.  Visible light communication using a conventional image sensor , 2015, 2015 12th Annual IEEE Consumer Communications and Networking Conference (CCNC).

[15]  Adrian Neild,et al.  Visible light positioning: a roadmap for international standardization , 2013, IEEE Commun. Mag..

[16]  Hao-Chung Kuo,et al.  450-nm GaN laser diode enables high-speed visible light communication with 9-Gbps QAM-OFDM. , 2015, Optics express.

[17]  Trang Nguyen,et al.  Region-of-Interest Signaling Vehicular System Using Optical Camera Communications , 2017, IEEE Photonics Journal.

[18]  Purnami Widyaningsih,et al.  Limited memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS) method for the parameter estimation on geographically weighted ordinal logistic regression model (GWOLR) , 2017 .

[19]  Chi-Wai Chow,et al.  Efficient demodulation scheme for rolling-shutter-patterning of CMOS image sensor based visible light communications. , 2017, Optics express.

[20]  Chi-Wai Chow,et al.  Comparison of thresholding schemes for visible light communication using mobile-phone image sensor. , 2016, Optics express.

[21]  Hai-Han Lu,et al.  An 8 m/9.6 Gbps Underwater Wireless Optical Communication System , 2016, IEEE Photonics Journal.

[22]  Chi-Wai Chow,et al.  Using advertisement light-panel and CMOS image sensor with frequency-shift-keying for visible light communication. , 2018, Optics express.

[23]  Dominic C. O'Brien,et al.  Visible light communications: Challenges and possibilities , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[24]  Hao-Chung Kuo,et al.  Phosphorous Diffuser Diverged Blue Laser Diode for Indoor Lighting and Communication , 2015, Scientific Reports.

[25]  Liqiong Liu,et al.  47-kbit/s RGB-LED-based optical camera communication based on 2D-CNN and XOR-based data loss compensation. , 2019, Optics express.

[26]  Kate Ching-Ju Lin,et al.  RollingLight: Enabling Line-of-Sight Light-to-Camera Communications , 2015, MobiSys.

[27]  Trang Nguyen,et al.  Modulation and Coding Scheme (MCS) for Indoor Image Sensor Communication System , 2017, Wirel. Pers. Commun..

[28]  Gong-Ru Lin,et al.  Blue Laser Diode Enables Underwater Communication at 12.4 Gbps , 2017, Scientific Reports.

[29]  D. O’brien,et al.  High-Speed Visible Light Communications Using Multiple-Resonant Equalization , 2008, IEEE Photonics Technology Letters.

[30]  Chi-Wai Chow,et al.  Non-flickering 100 m RGB visible light communication transmission based on a CMOS image sensor. , 2018, Optics express.

[31]  Chi-Wai Chow,et al.  Visible light communication using mobile-phone camera with data rate higher than frame rate. , 2015, Optics express.

[32]  Sridhar Rajagopal,et al.  IEEE 802.15.7 visible light communication: modulation schemes and dimming support , 2012, IEEE Communications Magazine.

[33]  C. Yeh,et al.  6.915-Gbit/s white-light phosphor laser diode-based DCO-OFDM visible light communication (VLC) system with functional transmission distance , 2020 .

[34]  Xuan Tang,et al.  Undersampled phase shift ON-OFF keying for camera communication , 2014, 2014 Sixth International Conference on Wireless Communications and Signal Processing (WCSP).

[35]  Scott A. Hamilton,et al.  Undersea laser communication with narrow beams , 2015, IEEE Communications Magazine.

[36]  Chien-Hung Yeh,et al.  Digital Signal Processing for Light Emitting Diode Based Visible Light Communication , 2012 .

[37]  Xuan Tang,et al.  Undersampled-PAM with subcarrier modulation for camera communications , 2015, 2015 Opto-Electronics and Communications Conference (OECC).

[38]  S. Denbaars,et al.  4 Gbps direct modulation of 450 nm GaN laser for high-speed visible light communication. , 2015, Optics express.

[39]  Shuji Nakamura,et al.  2 Gbit/s data transmission from an unfiltered laser-based phosphor-converted white lighting communication system. , 2015, Optics express.

[40]  Hongda Chen,et al.  A 550 Mbit/s real-time visible light communication system based on phosphorescent white light LED for practical high-speed low-complexity application. , 2014, Optics express.

[41]  Harald Haas,et al.  Using a CMOS camera sensor for visible light communication , 2012, 2012 IEEE Globecom Workshops.

[42]  Nan Chi,et al.  1.6 Gbit/s phosphorescent white LED based VLC transmission using a cascaded pre-equalization circuit and a differential outputs PIN receiver. , 2015, Optics express.

[43]  Hideki Aoyama,et al.  Line scan sampling for visible light communication: Theory and practice , 2015, 2015 IEEE International Conference on Communications (ICC).

[44]  Trang Nguyen,et al.  Design and Implementation of a Novel Compatible Encoding Scheme in the Time Domain for Image Sensor Communication , 2016, Sensors.

[45]  G Cossu,et al.  3.4 Gbit/s visible optical wireless transmission based on RGB LED. , 2012, Optics express.

[46]  Mohamed-Slim Alouini,et al.  20-meter underwater wireless optical communication link with 1.5 Gbps data rate. , 2016, Optics express.

[47]  Yang Liu,et al.  Rolling-shutter-effect camera-based visible light communication using RGB channel separation and an artificial neural network. , 2020, Optics express.

[48]  Chi-Wai Chow,et al.  Using logistic regression classification for mitigating high noise-ratio advisement light-panel in rolling-shutter based visible light communications. , 2019, Optics express.

[49]  Gong-Ru Lin,et al.  Tricolor R/G/B Laser Diode Based Eye-Safe White Lighting Communication Beyond 8 Gbit/s , 2017, Scientific Reports.

[50]  Hanlin Zhang,et al.  A Novel Three-dimensional Indoor Localization Algorithm Based on Visual Visible Light Communication Using Single LED , 2018, 2018 IEEE International Conference on Automation, Electronics and Electrical Engineering (AUTEEE).

[51]  Gong-Ru Lin,et al.  Filtered Multicarrier OFDM Encoding on Blue Laser Diode for 14.8-Gbps Seawater Transmission , 2018, Journal of Lightwave Technology.

[52]  Mohamed-Slim Alouini,et al.  4-Gbit/s visible light communication link based on 16-QAM OFDM transmission over remote phosphor-film converted white light by using blue laser diode. , 2015, Optics express.

[53]  C. Chow,et al.  Enhancement of Signal Performance in LED Visible Light Communications Using Mobile Phone Camera , 2015, IEEE Photonics Journal.

[54]  Yeong Min Jang,et al.  A survey of design and implementation for optical camera communication , 2017, Signal Process. Image Commun..