ChromaCode: A Fully Imperceptible Screen-Camera Communication System

Hidden screen-camera communication techniques emerge as a new paradigm that embeds data imperceptibly into regular videos while remaining unobtrusive to human viewers. Three key goals on imperceptible, high rate, and reliable communication are desirable but conflicting, and existing solutions usually made a trade-off among them. In this paper, we present the design and implementation of ChromaCode, a screen-camera communication system that achieves all three goals simultaneously. In our design, we consider for the first time color space for perceptually uniform lightness modifications. On this basis, we design an outcome-based adaptive embedding scheme, which adapts to both pixel lightness and regional texture. Last, we propose a concatenated code scheme for robust coding and devise multiple techniques to overcome various screen-camera channel errors. Our prototype and experiments demonstrate that ChromaCode achieves remarkable raw throughputs of >700 kbps, data goodputs of 120 kbps with BER of 0.05, and with fully imperceptible flicker for viewing proved by user study, which significantly outperforms previous works.

[1]  Rolf G. Kuehni.  Historical Development of Color Space and Color Difference Formulas , 2003 .

[2]  David Williams,et al.  The arrangement of the three cone classes in the living human eye , 1999, Nature.

[3]  Xinbing Wang,et al.  ARTcode: preserve art and code in any image , 2016, UbiComp.

[4]  Chi Zhang,et al.  Towards a visible light network architecture for continuous communication and localization , 2016, VLCS '16.

[5]  D. L. Macadam.  Visual Sensitivities to Color Differences in Daylight , 1942 .

[6]  R. McDonald,et al.  CIE94‐a new colour‐difference formula* , 2008 .

[7]  Feng Li,et al.  Uber-in-light: Unobtrusive visible light communication leveraging complementary color channel , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[8]  J A Solomon,et al.  Texture interactions determine perceived contrast , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Guoliang Xing,et al.  COBRA: color barcode streaming for smartphone systems , 2012, MobiSys '12.

[10]  Wenjun Hu,et al.  LightSync: unsynchronized visual communication over screen-camera links , 2013, MobiCom.

[11]  Ashwin Ashok,et al.  High-rate flicker-free screen-camera communication with spatially adaptive embedding , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[12]  S. Shankar Sastry,et al.  Geometric Models of Rolling-Shutter Cameras , 2005, ArXiv.

[13]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[14]  Chunming Hu,et al.  Enhancing reliability to boost the throughput over screen-camera links , 2014, MobiCom.

[15]  Guobin Shen,et al.  InFrame: Multiflexing Full-Frame Visible Communication Channel for Humans and Devices , 2014, HotNets.

[16]  Edward W. Knightly,et al.  LiRa: A WLAN Architecture for Visible Light Communication with a Wi-Fi Uplink , 2017, 2017 14th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[17]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[18]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Guobin Shen,et al.  InFrame++: Achieve Simultaneous Screen-Human Viewing and Hidden Screen-Camera Communication , 2015, MobiSys.

[20]  H. Coxeter.  Introduction to Geometry , 1961 .

[21]  Zhouping Wei,et al.  A median-Gaussian filtering framework for Moiré pattern noise removal from X-ray microscopy image. , 2012, Micron.

[22]  B. Rigg,et al.  Uniform Colour Space Based on the CMC(l:c) Colour‐difference Formula , 2008 .

[23]  Dina Katabi,et al.  PixNet: LCD-camera pairs as communication links , 2010, SIGCOMM '10.

[24]  P.V.C. Hough,et al.  Machine Analysis of Bubble Chamber Pictures , 1959 .

[25]  G S Brindley,et al.  The flicker fusion frequency of the blue‐sensitive mechanism of colour vision , 1966, The Journal of physiology.

[26]  M. Brill,et al.  How the CIE 1931 color-matching functions were derived from Wright-Guild data , 1997 .

[27]  Dimitrios Koutsonikolas,et al.  Messages behind the sound: real-time hidden acoustic signal capture with smartphones , 2016, MobiCom.

[28]  H. Yaguchi,et al.  Colorimetry - Part 5: CIE 1976 L*u*v* Colour Space and u, vUniform Chromaticity Scale Diagram , 2010 .

[29]  Yu Liu,et al.  A Discussion on Printing Color Difference Tolerance by CIEDE2000 Color Difference Formula , 2012 .

[30]  Xia Zhou,et al.  The darkLight rises: visible light communication in the dark , 2016, MobiCom.

[31]  Marco Gruteser,et al.  Reading between lines: high-rate, non-intrusive visual codes within regular videos via ImplicitCode , 2015, UbiComp.

[32]  Tianxing Li,et al.  Real-Time Screen-Camera Communication Behind Any Scene , 2015, MobiSys.

[33]  David J. Fleet,et al.  Embedding invisible information in color images , 1997, Proceedings of International Conference on Image Processing.

[34]  Jeffrey G. Andrews,et al.  Broadband wireless access with WiMax/802.16: current performance benchmarks and future potential , 2005, IEEE Communications Magazine.