Spatially varying radiometric calibration for camera-display messaging

Modern society has ubiquitous electronic displays including billboards, signage and kiosks. The concurrent prevalence of handheld cameras creates a novel opportunity to use cameras and displays as communication channels. The electronic display in this channel serves a twofold purpose: to display an image to humans while simultaneously transmitting hidden bits for decoding by a camera. Unlike standard digital watermarking, the message recovery in camera-display systems requires physics-based modeling of image formation in order to optically communicate hidden messages in real world scenes. By modeling the photometry of the system using a camera-display transfer function (CDTF), we show that this function depends on camera pose and varies spatially over the display.We devise a radiometric calibration to handle the nonlinearities of both the display and the camera, and we use this method for recovering video messages hidden within display images. Results are for 9 different display-camera systems for messages with 4500 bits. Message accuracy improves significantly with calibration and we achieve accuracy near 99% in our experiments, independent of the type of camera or display used.

[1]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[2]  K. Langer,et al.  513 Mbit/s Visible Light Communications Link Based on DMT-Modulation of a White LED , 2010, Journal of Lightwave Technology.

[3]  A. Sangeetha,et al.  A Watermarking Approach to Combat Geometric Attacks , 2009, 2009 International Conference on Digital Image Processing.

[4]  Jean-Luc Dugelay,et al.  Still-image watermarking robust to local geometric distortions , 2006, IEEE Transactions on Image Processing.

[5]  Ashwin Ashok,et al.  Dynamic and invisible messaging for visual MIMO , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[6]  Ping Li,et al.  Robust Image Copy Detection Using Local Invariant Feature , 2009, 2009 International Conference on Multimedia Information Networking and Security.

[7]  Michael S. Brown,et al.  Revisiting radiometric calibration for color computer vision , 2011, 2011 International Conference on Computer Vision.

[8]  Jun Wu,et al.  A feature-based robust digital image watermarking against geometric attacks , 2008, Image Vis. Comput..

[9]  Ramesh Raskar,et al.  VRCodes: Unobtrusive and active visual codes for interaction by exploiting rolling shutter , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[10]  Ashwin Ashok,et al.  Computer vision methods for visual MIMO optical system , 2011, CVPR 2011 WORKSHOPS.

[11]  Kevin Curran,et al.  Digital image steganography: Survey and analysis of current methods , 2010, Signal Process..

[12]  Perli. Samuel David.  Pixnet : designing interference-free wireless links using LCD-camera pairs , 2010 .

[13]  Zongming Guo,et al.  A Robust Video Watermarking Scheme Resilient to Spatial Desynchronization and Photometric Distortion , 2006, 2006 8th international Conference on Signal Processing.

[14]  Gang Zhang,et al.  Invisible barcode with optimized error correction , 2008, 2008 15th IEEE International Conference on Image Processing.

[15]  Ramesh Raskar,et al.  Bokode: imperceptible visual tags for camera based interaction from a distance , 2009, ACM Trans. Graph..

[16]  Stephen Lin,et al.  A New In-Camera Imaging Model for Color Computer Vision and Its Application , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Peter Wayner,et al.  Disappearing Cryptography: Information Hiding: Steganography and Watermarking , 2008 .

[18]  Trevor Darrell,et al.  From pixels to physics: Probabilistic color de-rendering , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Ashwin Ashok,et al.  Characterizing multiplexing and diversity in visual MIMO , 2011, 2011 45th Annual Conference on Information Sciences and Systems.

[21]  Ashwin Ashok,et al.  Challenge: mobile optical networks through visual MIMO , 2010, MobiCom.