Radiometric Compensation for Cooperative Distributed Multi-Projection System Through 2-DOF Distributed Control

This paper proposes a novel radiometric compensation technique for cooperative projection system based-on distributed optimization. To achieve high scalability and robustness, we assume cooperative projection environments such that 1. each projector does not have information about other projectors as well as target images, 2. the camera does not have information about the projectors either, while having the target images, and 3. only a broadcast communication from the camera to the projectors is allowed to suppress the data transfer bandwidth. To this end, we first investigate a distributed optimization based feedback mechanism that is suitable for the required decentralized information processing environment. Next, we show that this mechanism works well for still image projection, however not necessary for moving images due to the lack of dynamic responsiveness. To overcome this issue, we propose to implement an additional feedforward mechanism. Such a 2 Degree Of Freedom (2-DOF) control structure is well-known in control engineering community as a typical method to enhance not only disturbance rejection but also reference tracking capability, simultaneously. We theoretically guarantee and experimentally demonstrate that this 2-DOF structure yields the moving image projection accuracy that is overwhelming the best achievable performance only by the distributed optimization mechanisms.

[1]  Shun Ushida,et al.  Successive Wide Viewing Angle Appearance Manipulation with Dual Projector Camera Systems , 2014, ICAT-EGVE.

[2]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[3]  Oliver Bimber,et al.  Embedded entertainment with smart projectors , 2005, Computer.

[4]  Oliver Bimber,et al.  Imperceptible Calibration for Radiometric Compensation , 2007, Eurographics.

[5]  Gordon Wetzstein,et al.  The Visual Computing of Projector‐Camera Systems , 2008, SIGGRAPH '08.

[6]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[7]  Anselm Grundhöfer,et al.  Augmenting physical avatars using projector-based illumination , 2013, ACM Trans. Graph..

[8]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[9]  T. Yoshida,et al.  A Virtual Color Reconstruction System for Real Heritage with Light Projection , 2003 .

[10]  Kosuke Sato,et al.  Artifact Reduction in Radiometric Compensation of Projector-Camera Systems for Steep Reflectance Variations , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Kosuke Sato,et al.  Dynamic defocus and occlusion compensation of projected imagery by model-based optimal projector selection in multi-projection environment , 2011, Virtual Reality.

[12]  Takahiro Okabe,et al.  Radiometric Compensation in a Projector-Camera System Based Properties of Human Vision System , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[13]  Hirokazu Kato,et al.  Appearance Control Using Projection with Model Predictive Control , 2010, 2010 20th International Conference on Pattern Recognition.

[14]  K. Sato,et al.  Range imaging system utilizing nematic liquid crystal mask , 1987 .

[15]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  Kosuke Sato,et al.  Shadow removal of projected imagery by occluder shape measurement in a multiple overlapping projection system , 2014, Virtual Reality.

[18]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[19]  Oliver Bimber,et al.  Multifocal projection: a multiprojector technique for increasing focal depth , 2006, IEEE Transactions on Visualization and Computer Graphics.