Distributed Optimization Framework for Shadow Removal in Multi‐Projection Systems

This paper proposes a novel shadow removal technique for cooperative projection system based on spatiotemporal prediction. In our previous work, we proposed a distributed feedback algorithm, which is implementable in cooperative projection environments subject to data transfer constraints between components. A weakness of this scheme is that the compensation is conducted in each pixel independently. As a result, spatiotemporal information of the environmental change cannot be utilized even if it is available. In view of this, we specifically investigate the situation where some of the projectors are occluded by a moving object whose one‐frame‐ahead behaviour is predictable. In order to remove the resulting shadow, we propose a novel error propagating scheme that is still implementable in a distributed manner and enables us to incorporate the prediction information of the obstacle. It is demonstrated theoretically and experimentally that the proposed method significantly improves the shadow removal performance in comparison to the previous work.

[1]  Namrata Vaswani,et al.  Particle filtering for geometric active contours with application to tracking moving and deforming objects , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[3]  Gordon Wetzstein,et al.  The visual computing of projector-camera systems , 2008, SIGGRAPH '08.

[4]  Christopher O. Jaynes,et al.  Camera-based detection and removal of shadows from interactive multiprojector displays , 2004, IEEE Transactions on Visualization and Computer Graphics.

[5]  Oliver Bimber,et al.  Embedded Entertainment with Smart Projectors , 2005, Computer.

[6]  Shree K. Nayar,et al.  Making one object look like another: controlling appearance using a projector-camera system , 2004, CVPR 2004.

[7]  Gita Reese Sukthankar,et al.  Dynamic shadow elimination for multi-projector displays , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Kenji Kashima,et al.  Radiometric Compensation for Cooperative Distributed Multi-Projection System Through 2-DOF Distributed Control , 2015, IEEE Transactions on Visualization and Computer Graphics.

[9]  Kosuke Sato,et al.  Shadow removal of projected imagery by occluder shape measurement in a multiple overlapping projection system , 2014, Virtual Reality.

[10]  Hirokazu Kato,et al.  Appearance Control Using Projection with Model Predictive Control , 2010, 2010 20th International Conference on Pattern Recognition.

[11]  Jeremy R. Cooperstock,et al.  Shadow Removal in Front Projection Environments Using Object Tracking , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Chris Dwyer,et al.  Self-assembled architectures and the temporal aspects of computing , 2005, Computer.

[13]  Yin Zhixiang,et al.  Distributed subgradient method for multi-agent optimization with communication delays , 2013, Proceedings of the 32nd Chinese Control Conference.

[14]  W. Brent Seales,et al.  Dynamic shadow removal from front projection displays , 2001, Proceedings Visualization, 2001. VIS '01..

[15]  Shun Ushida,et al.  Successive Wide Viewing Angle Appearance Manipulation with Dual Projector Camera Systems , 2014, ICAT-EGVE.

[16]  James M. Rehg,et al.  Shadow Elimination and Blinding Light Suppression for Interactive Projected Displays , 2007, IEEE Trans. Vis. Comput. Graph..

[17]  Hideki Koike,et al.  Contrasting shadow for occluder light suppression from one-shot image , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.