Compressive Inverse Light Transport

This paper explores the possibility of acquiring inverse li ght transport directly. The current strategy of obtaining an inverse light transport ma trix involves two steps: First, acquire the forward light transport matrix (f-LTM) and then calculate the inverse of the f-LTM. Both steps of the strategy requires considerable computational power. In addition to computational cost, the measurement error incurred at the first step inevitably propagates to or potentially gets amplified in the matrix inv ersion step. In this paper, we propose a sensing strategy that acquires the inverse light transport matrix (i-LTM) directly, without reconstructing the f-LTM. Our direct strategy reduces both computational error and cost of acquiring i-LTM. For that, we propose a compressive inverse theory. Following the compressible property of i-LTM, a reconstruction condition for i-LTM is introduced. This new framework implies a trade-off between two factors: condition numbers of submatrices of f-LTM and the isometry constant of the illumination pattern. Our direct i-LTM reconstruction method is then demonstrated with a 2nd-bounce separation experiment on an M-shaped panel scene. Finally by quantitatively comparing our method with the existing two-stage approach, our method shows higher accuracy with lower complexity. The proofs of main theorem/lemma are contained in the supplementary material. The compressive inverse theory is general and potentially useful for wider application.

[1]  Zhouchen Lin,et al.  Kernel Nyström method for light transport , 2009, ACM Trans. Graph..

[2]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[3]  Edmond Chow,et al.  A Priori Sparsity Patterns for Parallel Sparse Approximate Inverse Preconditioners , 1999, SIAM J. Sci. Comput..

[4]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[5]  T. Huckle Approximate sparsity patterns for the inverse of a matrix and preconditioning , 1999 .

[6]  Tian-Tsong Ng,et al.  A Dual Theory of Inverse and Forward Light Transport , 2010, ECCV.

[7]  Quinn Snell,et al.  Parallel hierarchical global illumination , 1997, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).

[8]  T. Chan,et al.  Wavelet sparse approximate inverse preconditioners , 1997 .

[9]  Pieter Peers,et al.  Compressive light transport sensing , 2009, ACM Trans. Graph..

[10]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[11]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[12]  Steve Marschner,et al.  Dual photography , 2005, ACM Trans. Graph..

[13]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[14]  Kiriakos N. Kutulakos,et al.  A theory of inverse light transport , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[15]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[16]  Shree K. Nayar,et al.  Multiplexing for Optimal Lighting , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  E.J. Candes Compressive Sampling , 2022 .

[18]  Emmanuel J. Cand The Restricted Isometry Property and Its Implications for Compressed Sensing , 2008 .

[19]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[20]  Kiriakos N. Kutulakos,et al.  Optical computing for fast light transport analysis , 2010, SIGGRAPH 2010.

[21]  Soheil Darabi,et al.  Compressive Dual Photography , 2009, Comput. Graph. Forum.

[22]  Yousef Saad,et al.  A Probing Method for Computing the Diagonal of the Matrix Inverse ∗ , 2010 .

[23]  Hitoshi Habe,et al.  Inter-Reflection Compensation for Immersive Projection Display , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Yonina C. Eldar,et al.  Compressed Sensing with Coherent and Redundant Dictionaries , 2010, ArXiv.

[25]  Michael F. Cohen,et al.  Radiosity and realistic image synthesis , 1993 .

[26]  Jingyi Yu,et al.  Catadioptric projectors , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Tony Q. S. Quek,et al.  Radiometric compensation using stratified inverses , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Simon Haykin,et al.  Communication Systems , 1978 .