Simplified Light Probe using Minimal Number of Photodiodes

Many display system users have strongly desired that a superimposed virtual object of computer graphics (CG) have optical consistency with a real object at a scene. For this study, we model a real-world light environment as one point light source at infinite distance and an environmental light, which has only three parameters: the point light direction and intensity ratios of the two light sources. We propose a simplified light probe sensor that has five photo IC diodes on each surface of a square pillar, except at its bottom, to estimate the three parameters. The five outputs of the photo IC diode under specific model parameters are obtainable analytically because the directivity characteristics of photo IC diode are approximated as a cosine of the incident angle. The three parameters are then derived from the five outputs. The parameter estimation entails very low computational cost. Experimental results demonstrate sufficient estimation accuracy to render a CG object without a feeling of strangeness.

[1]  Atsuto Maki,et al.  Difference Sphere: An Approach to Near Light Source Estimation , 2004, CVPR.

[2]  Kenny Mitchell,et al.  From Faces to Outdoor Light Probes , 2018, Comput. Graph. Forum.

[3]  Katsushi Ikeuchi,et al.  Acquiring a Radiance Distribution to Superimpose Virtual Objects onto Real Scene , 2001, MVA.

[4]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[5]  Atsuto Maki,et al.  Self shadows and cast shadows in estimating illumination distribution , 2007 .

[6]  Yee-Hong Yang,et al.  Multiple Illuminant Direction Detection with Application to Image Synthesis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Naokazu Yokoya,et al.  Real-time estimation of light source environment for photorealistic augmented reality , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  Gustavo Patow,et al.  A Survey of Inverse Rendering Problems , 2003, Comput. Graph. Forum.

[9]  Atsuto Maki,et al.  Difference sphere: an approach to near light source estimation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Katsushi Ikeuchi,et al.  Illumination Distribution from Brightness in Shadows: Adaptive Estimation of Illumination Distribution with Unknown Reflectance Properties in Shadow Regions , 1999, ICCV.

[11]  David A. Forsyth,et al.  Rendering synthetic objects into legacy photographs , 2011, ACM Trans. Graph..

[12]  Jean-François Lalonde,et al.  Lighting Estimation in Outdoor Image Collections , 2014, 2014 2nd International Conference on 3D Vision.

[13]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Masao Shimizu Light environment estimation from a single cylinder image , 2013, 2013 IEEE International Conference on Signal and Image Processing Applications.

[15]  Alain Trémeau,et al.  Lighting Estimation in Indoor Environments from Low-Quality Images , 2012, ECCV Workshops.

[16]  Daniel Kurz,et al.  Real-time illumination estimation from faces for coherent rendering , 2014, ISMAR.

[17]  Andrew Jones,et al.  Direct HDR capture of the sun and sky , 2006, SIGGRAPH Courses.