x-Hour Outdoor Photometric Stereo

While Photometric Stereo (PS) has long been confined to the lab, there has been a recent interest in applying this technique to reconstruct outdoor objects and scenes. Un-fortunately, the most successful outdoor PS techniques typically require gathering either months of data, or waiting for a particular time of the year. In this paper, we analyze the illumination requirements for single-day outdoor PS to yield stable normal reconstructions, and determine that these requirements are often available in much less than a full day. In particular, we show that the right set of conditions for stable PS solutions may be observed in the sky within short time intervals of just above one hour. This work provides, for the first time, a detailed analysis of the factors affecting the performance of x-hour outdoor photometric stereo.

[1]  Ronen Basri,et al.  Photometric stereo with general, unknown lighting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Szymon Rusinkiewicz,et al.  Time‐Lapse Photometric Stereo and Applications , 2014, Comput. Graph. Forum.

[3]  Yannick Hold-Geoffroy,et al.  What Is a Good Day for Outdoor Photometric Stereo? , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[4]  Tony F. Chan,et al.  Outdoor photometric stereo , 2013, IEEE International Conference on Computational Photography (ICCP).

[5]  Katsushi Ikeuchi,et al.  Refining Outdoor Photometric Stereo Based on Sky Model , 2013, IPSJ Trans. Comput. Vis. Appl..

[6]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[7]  Robert Pless,et al.  Heliometric Stereo: Shape from Sun Position , 2012, ECCV.

[8]  Simon Fuhrmann,et al.  Photometric stereo for outdoor webcams , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Katsushi Ikeuchi,et al.  Photometric Stereo Using Internet Images , 2014, 2014 2nd International Conference on 3D Vision.

[10]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[11]  Roberto Cipolla,et al.  Overcoming Shadows in 3-Source Photometric Stereo , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jürgen Greif,et al.  European solar radiation atlas : solar radiation on horizontal and inclined surfaces , 1996 .

[13]  Ko Nishino,et al.  Shape and Reflectance from Natural Illumination , 2012, ECCV.

[14]  In-So Kweon,et al.  One-day outdoor photometric stereo via skylight estimation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Edward H. Adelson,et al.  Shape estimation in natural illumination , 2011, CVPR 2011.

[16]  Jitendra Malik,et al.  Shape, Illumination, and Reflectance from Shading , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Mike J. Chantler,et al.  On optimal light configurations in photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[18]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[19]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[20]  Yasuyuki Matsushita,et al.  Photometric Stereo in the Wild , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[21]  Warren W. Esty,et al.  The Box-Percentile Plot , 2003 .

[22]  David J. Kriegman,et al.  Photometric stereo with non-parametric and spatially-varying reflectance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.