Cultural Heritage Acquisition: Geometry-Based Radiometry in the Wild

Measuring radiometric surface properties "in the wild" is challenging, because the appearance of a surface strongly depends on ambient illumination, especially when direct sunlight or cast shadows need to be handled, and when the scene must not be altered by shrouding devices or by reference targets. We present a purely photogram metric measurement method that integrates 3D surface geometry, camera poses, known artificial illumination, and calibration of the measurement device. For geometry measurement, we extend Structure-from-Motion with constrained bundle adjustment post processing to obtain geo-referenced Euclidean reconstructions. For radiometry measurement, we perform frame differencing of images with and without intense artificial illumination to eliminate the influence of ambient illumination, and we calculate radiometric surface properties based on known illumination configuration and radiometric calibration. Calculating the relations between surface normal, camera pose, and incident light leads to the final result of dense 3D point clouds that represent radiometric surface properties. In our experimental validation, we apply this method to the field of cultural heritage acquisition of prehistoric rock art and achieve excellent results compared to ground truth. Further, the measurement method itself is quite general and will be applicable to many research areas where both, precise surface geometry and radiometry is required.

[1]  Shree K. Nayar,et al.  Stereo with mirrors , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Stephen Wolf,et al.  Color correction matrix for digital still and video imaging systems , 2003 .

[3]  Garrett M. Johnson,et al.  Color Imaging: Fundamentals and Applications , 2008 .

[4]  M. Rothermel,et al.  SURE : PHOTOGRAMMETRIC SURFACE RECONSTRUCTION FROM IMAGER Y , 2013 .

[5]  Todd E. Zickler,et al.  Passive Reflectometry , 2008, ECCV.

[6]  Luc Van Gool,et al.  Tackling Shapes and BRDFs Head-On , 2014, 2014 2nd International Conference on 3D Vision.

[7]  Ravi Ramamoorthi,et al.  A theory of differential photometric stereo for unknown isotropic BRDFs , 2011, CVPR 2011.

[8]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[9]  Horst Bischof,et al.  Online Feedback for Structure-from-Motion Image Acquisition , 2012, BMVC.

[10]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[11]  A. Pinz,et al.  A novel high accuracy 3D scanning device for rock-art sites , 2014 .

[12]  Paul E. Debevec,et al.  Digitizing the Parthenon: Estimating Surface Reflectance Properties of a Complex Scene under Captured Natural Illumination , 2004, VMV.

[13]  Shree K. Nayar,et al.  Making one object look like another: controlling appearance using a projector-camera system , 2004, CVPR 2004.

[14]  Yizhou Wang,et al.  What Object Motion Reveals about Shape with Unknown BRDF and Lighting , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Manmohan Krishna Chandraker,et al.  What Camera Motion Reveals about Shape with Unknown BRDF , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[17]  R. Fletcher Practical Methods of Optimization , 1988 .

[18]  Andrea Fusiello,et al.  Improving the efficiency of hierarchical structure-and-motion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[20]  Ravi Ramamoorthi,et al.  A Theory of Photometric Reconstruction for Unknown Isotropic Reflectances , 2010 .