Estimating the position of illuminants in paintings under weak model assumptions: an application to the works of two Baroque masters

The problems of estimating the position of an illuminant and the direction of illumination in realist paintings have been addressed using algorithms from computer vision. These algorithms fall into two general categories: In model-independent methods (cast-shadow analysis, occluding-contour analysis, ...), one does not need to know or assume the three-dimensional shapes of the objects in the scene. In model-dependent methods (shape-fromshading, full computer graphics synthesis, ...), one does need to know or assume the three-dimensional shapes. We explore the intermediate- or weak-model condition, where the three-dimensional object rendered is so simple one can very confidently assume its three-dimensional shape and, further, that this shape admits an analytic derivation of the appearance model. Specifically, we can assume that floors and walls are flat and that they are horizontal and vertical, respectively. We derived the maximum-likelihood estimator for the two-dimensional spatial location of a point source in an image as a function of the pattern of brightness (or grayscale value) over such a planar surface. We applied our methods to two paintings of the Baroque, paintings for which the question of the illuminant position is of interest to art historians: Georges de la Tour's Christ in the carpenter's studio (1645) and Caravaggio's The calling of St. Matthew (1599-1600). Our analyses show that a single point source (somewhat near to the depicted candle) is a slightly better explanation of the pattern of brightness on the floor in Christ than are two point sources, one in place of each of the figures. The luminance pattern on the rear wall in The calling implies the source is local, a few meters outside the picture frame-not the infinitely distant sun. Both results are consistent with previous rebuttals of the recent art historical claim that these paintings were executed by means of tracing optically projected images. Our method is the first application of such weak-model methods for inferring the location of illuminants in realist paintings and should find use in other questions in the history of art.

[1]  David G. Stork,et al.  Computer Vision, Image Analysis, and Master Art: Part 2 , 2006, IEEE MultiMedia.

[2]  Rama Chellappa,et al.  Estimation of illuminant direction, albedo, and shape from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Sharat Chandran,et al.  A Survey of Image-based Relighting Techniques , 2007, J. Virtual Real. Broadcast..

[4]  David G. Stork,et al.  Seeing the Light: Optics in nature, photography, color, vision, and holography , 1985 .

[5]  David G. Stork,et al.  Did Georges de la Tour use optical projections while painting Christ in the Carpenter’s Studio? , 2005, IS&T/SPIE Electronic Imaging.

[6]  David G. Stork,et al.  Estimating the location of illuminants in realist master paintings Computer image analysis addresses a debate in art history of the Baroque , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Michael G. Strintzis,et al.  Pose and illumination compensation for 3D face recognition , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[8]  David G. Stork,et al.  Color and Illumination in the Hockney Theory: A Critical Evaluation , 2003, Color and Imaging Conference.

[9]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[10]  David G. Stork,et al.  Inferring illumination direction estimated from disparate sources in paintings: an investigation into Jan Vermeer's Girl with a pearl earring , 2008, Electronic Imaging.

[11]  David G. Stork,et al.  Image analysis of paintings by computer graphics synthesis: an investigation of the illumination in Georges de la Tour's Christ in the carpenter's studio , 2008, Electronic Imaging.

[12]  David Hockney,et al.  Optical Insights into Renaissance Art , 2000 .

[13]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[14]  Edwin R. Hancock,et al.  Object Recognition Using Shape-from-Shading , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jacques Thuillier,et al.  Georges De La Tour , 1993 .

[16]  Bronwen Brown Secret Knowledge: Rediscovering the Lost Techniques of the Old Masters , 2002 .

[17]  M. Carter Computer graphics: Principles and practice , 1997 .

[18]  Akron Ohio Shading Models For Realistic Image Synthesis , 1989 .

[19]  David G. Stork Computer vision, image analysis, and master art: part 1 , 2006, IEEE MultiMedia.