Time and order estimation of paintings based on visual features and expert priors

Time and order are considered crucial information in the art domain, and subject of many research efforts by historians. In this paper, we present a framework for estimating the ordering and date information of paintings and drawings. We formulate this problem as the embedding into a one dimension manifold, which aims to place paintings far or close to each other according to a measure of similarity. Our formulation can be seen as a manifold learning algorithm, albeit properly adapted to deal with existing questions in the art community. To solve this problem, we propose an approach based in Laplacian Eigenmaps and a convex optimization formulation. Both methods are able to incorporate art expertise as priors to the estimation, in the form of constraints. Types of information include exact or approximate dating and partial orderings. We explore the use of soft penalty terms to allow for constraint violation to account for the fact that prior knowledge may contain small errors. Our problem is tested within the scope of the PrintART project, which aims to assist art historians in tracing Portuguese Tile art "Azulejos" back to the engravings that inspired them. Furthermore, we describe other possible applications where time information (and hence, this method) could be of use in art history, fake detection or curatorial treatment.

[1]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[2]  Richard Taylor,et al.  Authenticating Pollock paintings using fractal geometry , 2007, Pattern Recognit. Lett..

[3]  David G. Stork,et al.  Computer Vision and Image Analysis of Art , 2010 .

[4]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Daniel J. Graham,et al.  Stylometrics of artwork: uses and limitations , 2010, Electronic Imaging.

[6]  Gustavo Carneiro,et al.  Explaining scene composition using kinematic chains of humans: application to Portuguese tiles history , 2011, Electronic Imaging.

[7]  J. Kruskal.  Nonmetric multidimensional scaling: A numerical method , 1964 .

[8]  James Ze Wang,et al.  Content-based image indexing and searching using Daubechies' wavelets , 1998, International Journal on Digital Libraries.

[9]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[10]  Michael C. Hout,et al.  Multidimensional Scaling , 2003, Encyclopedic Dictionary of Archaeology.

[11]  Roy S. Berns,et al.  Rejuvenating the Appearance of Seurat ' s A Sunday on La Grande Jatte – 1884 Using Color and Imaging Science Techniques – a Simulation , 2004 .

[12]  Stephen P. Boyd,et al.  Recent Advances in Learning and Control , 2008, Lecture Notes in Control and Information Sciences.

[13]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  Gustavo Carneiro,et al.  The automatic annotation and retrieval of digital images of prints and tile panels using network link analysis algorithms , 2011, Electronic Imaging.

[15]  Frank Dellaert,et al.  Probabilistic temporal inference on reconstructed 3D scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Eric P. Xing,et al.  Modeling and Analysis of Dynamic Behaviors of Web Image Collections , 2010, ECCV.

[17]  David G. Stork,et al.  Computer Vision and Computer Graphics Analysis of Paintings and Drawings: An Introduction to the Literature , 2009, CAIP.