Identifying centres of interest in paintings using alignment and edge detection: Case studies on works by Luc Tuymans

What is the creative process through which an artist goes from an original image to a painting? Can we examine this process using techniques from computer vision and pattern recognition? Here we set the first preliminary steps to algorithmically deconstruct some of the transformations that an artist applies to an original image in order to establish centres of interest, which are focal areas of a painting that carry meaning. We introduce a comparative methodology that first cuts out the minimal segment from the original image on which the painting is based, then aligns the painting with this source, investigates micro-differences to identify centres of interest and attempts to understand their role. In this paper we focus exclusively on micro-differences with respect to edges. We believe that research into where and how artists create centres of interest in paintings is valuable for curators, art historians, viewers, and art educators, and might even help artists to understand and refine their own artistic method.

[1]  Hsueh-Ming Hang,et al.  Traditional Method Inspired Deep Neural Network For Edge Detection , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[2]  Martin Styner,et al.  Parametric estimate of intensity inhomogeneities applied to MRI , 2000, IEEE Transactions on Medical Imaging.

[3]  Tobias Isenberg,et al.  Neural style transfer: a paradigm shift for image-based artistic rendering? , 2017, NPAR '17.

[4]  Diane J. Cook,et al.  A Survey of Unsupervised Deep Domain Adaptation , 2018, ACM Trans. Intell. Syst. Technol..

[5]  B. Fredrickson,et al.  Objectification Theory: Toward Understanding Women's Lived Experiences and Mental Health Risks , 1997 .

[6]  Erwin Panofsky,et al.  Studies in Iconology , 1962 .

[7]  Antoine Isaac,et al.  Amsterdam Museum Linked Open Data , 2013, Semantic Web.

[8]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[9]  Mahesh Ananth Social Brain Matters: Stances on the Neurobiology of Social Cognition , 2009 .

[10]  Horst Bischof,et al.  Efficient Maximally Stable Extremal Region (MSER) Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Lawrence A. Ray,et al.  2-D and 3-D Image Registration for Medical, Remote Sensing, and Industrial Applications , 2005, J. Electronic Imaging.

[12]  Tomislav Lipic,et al.  Fine-tuning Convolutional Neural Networks for fine art classification , 2018, Expert Syst. Appl..

[13]  Bruno Cornelis Image Processing for Art Investigation , 2015 .

[14]  J. Eccles The emotional brain. , 1980, Bulletin et memoires de l'Academie royale de medecine de Belgique.

[15]  Luc Steels,et al.  Perceiving the Focal Point of a Painting with AI: Case Studies on Works of Luc Tuymans , 2020, ICAART.