Computer-based methodologies for semi-automatic 3D model generation from paintings

Over the last few years, technologies like 3D scanning and rapid prototyping provided an extraordinary boost in improving reproductions of 3D artworks, like sculptures and historical buildings, all over the world. Physical 3D reproduction of subjects represented in paintings, is recognised to be one of the best ways to allow visually impaired people to enjoy such kind of artworks. However, the use of advanced technologies with the aim of realising 3D models starting from paintings has not been satisfactorily investigated yet. Though a number of algorithms coming from computer vision science exist to cope with similar issues, the specific problem of producing a 3D representation which is targeted at blind people tactile exploration has been only marginally investigated. Starting from these considerations, this work presents 1) a quite extensive review of the criteria proposed in literature for producing tactile models suitable for blind people and 2) four alternative computer-based methods for semi-automatic generation of tactile 3D models starting from RGB digital images of paintings. The outcomes of this study contribute new information to the field of visually impaired user-oriented 3D reconstruction and clearly indicate the strategy to be adopted in order to produce a meaningful reproduction of a bi-dimensional piece of artwork.

[1]  Monica Carfagni,et al.  Model-based extraction of femoral medulla ducts from radiographic images , 2004, Image Vis. Comput..

[2]  Yvette Hatwell,et al.  Chapter 15. The tactile reading of maps and drawings, and the access of blind people to works of art , 2003 .

[3]  William A. Barrett,et al.  Interactive live-wire boundary extraction , 1997, Medical Image Anal..

[4]  Elisabeth Salzhauer Axel,et al.  Art Beyond Sight: A Resource Guide to Art, Creativity, and Visual Impairment , 2002 .

[5]  Hamid Hassanpour,et al.  Edge Detection Techniques: Evaluations and Comparison , 2008 .

[6]  Igor Juricevic,et al.  Haptics and Projection: Drawings by Tracy, a Blind Adult , 2003, Perception.

[7]  Y.Volpe Yvolpe,et al.  From unordered point cloud to weighted B-Spline - a novel PCA-based method - , 2011 .

[8]  Djemel Ziou,et al.  Edge Detection Techniques-An Overview , 1998 .

[9]  Yoshinori Teshima.  Three-Dimensional Tactile Models for Blind People and Recognition of 3D Objects by Touch: Introduction to the Special Thematic Session , 2010, ICCHP.

[10]  Baoxin Li,et al.  A Bayesian Approach to Automated Creation of Tactile Facial Images , 2010, IEEE Transactions on Multimedia.

[11]  Serge Beucher,et al.  Use of watersheds in contour detection , 1979 .

[12]  Monica Carfagni,et al.  Tactile Representation of Paintings: An Early Assessment of Possible Computer Based Strategies , 2012, EuroMed.

[13]  R. Furferi,et al.  Multiple Incident Splines ( MISs ) algorithm for topological reconstruction of 2 D unordered point clouds , 2011 .

[14]  Richard E. Ladner,et al.  Automated tactile graphics translation: in the field , 2007, Assets '07.

[15]  Kenneth E. Barner,et al.  Tactile imaging using watershed-based image segmentation , 2000, Assets '00.

[16]  John M Kennedy,et al.  Drawings from Gaia, a Blind Girl , 2003, Perception.