Tactile exploration of paintings: An interactive procedure for the reconstruction of 2.5D models

Cultural heritage is often not accessible to visually impaired and blind people, hardly ever when dealing with two-dimensional artworks like, for instance, paintings. In fact, despite tactile reproductions of 3D works of art such as sculptures or architectural models are quite common, a real barrier between blind people and pictorial artworks still exists, obviously due to their intrinsic 2D format. The translation of paintings into bas-relieves is recognized to be one of the most effective ways for breaking down such a barrier, thus allowing a sensible improvement in blind people's accessibility to this kind of works of art. Moving from these considerations, in this work the authors want to provide a bird's eye view on a new methodology for the semi-automatic generation of tactile 3D models starting from paintings, in particular those characterized by single-point perspective. The proposed method relies on an interactive Computer-based modelling procedure, which is conceived to be simple and effective to use. The procedure, which has been implemented into a prototypal software package, has been effectively used to “translate” a set of paintings from the Italian Renaissance.

[1]  Stephen J. Maybank,et al.  A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images , 1999, BMVC.

[2]  Leanne Thompson,et al.  Beyond visual conventions: Rethinking the design of tactile diagrams , 2006 .

[3]  Ronen Basri,et al.  Example Based 3D Reconstruction from Single 2D Images , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[4]  Lapo Governi,et al.  3D Model Retrieval from mechanical drawings analysis , 2011 .

[5]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[6]  Azriel Rosenfeld,et al.  Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System , 1985, Artif. Intell..

[7]  Lapo Governi,et al.  3D geometry reconstruction from orthographic views: A method based on 3D image processing and data fitting , 2013, Comput. Ind..

[8]  William A. Barrett,et al.  Interactive live-wire boundary extraction , 1997, Medical Image Anal..

[9]  Lapo Governi,et al.  Improving surface reconstruction in shape from shading using easy-to-set boundary conditions , 2013, Int. J. Comput. Vis. Robotics.

[10]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[11]  O. Faugeras,et al.  A VISCOSITY SOLUTION METHOD FOR SHAPE-FROM-SHADING WITHOUT IMAGE BOUNDARY DATA , 2006 .

[12]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Lapo Governi,et al.  Tactile 3D bas-relief from single-point perspective paintings: a computer based method , 2014 .

[14]  Monica Carfagni,et al.  Tactile Representation of Paintings: An Early Assessment of Possible Computer Based Strategies , 2012, EuroMed.

[15]  Riesenfeld,et al.  Homogeneous Coordinates and Projective Planes in Computer Graphics , 1981, IEEE Computer Graphics and Applications.

[16]  Kenji Yamazawa,et al.  Reproduction of Tactile Paintings for Visual Impairments Utilized Three-Dimensional Modeling System and the Effect of Difference in the Painting Size on Tactile Perception , 2010, ICCHP.

[17]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[18]  Werner Purgathofer,et al.  High-quality tactile paintings , 2011, JOCCH.

[19]  Xing Wang Zhang,et al.  A New Embossing Method for Gray Images Using Kalman Filter , 2010 .

[20]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[21]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[22]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[23]  Honglak Lee,et al.  Automatic Single-Image 3d Reconstructions of Indoor Manhattan World Scenes , 2007, ISRR.

[24]  Monica Carfagni,et al.  Digital Bas-Relief Design: a Novel Shape from Shading-Based Method , 2014 .

[25]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, SIGGRAPH 2005.