From 2D to 2.5D i.e. from painting to tactile model

Display Omitted Commonly used to produce the visual effect of full 3D scene on reduced depth supports, bas relief can be successfully employed to help blind people to access inherently bi-dimensional works of art. Despite a number of methods have been proposed dealing with the issue of recovering 3D or 2.5D surfaces from single images, only a few of them explicitly address the recovery problem from paintings and, more specifically, the needs of visually impaired and blind people.The main aim of the present paper is to provide a systematic method for the semi-automatic generation of 2.5D models from paintings. Consequently, a number of ad hoc procedures are used to solve most of the typical problems arising when dealing with artistic representation of a scene. Feedbacks provided by a panel of end-users demonstrated the effectiveness of the method in providing models reproducing, using a tactile language, works of art otherwise completely inaccessible.

[1]  Jian Chang,et al.  A review of digital relief generation techniques , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[2]  Ralph R. Martin,et al.  Making bas-reliefs from photographs of human faces , 2013, Comput. Aided Des..

[3]  Monica Carfagni,et al.  Digital Bas-Relief Design: a Novel Shape from Shading-Based Method , 2014 .

[4]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[5]  Kenji Yamazawa,et al.  Reproduction of Tactile Paintings for Visual Impairments Utilized Three-Dimensional Modeling System and the Effect of Difference in the Painting Size on Tactile Perception , 2010, ICCHP.

[6]  Lapo Governi,et al.  Computer-based methodologies for semi-automatic 3D model generation from paintings , 2014, Int. J. Comput. Aided Eng. Technol..

[7]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[8]  William A. Barrett,et al.  Interactive live-wire boundary extraction , 1997, Medical Image Anal..

[9]  Lapo Governi,et al.  Improving surface reconstruction in shape from shading using easy-to-set boundary conditions , 2013, Int. J. Comput. Vis. Robotics.

[10]  Rui Huang,et al.  Structure-Preserving Regularisation Constraints for Shape-from-Shading , 2009, CAIP.

[11]  P. Daniel,et al.  From Deterministic to Stochastic Methods for Shape From Shading , 2000 .

[12]  Hamid Hassanpour,et al.  Edge Detection Techniques: Evaluations and Comparison , 2008 .

[13]  R. Klatzky,et al.  There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision. , 1987 .

[14]  E. Spelke,et al.  Haptic perception of objects in infancy , 1988, Cognitive Psychology.

[15]  John C. Beatty,et al.  An experimental comparison of RGB, YIQ, LAB, HSV, and opponent color models , 1987, TOGS.

[16]  Harry Shum,et al.  Interactive normal reconstruction from a single image , 2008, SIGGRAPH Asia '08.

[17]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[18]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Edwin R. Hancock,et al.  Needle map recovery using robust regularizers , 1999, Image Vis. Comput..

[20]  Jim R. Parker,et al.  Algorithms for image processing and computer vision , 1996 .

[21]  Ralph R. Martin,et al.  Use of non-photorealistic rendering and photometric stereo in making bas-reliefs from photographs , 2014, Graph. Model..

[22]  Alistair A. Young,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2017, MICCAI 2017.

[23]  Christian Bräuer-Burchardt,et al.  Robust vanishing point determination in noisy images , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[24]  Michael Breuß,et al.  Making Shape from Shading Work for Real-World Images , 2009, DAGM-Symposium.

[25]  Adam Finkelstein,et al.  Digital bas-relief from 3D scenes , 2007, ACM Trans. Graph..

[26]  Jean-Denis Durou,et al.  Numerical methods for shape-from-shading: A new survey with benchmarks , 2008, Comput. Vis. Image Underst..

[27]  Song Wang,et al.  Restoration of Brick and Stone Relief from Single Rubbing Images , 2012, IEEE Transactions on Visualization and Computer Graphics.

[28]  Hans-Peter Seidel,et al.  Automatic Generation of Bas-reliefs from 3D Shapes , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[29]  Werner Purgathofer,et al.  High-quality tactile paintings , 2011, JOCCH.

[30]  Yasuyuki Matsushita,et al.  High-quality shape from multi-view stereo and shading under general illumination , 2011, CVPR 2011.

[31]  Ehsan Nadernejad.  Edge Detection Techniques : Evaluations and Comparisons , 2008 .

[32]  Paolo Di Stefano,et al.  Bilateral symmetry estimation of human face , 2013 .

[33]  Lapo Governi,et al.  Tactile 3D bas-relief from single-point perspective paintings: a computer based method , 2014 .

[34]  Monica Carfagni,et al.  Tactile Representation of Paintings: An Early Assessment of Possible Computer Based Strategies , 2012, EuroMed.

[35]  Alexei Sourin,et al.  Functionally based virtual computer art , 2001, I3D '01.

[36]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[37]  Leanne Thompson,et al.  Beyond visual conventions: Rethinking the design of tactile diagrams , 2006 .

[38]  Werner Purgathofer,et al.  Computer-Aided Design of Tactile Models - Taxonomy and Case Studies , 2012, ICCHP.

[39]  Xing Wang Zhang,et al.  A New Embossing Method for Gray Images Using Kalman Filter , 2010 .