ShapePalettes: interactive normal transfer via sketching

We present a simple interactive approach to specify 3D shape in a single view using "shape palettes". The interaction is as follows: draw a simple 2D primitive in the 2D view and then specify its 3D orientation by drawing a corresponding primitive on a shape palette. The shape palette is presented as an image of some familiar shape whose local 3D orientation is readily understood and can be easily marked over. The 3D orientation from the shape palette is transferred to the 2D primitive based on the markup. As we will demonstrate, only sparse markup is needed to generate expressive and detailed 3D surfaces. This markup approach can be used to model freehand 3D surfaces drawn in a single view, or combined with image-snapping tools to quickly extract surfaces from images and photographs.

[1]  Marc Alexa,et al.  A sketch-based interface for detail-preserving mesh editing , 2005, SIGGRAPH 2005.

[2]  Michael S. Brown,et al.  ShapePalettes: interactive normal transfer via sketching , 2007, SIGGRAPH 2007.

[3]  Steven M. Seitz,et al.  Example-based photometric stereo: shape reconstruction with general, varying BRDFs , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Yasuyuki Matsushita,et al.  Single-View Relighting with Normal Map Painting , 2006 .

[5]  Gil Shklarski,et al.  Interactive topology-aware surface reconstruction , 2007, ACM Trans. Graph..

[6]  John F. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, SIGGRAPH '06.

[7]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Scott F. Johnston.  Lumo: illumination for cel animation , 2002, NPAR '02.

[9]  Steven M. Seitz,et al.  Shape and spatially-varying BRDFs from photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[11]  John F. Hughes,et al.  SKETCH: An Interface for Sketching 3D Scenes , 1996, SIGGRAPH.

[12]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[13]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[14]  Adam Finkelstein,et al.  Suggestive contours for conveying shape , 2003, ACM Trans. Graph..

[15]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, ACM Trans. Graph..

[16]  Cornelius W. A. M. van Overveld,et al.  Painting Gradients: Free-form Surface Design Using Shading Patterns , 1996, Graphics Interface.

[17]  Jan J. Koenderink,et al.  Pictorial relief , 2019, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[18]  Li Zhang,et al.  Single view modeling of free-form scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[19]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[20]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Tien-Tsin Wong,et al.  Dense Photometric Stereo: A Markov Random Field Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Peter Kovesi,et al.  Shapelets correlated with surface normals produce surfaces , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Marc Alexa,et al.  A sketch-based interface for detail-preserving mesh editing , 2007, SIGGRAPH Courses.

[24]  Hans-Peter Seidel,et al.  Ridge-valley lines on meshes via implicit surface fitting , 2004, ACM Trans. Graph..

[25]  Peter-Pike J. Sloan,et al.  The Lit Sphere: A Model for Capturing NPR Shading from Art , 2001, Graphics Interface.

[26]  Vishvjit S. Nalwa,et al.  A guided tour of computer vision , 1993 .