Paparazzi

Fig. 1. Paparazzi enables plug-and-play image processing algorithms on 3D shapes. For instance, superpixel produces a Mosaic style shape; L0 norm makes the shape piecewise planar but preserves features such as the noses; style transfer synthesizes the artistic style from a painting to the geometry. Note that the images are just for showing the 2D effects, they are not in the Paparazzi optimization loop.

[1]  David P. Luebke,et al.  Perceptually-Driven Simplification for Interactive Rendering , 2001, Rendering Techniques.

[2]  Alfred M. Bruckstein,et al.  Real-Time Depth Refinement for Specular Objects , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Olga Sorkine-Hornung,et al.  Appearance-mimicking surfaces , 2014, ACM Trans. Graph..

[4]  Xavier Granier,et al.  Intuitive Shape Modeling by Shading Design , 2005, Smart Graphics.

[5]  Greg Turk,et al.  Generating textures on arbitrary surfaces using reaction-diffusion , 1991, SIGGRAPH.

[6]  H. Gouraud.  Continuous Shading of Curved Surfaces , 1971, IEEE Transactions on Computers.

[7]  Dervis Karaboga,et al.  Color Image Quantization: A Short Review and an Application with Artificial Bee Colony Algorithm , 2014, Informatica.

[8]  Alec Jacobson,et al.  Fast winding numbers for soups and clouds , 2018, ACM Trans. Graph..

[9]  Hans-Peter Seidel,et al.  Shading-based dynamic shape refinement from multi-view video under general illumination , 2011, 2011 International Conference on Computer Vision.

[10]  Pat Hanrahan,et al.  A signal-processing framework for inverse rendering , 2001, SIGGRAPH.

[11]  Robert Bridson,et al.  Robust Topological Operations for Dynamic Explicit Surfaces , 2009, SIAM J. Sci. Comput..

[12]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Timothy Dozat,et al.  Incorporating Nesterov Momentum into Adam , 2016 .

[14]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[15]  Michael J. Black,et al.  OpenDR: An Approximate Differentiable Renderer , 2014, ECCV.

[16]  Ryan Schmidt,et al.  meshmixer: an interface for rapid mesh composition , 2010, SIGGRAPH '10.

[17]  Steve Marschner,et al.  Inverse Lighting for Photography , 1997, CIC.

[18]  Scott Schaefer,et al.  Scales and Scale‐like Structures , 2010, Comput. Graph. Forum.

[19]  Edilson de Aguiar,et al.  Multi-view Performance Capture of Surface Details , 2017, International Journal of Computer Vision.

[20]  Jihad El-Sana,et al.  Skip Strips: maintaining triangle strips for view-dependent rendering , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[21]  Karol Myszkowski,et al.  Perception‐driven Accelerated Rendering , 2017, Comput. Graph. Forum.

[22]  Hugues Hoppe,et al.  View-dependent refinement of progressive meshes , 1997, SIGGRAPH.

[23]  Jian Sun,et al.  Fast Guided Filter , 2015, ArXiv.

[24]  Nikos Paragios,et al.  Handbook of Mathematical Models in Computer Vision , 2005 .

[25]  Amitabh Varshney,et al.  Dynamic view-dependent simplification for polygonal models , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[26]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[27]  Marco Attene,et al.  A lightweight approach to repairing digitized polygon meshes , 2010, The Visual Computer.

[28]  Emmanuel Prados,et al.  Gradient Flows for Optimizing Triangular Mesh-based Surfaces: Applications to 3D Reconstruction Problems Dealing with Visibility , 2011, International Journal of Computer Vision.

[29]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[30]  David P. Luebke,et al.  View-dependent simplification of arbitrary polygonal environments , 1997, SIGGRAPH.

[31]  Marco Attene,et al.  As-exact-as-possible repair of unprintable STL files , 2016, Rapid Prototyping Journal.

[32]  Ralph R. Martin,et al.  Geometric texture synthesis and transfer via geometry images , 2005, SPM '05.

[33]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[34]  Cornelius W. A. M. van Overveld,et al.  Painting Gradients: Free-form Surface Design Using Shading Patterns , 1996, Graphics Interface.

[35]  Shuang Zhao,et al.  Inverse volume rendering with material dictionaries , 2013, ACM Trans. Graph..

[36]  Jun Wu,et al.  By-example synthesis of structurally sound patterns , 2015, ACM Trans. Graph..

[37]  Daniele Panozzo,et al.  LIBIGL: A C++ library for geometry processing without a mesh data structure , 2014 .

[38]  Shuang Zhao,et al.  Modeling and Rendering Fabrics at Micron-Resolution , 2014 .

[39]  Yotam I. Gingold,et al.  Shape optimization using reflection lines , 2007, Symposium on Geometry Processing.

[40]  Bailin Deng,et al.  Guided Mesh Normal Filtering , 2015, Comput. Graph. Forum.

[41]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[42]  Tamy Boubekeur,et al.  GeoBrush: Interactive Mesh Geometry Cloning , 2011, Comput. Graph. Forum.

[43]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[44]  In-So Kweon,et al.  Refining Geometry from Depth Sensors using IR Shading Images , 2016, International Journal of Computer Vision.

[45]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[46]  Tatsuya Harada,et al.  Neural 3D Mesh Renderer , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[48]  Keenan Crane,et al.  Stripe patterns on surfaces , 2015, ACM Trans. Graph..

[49]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  William T. Freeman,et al.  Unsupervised Training for 3D Morphable Model Regression , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[51]  Greg Turk,et al.  Image-driven simplification , 2000, TOGS.

[52]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[53]  Jitendra Malik,et al.  Shape, Illumination, and Reflectance from Shading , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Jorge Nocedal,et al.  Optimization Methods for Large-Scale Machine Learning , 2016, SIAM Rev..

[55]  Ersin Yumer,et al.  Material Editing Using a Physically Based Rendering Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[56]  Yotam I. Gingold,et al.  Shading-based surface editing , 2008, ACM Trans. Graph..

[57]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[59]  Pau Gargallo,et al.  Minimizing the Reprojection Error in Surface Reconstruction from Images , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[60]  Jonathan D. Cohen,et al.  Perceptually guided simplification of lit, textured meshes , 2003, I3D '03.

[61]  Lei He,et al.  Mesh denoising via L0 minimization , 2013, ACM Trans. Graph..

[62]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[64]  Leif Kobbelt,et al.  A survey of point-based techniques in computer graphics , 2004, Comput. Graph..

[65]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[66]  James T Todd,et al.  Perceptual biases in the interpretation of 3D shape from shading , 2004, Vision Research.

[67]  Shahram Izadi,et al.  Real-time shading-based refinement for consumer depth cameras , 2014, ACM Trans. Graph..

[68]  Daniele Panozzo,et al.  libigl: prototyping geometry processing research in C++ , 2017, SIGGRAPH ASIA.