Extended Abstract Track

We introduce a novel approach to disentangle style from content in the 3D domain and perform unsupervised neural style transfer. Our approach is able to extract style information from 3D input in a self supervised fashion, conditioning the definition of style on inductive biases enforced explicitly, in the form of specific augmentations applied to the input.This allows, at test time, to select specifically the features to be transferred between two arbitrary 3D shapes, being still able to capture complex changes (e.g. combinations of arbitrary geometrical and topological transformations) with the data prior. Coupled with the choice of representing 3D shapes as neural implicit fields, we are able to perform style transfer in a controllable way, handling a variety of transformations. We validate our approach qualitatively and quantitatively on a dataset with font style labels.

[1]  Thomas Funkhouser,et al.  Multiresolution Deep Implicit Functions for 3D Shape Representation , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[2]  A. Andrade-Campos,et al.  Bridging Between Topology Optimization and Additive Manufacturing via Laplacian Smoothing , 2021 .

[3]  Pradeep Kumar Jayaraman,et al.  UVStyle-Net: Unsupervised Few-shot Learning of 3D Style Similarity Measure for B-Reps , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[4]  Hsueh-Ti Derek Liu,et al.  Normal‐Driven Spherical Shape Analogies , 2021, Comput. Graph. Forum.

[5]  Hao Zhang,et al.  DECOR-GAN: 3D Shape Detailization by Conditional Refinement , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  R. Siegwart,et al.  3DSNet: Unsupervised Shape-to-Shape 3D Style Transfer , 2020, ArXiv.

[7]  Maks Ovsjanikov,et al.  Instant recovery of shape from spectrum via latent space connections , 2020, 2020 International Conference on 3D Vision (3DV).

[8]  Gerard Pons-Moll,et al.  Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Katashi Nagao,et al.  PSNet: A Style Transfer Network for Point Cloud Stylization on Geometry and Color , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[10]  Y. Lipman,et al.  Implicit Geometric Regularization for Learning Shapes , 2020, ICML.

[11]  Alec Jacobson,et al.  Cubic stylization , 2019, ACM Trans. Graph..

[12]  Youssef Mroueh,et al.  Wasserstein Style Transfer , 2019, AISTATS.

[13]  Nicholas I. Kolkin,et al.  Style Transfer by Relaxed Optimal Transport and Self-Similarity , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Richard A. Newcombe,et al.  DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Marc Alexa,et al.  ABC: A Big CAD Model Dataset for Geometric Deep Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Sebastian Nowozin,et al.  Occupancy Networks: Learning 3D Reconstruction in Function Space , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Hao Zhang,et al.  Learning Implicit Fields for Generative Shape Modeling , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Zunlei Feng,et al.  Neural Style Transfer: A Review , 2017, IEEE Transactions on Visualization and Computer Graphics.

[19]  Szymon Rusinkiewicz,et al.  Learning Detail Transfer based on Geometric Features , 2017, Comput. Graph. Forum.

[20]  Serge J. Belongie,et al.  Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  Jiaying Liu,et al.  Demystifying Neural Style Transfer , 2017, IJCAI.

[22]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Alla Sheffer,et al.  Functionality preserving shape style transfer , 2016, ACM Trans. Graph..

[24]  Yongsheng Ma,et al.  A survey of manufacturing oriented topology optimization methods , 2016, Adv. Eng. Softw..

[25]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Leonidas J. Guibas,et al.  ShapeNet: An Information-Rich 3D Model Repository , 2015, ArXiv.

[27]  Alla Sheffer,et al.  Analogy‐driven 3D style transfer , 2014, Comput. Graph. Forum.

[28]  Yu Wang,et al.  Intrinsic and extrinsic operators for shape analysis , 2019, Handbook of Numerical Analysis.

[29]  Olga Sorkine-Hornung,et al.  Laplacian Mesh Processing , 2005, Eurographics.