3D Shape Synthesis for Conceptual Design and Optimization Using Variational Autoencoders

We propose a data-driven 3D shape design method that can learn a generative model from a corpus of existing designs, and use this model to produce a wide range of new designs. The approach learns an encoding of the samples in the training corpus using an unsupervised variational autoencoder-decoder architecture, without the need for an explicit parametric representation of the original designs. To facilitate the generation of smooth final surfaces, we develop a 3D shape representation based on a distance transformation of the original 3D data, rather than using the commonly utilized binary voxel representation. Once established, the generator maps the latent space representations to the high-dimensional distance transformation fields, which are then automatically surfaced to produce 3D representations amenable to physics simulations or other objective function evaluation modules. We demonstrate our approach for the computational design of gliders that are optimized to attain prescribed performance scores. Our results show that when combined with genetic optimization, the proposed approach can generate a rich set of candidate concept designs that achieve prescribed functional goals, even when the original dataset has only a few or no solutions that achieve these goals.

[1]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Wei Chen,et al.  BézierGAN: Automatic Generation of Smooth Curves from Interpretable Low-Dimensional Parameters , 2018, ArXiv.

[3]  Ikjin Lee,et al.  Design Automation by Integrating Generative Adversarial Networks and Topology Optimization , 2018, Volume 2A: 44th Design Automation Conference.

[4]  Matthias Nießner,et al.  Matterport3D: Learning from RGB-D Data in Indoor Environments , 2017, 2017 International Conference on 3D Vision (3DV).

[5]  Andreas Geiger,et al.  Learning 3D Shape Completion from Laser Scan Data with Weak Supervision , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Christopher McComb,et al.  Design Strategy Transfer in Cognitively-Inspired Agents , 2018, Volume 2A: 44th Design Automation Conference.

[7]  C. Lee Giles,et al.  Learning a Hierarchical Latent-Variable Model of 3D Shapes , 2017, 2018 International Conference on 3D Vision (3DV).

[8]  John S. Gero,et al.  Adaptive enlargement of state spaces in evolutionary designing , 2000, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[9]  Matthew L. Dering,et al.  A Convolutional Neural Network Model for Predicting a Product's Function, Given Its Form , 2017 .

[10]  Ivan V. Oseledets,et al.  Neural networks for topology optimization , 2017, Russian Journal of Numerical Analysis and Mathematical Modelling.

[11]  Mark Fuge,et al.  Machine Learning Algorithms for Recommending Design Methods , 2014 .

[12]  James T. Allison,et al.  Reducing Evaluation Cost for Circuit Synthesis Using Active Learning , 2018, Volume 2A: 44th Design Automation Conference.

[13]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[14]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[15]  Volker Roth,et al.  Learning Sparse Latent Representations with the Deep Copula Information Bottleneck , 2018, ICLR.

[16]  Honglak Lee,et al.  Estimating and Exploring the Product Form Design Space Using Deep Generative Models , 2016, DAC 2016.

[17]  G. Karniadakis,et al.  Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems , 2018, 1801.01236.

[18]  Takeo Igarashi,et al.  Pteromys: interactive design and optimization of free-formed free-flight model airplanes , 2014, ACM Trans. Graph..

[19]  Ian C. Parmee,et al.  GENETIC ALGORITHMS BASED SYSTEMS FOR CONCEPTUAL ENGINEERING DESIGN , 1999 .

[20]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[21]  Theodore Lim,et al.  Generative and Discriminative Voxel Modeling with Convolutional Neural Networks , 2016, ArXiv.

[22]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Haym Hirsh,et al.  A genetic algorithm for continuous design space search , 1997, Artif. Intell. Eng..

[24]  John Hauser,et al.  Predicting "Design Gaps" in the Market: Deep Consumer Choice Models under Probabilistic Design Constraints , 2018, 1812.11067.

[25]  Lei Xu,et al.  Sketch-pix2seq: a Model to Generate Sketches of Multiple Categories , 2017, ArXiv.

[26]  C. Qi Deep Learning on Point Sets for 3 D Classification and Segmentation , 2016 .

[27]  Leonidas J. Guibas,et al.  FPNN: Field Probing Neural Networks for 3D Data , 2016, NIPS.

[28]  Amos J. Storkey,et al.  Towards a Neural Statistician , 2016, ICLR.

[29]  Thomas Brox,et al.  Orientation-boosted Voxel Nets for 3D Object Recognition , 2016, BMVC.

[30]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Alden H. Wright,et al.  Genetic Algorithms for Real Parameter Optimization , 1990, FOGA.