Computer-Aided Design as Language

Computer-Aided Design (CAD) applications are used in manufacturing to model everything from coffee mugs to sports cars. These programs are complex and require years of training and experience to master. A component of all CAD models particularly difficult to make are the highly structured 2D sketches that lie at the heart of every 3D construction. In this work, we propose a machine learning model capable of automatically generating such sketches. Through this, we pave the way for developing intelligent tools that would help engineers create better designs with less effort. The core of our method is a combination of a generalpurpose language modeling technique alongside an off-the-shelf data serialization protocol. Additionally, we explore several extensions allowing us to gain finer control over the generation process. We show that our approach has enough flexibility to accommodate the complexity of the domain and performs well for both unconditional synthesis and image-to-sketch translation.

[1]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[2]  S. M. Ali Eslami,et al.  PolyGen: An Autoregressive Generative Model of 3D Meshes , 2020, ICML.

[3]  Nathan W. Hartman,et al.  Defining Expertise in the Use of Constraint-based CAD Tools by Examining Practicing Professionals , 2004 .

[4]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[5]  Koushik Sen,et al.  AutoPandas: neural-backed generators for program synthesis , 2019, Proc. ACM Program. Lang..

[6]  Karl Tombre,et al.  Celesstin: CAD conversion of mechanical drawings , 1992, Computer.

[7]  Ryan P. Adams,et al.  SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Design , 2020, ArXiv.

[8]  Marc'Aurelio Ranzato,et al.  Sequence Level Training with Recurrent Neural Networks , 2015, ICLR.

[9]  Yoshua Bengio,et al.  A Neural Probabilistic Language Model , 2003, J. Mach. Learn. Res..

[10]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[11]  Martín Ugarte,et al.  Foundations of JSON Schema , 2016, WWW.

[12]  Taku Kudo,et al.  SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing , 2018, EMNLP.

[13]  Robert C. Bolles,et al.  Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching , 1977, IJCAI.

[14]  Karl D. D. Willis,et al.  Engineering Sketch Generation for Computer-Aided Design , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Peter Wonka,et al.  SketchGen: Generating Constrained CAD Sketches , 2021, NeurIPS.

[16]  Raf Ramakers,et al.  CODA: A Design Assistant to Facilitate Specifying Constraints and Parametric Behavior in CAD Models , 2021 .

[17]  Oriol Vinyals,et al.  Synthesizing Programs for Images using Reinforced Adversarial Learning , 2018, ICML.

[18]  Douglas Eck,et al.  A Neural Representation of Sketch Drawings , 2017, ICLR.

[19]  P. Azariadis,et al.  A Constraint-based Framework to Recognize Design Intent during Sketching in Parametric Environments , 2020, Computer-Aided Design and Applications.

[20]  Noshir A. Langrana,et al.  Engineering Drawing Processing and Vectorization System , 1990, Comput. Vis. Graph. Image Process..

[21]  Alexandre Alahi,et al.  DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation , 2020, NeurIPS.

[22]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[23]  Marc Alexa,et al.  ABC: A Big CAD Model Dataset for Geometric Deep Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  D. Zorin,et al.  Deep Vectorization of Technical Drawings , 2020, ECCV.

[25]  Javier Jiménez,et al.  Some experiments in image vectorization , 1982 .

[26]  Navdeep Jaitly,et al.  Pointer Networks , 2015, NIPS.

[27]  Jeng-Chung Wu A Study of the Learning Models Employed by Industrial Design Students When Learning to Use 3D Computer-Aided Design (CAD) Software , 2009 .

[28]  Holly K. Ault,et al.  Using Geometric Constraints to Capture Design Intent , 1999 .

[29]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[30]  Alex Graves,et al.  Conditional Image Generation with PixelCNN Decoders , 2016, NIPS.

[31]  Ali Razavi,et al.  Generating Diverse High-Fidelity Images with VQ-VAE-2 , 2019, NeurIPS.

[32]  Ilya Sutskever,et al.  Jukebox: A Generative Model for Music , 2020, ArXiv.

[33]  Ilya Sutskever,et al.  Zero-Shot Text-to-Image Generation , 2021, ICML.

[34]  Niloy J. Mitra,et al.  Im2Vec: Synthesizing Vector Graphics without Vector Supervision , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Mark Chen,et al.  Language Models are Few-Shot Learners , 2020, NeurIPS.

[36]  Manuel Contero,et al.  On the Role of Geometric Constraints to Support Design Intent Communication and Model Reusability , 2019, Computer-Aided Design and Applications.

[37]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[38]  Tzu-Mao Li,et al.  Differentiable vector graphics rasterization for editing and learning , 2020, ACM Trans. Graph..

[39]  Wojciech Matusik,et al.  Fusion 360 Gallery: A Dataset and Environment for Programmatic CAD Reconstruction , 2020, ArXiv.

[40]  Basilio Ramos Barbero,et al.  Learning CAD at university through summaries of the rules of design intent , 2017 .

[41]  Rundi Wu,et al.  DeepCAD: A Deep Generative Network for Computer-Aided Design Models , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[42]  Andy R. Terrel,et al.  SymPy: Symbolic computing in Python , 2017, PeerJ Prepr..

[43]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[44]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[45]  Yejin Choi,et al.  The Curious Case of Neural Text Degeneration , 2019, ICLR.

[46]  Dov Dori,et al.  From engineering drawings to 3D models: are we ready now? , 1995, Comput. Aided Des..