A Convolutional Neural Network Model for Predicting a Product's Function, Given Its Form

Quantifying the ability of a digital design concept to perform a function currently requires the use of costly and intensive solutions such as Computational Fluid Dynamics. To mitigate these challenges, the authors of this work propose a deep learning approach based on 3-Dimensional Convolutions that predicts Functional Quantities of digital design concepts. This work defines the term Functional Quantity to mean a quantitative measure of an artifact’s ability to perform a function. Several research questions are derived from this work: i) Are learned 3D Convolutions able to accurately calculate these quantities, as measured by rank, magnitude and accuracy? ii) What do the latent features (that is, internal values in the model) discovered by this network mean? iii) Does this work perform better than other deep learning approaches at calculating Functional Quantities? In the case study, a proposed network design is tested for its ability to predict several functions (Sitting, Storing Liquid, Emitting Sound, Displaying Images, and Providing Conveyance) based on test form classes distinct from training class. This study evaluates several approaches to this problem based on a common architecture, with the best approach achieving F Scores of > 0.9 in 3 of the 5 functions identified. Testing trained models on novel input also yields accuracy as high as 98% for estimating rank of these functional quantities. This method is also employed to differentiate between decorative and functional head-wear, which yields an 84.4% accuracy and 0.786 precision.

[1]  Jonathan Cagan,et al.  Concurrent Optimization of Computationally Learned Stylistic Form and Functional Goals , 2012 .

[2]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Leonidas J. Guibas,et al.  Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Conrad S. Tucker,et al.  Open Source 3D Scanning and Printing for Design Capture and Realization , 2014 .

[5]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[6]  Mitzi M. Montoya,et al.  Brand‐Specific Design Effects: Form and Function , 2013 .

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Shih-Wen Hsiao,et al.  An image evaluation approach for parameter-based product form and color design , 2006, Comput. Aided Des..

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Lawrence D. Pohlmann,et al.  The Engineering Design of Systems – Models and Methods , 2000 .

[12]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[13]  Yu Zhang,et al.  Unsupervised 3D shape segmentation and co-segmentation via deep learning , 2016, Comput. Aided Geom. Des..

[14]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[15]  Wei Shyy,et al.  Computational Fluid Dynamics with Moving Boundaries , 1995 .

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[18]  Zhichao Zhou,et al.  DeepPano: Deep Panoramic Representation for 3-D Shape Recognition , 2015, IEEE Signal Processing Letters.

[19]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Federico Tombari,et al.  A combined texture-shape descriptor for enhanced 3D feature matching , 2011, 2011 18th IEEE International Conference on Image Processing.

[21]  Conrad S. Tucker,et al.  Automated Concept Generation Based on Function-Form Synthesis , 2015, DAC 2015.

[22]  Ram D. Sriram,et al.  Function-to-form mapping: model, representation and applications in design synthesis , 2001, Comput. Aided Des..

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Jie Hu,et al.  Automatically Synthesizing Principle Solutions in Multi-Disciplinary Conceptual Design With Functional and Structural Knowledge , 2015, DAC 2015.

[25]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[26]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Jonathan Cagan,et al.  Quantifying Aesthetic Form Preference in a Utility Function , 2008 .

[28]  L. Shu Biologically Meaningful Keywords for Functional Terms of the Functional Basis , 2011 .

[29]  Jonathan Cagan,et al.  Understanding Consumer Tradeoffs Between Form and Function Through Metaconjoint and Cognitive Neuroscience Analyses , 2013 .

[30]  Mehul Bhatt,et al.  Ontological modelling of form and function for architectural design , 2012, Appl. Ontology.

[31]  John S. Gero,et al.  The Situated Function - Behaviour - Structure Framework , 2002, AID.

[32]  Kai Liu,et al.  Iterative 3D shape classification by online metric learning , 2015, Comput. Aided Geom. Des..

[33]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Yinda Zhang,et al.  DeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understanding , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[35]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[36]  Alain Bernard,et al.  The evolution, challenges, and future of knowledge representation in product design systems , 2013, Comput. Aided Des..

[37]  Leonidas J. Guibas,et al.  ShapeNet: An Information-Rich 3D Model Repository , 2015, ArXiv.

[38]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[39]  Jonathan Masci,et al.  Learning shape correspondence with anisotropic convolutional neural networks , 2016, NIPS.

[40]  Yong Chen,et al.  A knowledge-based framework for creative conceptual design of multi-disciplinary systems , 2012, Comput. Aided Des..

[41]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[42]  Jonathan Cagan,et al.  Form Function Fidelity , 2011 .

[43]  Jonathan Cagan,et al.  Modeling Aggregate Choice for Form and Function Through Metaconjoint Analysis , 2014 .

[44]  Gernot Riegler,et al.  OctNet: Learning Deep 3D Representations at High Resolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Greg Turk,et al.  Simplification and Repair of Polygonal Models Using Volumetric Techniques , 2003, IEEE Trans. Vis. Comput. Graph..

[46]  Luc Van Gool,et al.  DEX: Deep EXpectation of Apparent Age from a Single Image , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[47]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[48]  Conrad S. Tucker,et al.  Digital Representation of Physical Artifacts: The Effect of Low Cost, High Accuracy 3D Scanning Technologies on Engineering Education, Student Learning and Design Evaluation , 2013 .