Image Classification of Clogs in Direct Ink Write Additive Manufacturing

For our direct ink write (DIW) setup, hours of video are collected of fibrous ink that is printed from a translucent nozzle while parts are made. Due to sporadic misalignment of the fibers, clogs may arise that disrupt ink flow, resulting in a failed part. Without on-line monitoring, defective parts can only be identified by operators who witness clogs as or after they occur, requiring operators to continuously monitor the process to eliminate defects. In order to alleviate this, we aim to minimize the effect of clogging via automated process monitoring and rapid detection, thereby reducing labor costs, material loss, and proper identification of defective parts. In this paper, we propose applying a convolutional neural network (CNN) for single frame classification on images gathered from our DIW setup. We report a class average recall of 99.85% across clogged and unclogged classes, and average error of 1.64% when evaluated on new test video sequences, with a processing rate of 27.58 fps. Using class activation mapping, we can visualize image regions the CNN model identifies as salient for each class in performing its discriminative classification task.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[3]  Sara McMains,et al.  Semi-Supervised Convolutional Neural Networks for In-Situ Video Monitoring of Selective Laser Melting , 2019, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[6]  Du T. Nguyen,et al.  Automated detection and sorting of microencapsulation via machine learning. , 2019, Lab on a chip.

[7]  W. S. Compel,et al.  Advanced Methods for Direct Ink Write Additive Manufacturing , 2018 .

[8]  Sara McMains,et al.  Machine‐Learning‐Based Monitoring of Laser Powder Bed Fusion , 2018, Advanced Materials Technologies.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Bin Yao,et al.  Efficient 3D Printed Pseudocapacitive Electrodes with Ultrahigh MnO2 Loading , 2019, Joule.

[12]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[13]  Amanda S. Wu,et al.  3D-Printing of Meso-structurally Ordered Carbon Fiber/Polymer Composites with Unprecedented Orthotropic Physical Properties , 2017, Scientific Reports.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Robert F. Shepherd,et al.  Direct‐Write Assembly of 3D Hydrogel Scaffolds for Guided Cell Growth , 2009 .

[17]  John A. Rogers,et al.  Omnidirectional Printing of Flexible, Stretchable, and Spanning Silver Microelectrodes , 2009, Science.

[18]  J. A. Lewis.  Direct Ink Writing of 3D Functional Materials , 2006 .

[19]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Alan D. Kaplan,et al.  Image classification and control of microfluidic systems , 2019, Optical Engineering + Applications.

[22]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Shu-Ching Chen,et al.  Dynamic Sampling in Convolutional Neural Networks for Imbalanced Data Classification , 2018, 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR).