Modified DenseNet for Automatic Fabric Defect Detection With Edge Computing for Minimizing Latency

As an essential step in quality control, fabric defect detection plays an important role in the textile manufacturing industry. The traditional manual detection method is inaccurate and incurs a high cost; as a result, it is gradually being replaced by deep learning algorithms based on cloud computing. However, a high data transmission latency between end devices and the cloud has a significant impact on textile production efficiency. In contrast, edge computing, which provides services near end devices by deploying network, computing and storage facilities at the edge of the Internet, can effectively solve the above-mentioned problem. In this article, we propose a deep-learning-based fabric defect detection method for edge computing scenarios. First, this article modifies the structure of DenseNet to better suit a resource-constrained edge computing scenario. To better assess the proposed model, an optimized cross-entropy loss function is also formulated. Afterward, six feasible expansion schemes are utilized to enhance the data set according to the characteristics of various defects in fabric samples. To balance the distribution of samples, proportions of various defect types are used to determine the number of enhancements. Finally, a fabric defect detection system is established to test the performance of the optimized model used on edge devices in a real-world textile industry scenario. Experimental results demonstrate that compared with the conventional convolutional neural network (CNN), the proposed optimized model attains an average improvement of 18% in the area under the curve (AUC) metric for 11 defects. Data transmission is reduced by approximately 50% and latency is reduced by 32% in the Cambricon 1H8 platform compared with a cloud platform.

[1]  Reinhold Huber-Mörk,et al.  Convolutional Neural Networks for Steel Surface Defect Detection from Photometric Stereo Images , 2014, ISVC.

[2]  Vinod Vokkarane,et al.  A New Deep Learning-Based Food Recognition System for Dietary Assessment on An Edge Computing Service Infrastructure , 2018, IEEE Transactions on Services Computing.

[3]  Hossein Pourghassem,et al.  Corner defect detection based on dot product in ceramic tile images , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[4]  Dario Pompili,et al.  Deep Learning with Edge Computing for Localization of Epileptogenicity Using Multimodal rs-fMRI and EEG Big Data , 2017, 2017 IEEE International Conference on Autonomic Computing (ICAC).

[5]  Jie Zhang,et al.  CNN-based Skip-Gram Method for Improving Classification Accuracy of Chinese Text , 2019, KSII Trans. Internet Inf. Syst..

[6]  Hao Ma,et al.  Automatic fabric defect detection using a deep convolutional neural network , 2019, Coloration Technology.

[7]  Jürgen Schmidhuber,et al.  Steel defect classification with Max-Pooling Convolutional Neural Networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[8]  Sinan Kalkan,et al.  Imbalance Problems in Object Detection: A Review , 2020, IEEE transactions on pattern analysis and machine intelligence.

[9]  M. Fatih Demirci,et al.  Cifar-10 Image Classification with Convolutional Neural Networks for Embedded Systems , 2018, 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA).

[10]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[11]  Ronald M. Summers,et al.  Anatomy-specific classification of medical images using deep convolutional nets , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[12]  Ankit Chaudhary,et al.  Real Time Fabric Defect Detection System on an Embedded DSP Platform , 2014, ArXiv.

[13]  Chih-Yang Lin,et al.  Cascading Convolutional Neural Network for Steel Surface Defect Detection , 2019, AHFE.

[14]  Tae Jin Kang,et al.  Texture classification and segmentation using wavelet packet frame and Gaussian mixture model , 2007, Pattern Recognit..

[15]  K. Srinivasan,et al.  FDAS: A Knowledge-based Framework for Analysis of Defects in Woven Textile Structures , 1992 .

[16]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Jianli Pan,et al.  Future Edge Cloud and Edge Computing for Internet of Things Applications , 2018, IEEE Internet of Things Journal.

[18]  Tarik Taleb,et al.  Edge Computing for the Internet of Things: A Case Study , 2018, IEEE Internet of Things Journal.

[19]  Chi-Ho Chan,et al.  Fabric defect detection by Fourier analysis , 1999, Conference Record of the 1999 IEEE Industry Applications Conference. Thirty-Forth IAS Annual Meeting (Cat. No.99CH36370).

[20]  Anant Madabhushi,et al.  Class-specific weighting for Markov random field estimation: Application to medical image segmentation , 2012, Medical Image Anal..

[21]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Arun Kumar Sangaiah,et al.  Object Tracking in Vary Lighting Conditions for Fog Based Intelligent Surveillance of Public Spaces , 2018, IEEE Access.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Kamal Jamshidi,et al.  Defect Detection of Tiles Using 2D-Wavelet Transform and Statistical Features , 2009 .

[25]  Kyungha Min,et al.  A Deep Approach for Classifying Artistic Media from Artworks , 2019, KSII Trans. Internet Inf. Syst..

[26]  Shifeng Zhang,et al.  S^3FD: Single Shot Scale-Invariant Face Detector , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Mehdi Rasouli,et al.  Serum proteins profile as an indicator of malignancy: multivariate logistic regression and ROC analyses , 2005, Clinical chemistry and laboratory medicine.

[28]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[29]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  Ke Zhang,et al.  Edge Intelligence and Blockchain Empowered 5G Beyond for the Industrial Internet of Things , 2019, IEEE Network.

[32]  Reza Safabakhsh,et al.  Text Detection in Natural Scenes using Fully Convolutional DenseNets , 2018, 2018 4th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS).

[33]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[34]  Mugen Peng,et al.  Recent Advances of Edge Cache in Radio Access Networks for Internet of Things: Techniques, Performances, and Challenges , 2019, IEEE Internet of Things Journal.

[35]  Farnoush Farhadi,et al.  Fabric Defect Detection Using Auto-Correlation Function , 2013 .

[36]  D S Emmerich,et al.  Receiver-operating characteristics determined under several interaural conditions of listening. , 1968, The Journal of the Acoustical Society of America.

[37]  Joonki Paik,et al.  Deep Learning–based Number Detection and Recognition for Gas Meter Reading , 2019 .

[38]  Lars Bauer,et al.  From Cloud Down to Things: An Overview of Machine Learning in Internet of Things , 2019, IEEE Internet of Things Journal.

[39]  Xinggang Wang,et al.  Automated defect inspection of LED chip using deep convolutional neural network , 2019, J. Intell. Manuf..

[40]  Xu Chen,et al.  Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing , 2019, Proceedings of the IEEE.

[41]  Margaret S Pepe,et al.  Using the ROC curve for gauging treatment effect in clinical trials , 2006, Statistics in medicine.

[42]  Jiwen Dong,et al.  Simple convolutional neural network on image classification , 2017, 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA)(.

[43]  D. M. Hutton,et al.  The Cross‐Entropy Method: A Unified Approach to Combinatorial Optimisation, Monte‐Carlo Simulation and Machine Learning , 2005 .

[44]  Zhi Zhou,et al.  Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing , 2019, IEEE Transactions on Wireless Communications.

[45]  Naoya Takahashi,et al.  Multi-Scale multi-band densenets for audio source separation , 2017, 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA).

[46]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.