Tile Surface Segmentation Using Deep Convolutional Encoder-Decoder Architecture

Visual inspection systems in industries have increasingly gained a lot of interests. Advances in manufacturing activities have led to mass production in order to reduce overall operational cost. The visual inspection systems provide instant quantitative feedback such as quantity and type of defects. In this paper, we present a visual inspection method of tiles industry using a deep learning approach. The deep learning approach is employed for segmenting cracks and backgrounds in tiles. Due to the small size of the cracks, image segmentation is crucial. Architecture for segmenting semantic objects in a color image is the main inspiration to be applied on this paper. Semantic segmentation is widely applied for image analysis in the real world, one of which is to conduct a visual inspection of tile surfaces where each pixel input of high-resolution images is categorized into a set of semantic labels. In order to test the performance of the segmentation algorithm, SegNet architecture with the DeepLabV3plus were compared. A new dataset named UBIN is also proposed as a training and evaluation data. The training data that we have collected shows promising results on visual inspection when using the proposed algorithm. We believe that this work could improve to a more advanced manufacturing industries.

[1]  Y-Lan Boureau,et al.  Learning Convolutional Feature Hierarchies for Visual Recognition , 2010, NIPS.

[2]  Roberto Cipolla,et al.  Semantic object classes in video: A high-definition ground truth database , 2009, Pattern Recognit. Lett..

[3]  Iasonas Kokkinos,et al.  Sub-cortical brain structure segmentation using F-CNN'S , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[4]  Anhar Risnumawan,et al.  Automatic Detection of Wrecked Airplanes from UAV Images , 2019, EMITTER International Journal of Engineering Technology.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Anhar Risnumawan,et al.  Indonesian Vehicle License Plate Number Detection Using Deep Convolutional Neural Network , 2018, 2018 International Electronics Symposium on Knowledge Creation and Intelligent Computing (IES-KCIC).

[7]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[8]  Anhar Risnumawan,et al.  Human Detection and Tracking on Surveillance Video Footage Using Convolutional Neural Networks , 2019, 2019 International Electronics Symposium (IES).

[9]  George Papandreou,et al.  Weakly-and Semi-Supervised Learning of a Deep Convolutional Network for Semantic Image Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Chris Murphy,et al.  Local Label Descriptor for Example Based Semantic Image Labeling , 2012, ECCV.

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  Marc'Aurelio Ranzato,et al.  Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[14]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[15]  Gabriela Csurka,et al.  What is a good evaluation measure for semantic segmentation? , 2013, BMVC.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Anhar Risnumawan,et al.  Deep multilayer network for automatic targeting system of gun turret , 2017, 2017 International Electronics Symposium on Engineering Technology and Applications (IES-ETA).

[19]  Anhar Risnumawan,et al.  From concrete to abstract: Multilayer neural networks for disaster victims detection , 2016, 2016 International Electronics Symposium (IES).

[20]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[22]  Zaqiatud Darojah,et al.  Deep Features Representation for Automatic Targeting System of Gun Turret , 2018, 2018 International Electronics Symposium on Engineering Technology and Applications (IES-ETA).

[23]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  Endah Suryawati Ningrum,et al.  Aksara jawa text detection in scene images using convolutional neural network , 2017, 2017 International Electronics Symposium on Knowledge Creation and Intelligent Computing (IES-KCIC).

[26]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jemal H. Abawajy,et al.  Text Detection in Low Resolution Scene Images Using Convolutional Neural Network , 2016, SCDM.

[30]  Edi Satriyanto,et al.  Implementation of Victims Detection Framework on Post Disaster Scenario , 2018, 2018 International Electronics Symposium on Engineering Technology and Applications (IES-ETA).

[31]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Sven Behnke,et al.  Fast Semantic Segmentation of RGB-D Scenes with GPU-Accelerated Deep Neural Networks , 2014, KI.

[33]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.