Metallographic Image Segmentation Method Based on Superpixels Algorithm and Transfer Learning

In the production process of aluminium alloy, we can evaluate the microstructure and characterization of alloy metals by using optical microscope and transmission electron microscope. Specifically, we could access the second phase distribution and grain of alloy surface by optical microscope, which are significant indications of alloy qualities and mechanical properties. In the actual industrial production process, the majority of meaningful information are extracted by manual counting. This kind of complicated statistics greatly increase the work of quality inspectors and researchers, which make them hard to concentrate on research of properties of alloy metal. Based on this, we proposed a deep learning method that utilizing U-Net to realize the accurate segmentation of the alloy matrix and the second phase in the metallographic image based on superpixels algorithm and transfer learning. Researchers can easily get some important information about distribution and proportion of the second phase to improve work efficiency. The final experiments indicate that the method proposed in this paper can effectively distinguish alloy matrix and second phase in metallographic image and achieve good results on accuracy, recall, precision and generalization.

[1]  Dali Chen,et al.  Aluminum alloy microstructural segmentation in micrograph with hierarchical parameter transfer learning method , 2019, J. Electronic Imaging.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  William D. Callister,et al.  Materials Science and Engineering: An Introduction , 1985 .

[4]  Li Chen,et al.  Image segmentation using iterative watersheding plus ridge detection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  João Manuel R. S. Tavares,et al.  Evaluation of multilayer perceptron and self-organizing map neural network topologies applied on microstructure segmentation from metallographic images , 2009 .

[6]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Neil D. Lawrence,et al.  Learning to learn with the informative vector machine , 2004, ICML.

[9]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Raymond J. Mooney,et al.  Mapping and Revising Markov Logic Networks for Transfer Learning , 2007, AAAI.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Shiyue Zhang,et al.  Aluminum alloy microstructural segmentation method based on simple noniterative clustering and adaptive density-based spatial clustering of applications with noise , 2019, J. Electronic Imaging.

[13]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[14]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[16]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.