Materials discovery: Understanding polycrystals from large-scale electron patterns

This paper explores the idea of modeling a large image data collection of polycrystal electron patterns, in order to detect insights in understanding materials discovery. There is an emerging interest in applying big data processing, management and modeling methods to scientific images, which often come in a form and with patterns only interpretable to domain experts. While large-scale machine learning approaches have demonstrated certain superiority in analyzing, summarizing, and providing an understandable route to data types like natural images, speeches and texts, scientific images is still a relatively unexplored area. Deep convolutional neural networks, despite their recent triumph in natural image understanding, are still rarely seen adapted to experimental microscopic images, especially in a large scale. To the best of our knowledge, we present the first deep learning solution towards a scientific image indexing problem using a collection of over 300K microscopic images. The result obtained is 54% better than a dictionary lookup method which is state-of-the-art in the materials science society.

[1]  A. Choudhary,et al.  Perspective: Materials informatics and big data: Realization of the “fourth paradigm” of science in materials science , 2016 .

[2]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[3]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[4]  D. W. Noid,et al.  On the Design, Analysis, and Characterization of Materials Using Computational Neural Networks , 1996 .

[5]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[6]  Yunlian Qi,et al.  Development of constitutive relationship model of Ti600 alloy using artificial neural network , 2010 .

[7]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[8]  Muratahan Aykol,et al.  The Open Quantum Materials Database (OQMD): assessing the accuracy of DFT formation energies , 2015 .

[9]  H. K. D. H. Bhadeshia,et al.  Performance of neural networks in materials science , 2009 .

[10]  Ankit Agrawal,et al.  Machine learning approaches for elastic localization linkages in high-contrast composite materials , 2015, Integrating Materials and Manufacturing Innovation.

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[13]  Tony Hey,et al.  The Fourth Paradigm: Data-Intensive Scientific Discovery , 2009 .

[14]  Alok Choudhary,et al.  Combinatorial screening for new materials in unconstrained composition space with machine learning , 2014 .

[15]  Paul Raccuglia,et al.  Machine-learning-assisted materials discovery using failed experiments , 2016, Nature.

[16]  Marc De Graef,et al.  Dynamical Electron Backscatter Diffraction Patterns. Part I: Pattern Simulations , 2013, Microscopy and Microanalysis.

[17]  Kristin A. Persson,et al.  Commentary: The Materials Project: A materials genome approach to accelerating materials innovation , 2013 .

[18]  Parijat Deshpande,et al.  Exploration of data science techniques to predict fatigue strength of steel from composition and processing parameters , 2014, Integrating Materials and Manufacturing Innovation.

[19]  Dan Backman,et al.  Integrated computational materials engineering: A new paradigm for the global materials profession , 2006 .

[20]  Surya R. Kalidindi,et al.  Materials Data Science: Current Status and Future Outlook , 2015 .

[21]  Alfred O. Hero,et al.  A Dictionary Approach to Electron Backscatter Diffraction Indexing* , 2015, Microscopy and Microanalysis.

[22]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[23]  Thomas Hofmann,et al.  Efficient Learning of Sparse Representations with an Energy-Based Model , 2007 .

[24]  Alok Choudhary,et al.  A predictive machine learning approach for microstructure optimization and materials design , 2015, Scientific Reports.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Vijay S. Pande,et al.  Massively Multitask Networks for Drug Discovery , 2015, ArXiv.

[27]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[28]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Charles H. Ward.  Materials Genome Initiative for Global Competitiveness , 2012 .

[30]  Pietro Perona,et al.  Automatic recognition of biological particles in microscopic images , 2007, Pattern Recognit. Lett..

[31]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[32]  E. F. Rauch,et al.  Rapid Diffraction Patterns identification through template matching , 2005 .

[33]  Edgar F. Rauch,et al.  Rapid spot diffraction patterns idendification through template matching , 2005 .

[34]  Hod Lipson,et al.  Understanding Neural Networks Through Deep Visualization , 2015, ArXiv.

[35]  Mukul Kumar,et al.  Electron Backscatter Diffraction in Materials Science , 2000 .

[36]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[37]  Xiaodong Tao,et al.  Errors, Artifacts, and Improvements in EBSD Processing and Mapping , 2005, Microscopy and Microanalysis.

[38]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[39]  James Babcock,et al.  Artificial General Intelligence , 2016, Lecture Notes in Computer Science.