Convolutional neural networks at the interface of physical and digital data

Electron and X-ray interactions with matter can be recorded as digital images, which are signal acquisition mechanisms often used to investigate materials microstructure. Recently, the ability to quickly acquire large datasets at high resolution has created new challenges in areas that rely upon image-based information. The proposed analysis schemes employ Convolutional Neural Networks as the core algorithm in the reconnaissance of expected events from data gathered in two regimes: experimentally and by simulation. At the interface of physical and digital datasets, we propose classification schemes that exploit complex geometrical structure from scientific images through different machine learning packages, such as MatConvNet and TensorFlow. Our results show correct classification rates over 90% considering thousands of samples from four image modalities: cryo-electron microscopy, X-ray diffraction, X-ray scattering and X-ray microtomography. Our main contributions are: (a) developing algorithms designed for data that stem from physical experiments; (b) building new software to constrain parameter space, particularly given new hardware; and (c) testing different CNN models for classification of scientific images.

[1]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[2]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[3]  D. Casasent,et al.  Minimum average correlation energy filters. , 1987, Applied optics.

[4]  J. Frank Three-Dimensional Electron Microscopy of Macromolecular Assemblies: Visualization of Biological Molecules in Their Native State , 1996 .

[5]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[6]  B. V. K. Vijaya Kumar,et al.  Optimal tradeoff circular harmonic function correlation filter methods providing controlled in-plane rotation response , 2000, IEEE Trans. Image Process..

[7]  Joel Davis Brain and Visual Perception: The Story of a 25-Year Collaboration , 2004 .

[8]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  J. Frank Three-Dimensional Electron Microscopy of Macromolecular Assemblies , 2006 .

[10]  Dharmendra S. Modha,et al.  The cat is out of the bag: cortical simulations with 109 neurons, 1013 synapses , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[13]  R. Ritchie,et al.  Real-time Quantitative Imaging of Failure Events in Materials under Load at Temperatures above 1,600 , 2012 .

[14]  Talita Perciano,et al.  Structure recognition from high resolution images of ceramic composites , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[15]  Babette B. Tischleder,et al.  Cultures of Obsolescence , 2015 .

[16]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[17]  D. Ushizima,et al.  Block Copolymer Packing Limits and Interfacial Reconfigurability in the Assembly of Periodic Mesoporous Organosilicas , 2015 .

[18]  Andrew S. Cassidy,et al.  Convolutional networks for fast, energy-efficient neuromorphic computing , 2016, Proceedings of the National Academy of Sciences.

[19]  Dharmendra S. Modha,et al.  Deep neural networks are robust to weight binarization and other non-linear distortions , 2016, ArXiv.

[20]  Chao Yang,et al.  IDEAL: Images Across Domains, Experiments, Algorithms and Learning , 2016 .

[21]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[22]  Ling Shao,et al.  Discriminative Semantic Subspace Analysis for Relevance Feedback , 2016, IEEE Transactions on Image Processing.