Visual Understanding of Multiple Attributes Learning Model of X-Ray Scattering Images

This extended abstract presents a visualization system, which is designed for domain scientists to visually understand their deep learning model of extracting multiple attributes in x-ray scattering images. The system focuses on studying the model behaviors related to multiple structural attributes. It allows users to explore the images in the feature space, the classification output of different attributes, with respect to the actual attributes labelled by domain scientists. Abundant interactions allow users to flexibly select instance images, their clusters, and compare them visually in details. Two preliminary case studies demonstrate its functionalities and usefulness.

[1]  Dantong Yu,et al.  Dataset of Synthetic X-ray Scattering Images for Classification Using Deep Learning , 2017 .

[2]  Theresa-Marie Rhyne,et al.  Visual Analytics for Explainable Deep Learning , 2018, IEEE Computer Graphics and Applications.

[3]  Hong Qin,et al.  Automatic X-ray Scattering Image Annotation via Double-View Fourier-Bessel Convolutional Networks , 2018, BMVC.

[4]  Grant Potter,et al.  ConvNetJS: Deep Learning in your browser , 2017 .

[5]  Percy Liang,et al.  Understanding Black-box Predictions via Influence Functions , 2017, ICML.

[6]  W. Park,et al.  Classification of crystal structure using a convolutional neural network , 2017, IUCrJ.

[7]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Boyu Wang,et al.  X-Ray Scattering Image Classification Using Deep Learning , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[9]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[10]  Tommi S. Jaakkola,et al.  A causal framework for explaining the predictions of black-box sequence-to-sequence models , 2017, EMNLP.

[11]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Zhen Li,et al.  Towards Better Analysis of Deep Convolutional Neural Networks , 2016, IEEE Transactions on Visualization and Computer Graphics.

[13]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Alexander C. Berg,et al.  Materials discovery: Fine-grained classification of X-ray scattering images , 2014, IEEE Winter Conference on Applications of Computer Vision.

[16]  Hod Lipson,et al.  Understanding Neural Networks Through Deep Visualization , 2015, ArXiv.

[17]  Minsuk Kahng,et al.  ActiVis: Visual Exploration of Industry-Scale Deep Neural Network Models , 2017, IEEE Transactions on Visualization and Computer Graphics.

[18]  K. Yager,et al.  Periodic lattices of arbitrary nano‐objects: modeling and applications for self‐assembled systems , 2014 .

[19]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Martin Wattenberg,et al.  Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow , 2018, IEEE Transactions on Visualization and Computer Graphics.

[21]  Rick Archibald,et al.  BraggNet: integrating Bragg peaks using neural networks. , 2019, Journal of applied crystallography.

[22]  Singanallur Venkatakrishnan,et al.  Convolutional neural networks for grazing incidence x-ray scattering patterns: thin film structure identification , 2019, MRS Communications.