Classification of diffraction patterns in single particle imaging experiments performed at x-ray free-electron lasers using a convolutional neural network

Single particle imaging (SPI) is a promising method for native structure determination which has undergone a fast progress with the development of X-ray Free-Electron Lasers. Large amounts of data are collected during SPI experiments, driving the need for automated data analysis. The necessary data analysis pipeline has a number of steps including binary object classification (single versus multiple hits). Classification and object detection are areas where deep neural networks currently outperform other approaches. In this work, we use the fast object detector networks YOLOv2 and YOLOv3. By exploiting transfer learning, a moderate amount of data is sufficient for training of the neural network. We demonstrate here that a convolutional neural network (CNN) can be successfully used to classify data from SPI experiments. We compare the results of classification for the two different networks, with different depth and architecture, by applying them to the same SPI data with different data representation. The best results are obtained for YOLOv2 color images linear scale classification, which shows an accuracy of about 97% with the precision and recall of about 52% and 61%, respectively, which is in comparison to manual data classification.

[1]  Anton Barty,et al.  High-throughput imaging of heterogeneous cell organelles with an X-ray laser , 2014, Nature Photonics.

[2]  Riccardo Cucini,et al.  Deep neural networks for classifying complex features in diffraction images. , 2019, Physical review. E.

[3]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[4]  H. N. Chapman,et al.  Imaging Atomic Structure and Dynamics with Ultrafast X-ray Scattering , 2007, Science.

[5]  Garth J. Williams,et al.  Diffraction data from aerosolized Coliphage PR772 virus particles imaged with the Linac Coherent Light Source , 2020, Scientific data.

[6]  D. Schneider,et al.  Linac Coherent Light Source data analysis using psana , 2016 .

[7]  Kaiming He,et al.  Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour , 2017, ArXiv.

[8]  Garth J. Williams,et al.  Single mimivirus particles intercepted and imaged with an X-ray laser , 2011, Nature.

[9]  Sébastien Boutet,et al.  Non-destructive characterization and alignment of aerodynamically focused particle beams using single particle charge detection , 2008 .

[10]  Nora Berrah,et al.  The LAMP instrument at the Linac Coherent Light Source free-electron laser. , 2018, The Review of scientific instruments.

[11]  Lars Loetgering,et al.  Quantitative ptychographic bio-imaging in the water window. , 2018, Optics express.

[12]  Anton Barty,et al.  Imaging single cells in a beam of live cyanobacteria with an X-ray laser , 2015, Nature Communications.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Marc Messerschmidt,et al.  The Atomic, Molecular and Optical Science instrument at the Linac Coherent Light Source , 2015, Journal of synchrotron radiation.

[15]  D. Ratner,et al.  First lasing and operation of an ångstrom-wavelength free-electron laser , 2010 .

[16]  T. Ishikawa,et al.  A compact X-ray free-electron laser emitting in the sub-ångström region , 2012, Nature Photonics.

[17]  J. Hajdu,et al.  Potential for biomolecular imaging with femtosecond X-ray pulses , 2000, Nature.

[18]  R. Adrian,et al.  3D printing of gas-dynamic virtual nozzles and optical characterization of high-speed microjets. , 2020, Optics express.

[19]  J. Hajdu,et al.  An advanced workflow for single-particle imaging with the limited data at an X-ray free-electron laser , 2020, IUCrJ.

[20]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[21]  Anton Barty,et al.  Single-particle imaging without symmetry constraints at an X-ray free-electron laser , 2018, IUCrJ.

[22]  Anton Barty,et al.  Coherent soft X-ray diffraction imaging of coliphage PR772 at the Linac coherent light source , 2017, Scientific Data.

[23]  H. Sinn,et al.  A MHz-repetition-rate hard X-ray free-electron laser driven by a superconducting linear accelerator , 2020 .

[24]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[25]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[26]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[27]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[28]  Geoffrey E. Hinton,et al.  Layer Normalization , 2016, ArXiv.

[29]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[30]  Haoyuan Li,et al.  Evaluation of the performance of classification algorithms for XFEL single-particle imaging data , 2019, IUCrJ.

[31]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[32]  S A Bobkov,et al.  Sorting algorithms for single-particle imaging experiments at X-ray free-electron lasers. , 2015, Journal of synchrotron radiation.

[33]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.

[34]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Maik Kahnt,et al.  Tomographic reconstruction with a generative adversarial network , 2020, Journal of synchrotron radiation.

[36]  A. H. Walenta,et al.  Large-format, high-speed, X-ray pnCCDs combined with electron and ion imaging spectrometers in a multipurpose chamber for experiments at 4th generation light sources , 2010 .

[37]  Jean-Michel Claverie,et al.  Three-dimensional reconstruction of the giant mimivirus particle with an x-ray free-electron laser. , 2015, Physical review letters.

[38]  Tunc Geveci,et al.  Advanced Calculus , 2014, Nature.

[39]  Steffen Hauf,et al.  Megahertz single-particle imaging at the European XFEL , 2019, Communications Physics.

[40]  W. H. Benner,et al.  Femtosecond diffractive imaging with a soft-X-ray free-electron laser , 2006, physics/0610044.

[41]  R. Santra,et al.  The linac coherent light source single particle imaging road map , 2015, Structural dynamics.