Accelerating small-angle scattering experiments on anisotropic samples using kernel density estimation

We propose a method to accelerate small-angle scattering experiments by exploiting spatial correlation in two-dimensional data. We applied kernel density estimation to the average of a hundred short scans and evaluated noise reduction effects of kernel density estimation (smoothing). Although there is no advantage of using smoothing for isotropic data due to the powerful noise reduction effect of radial averaging, smoothing with a statistically and physically appropriate kernel can shorten measurement time by less than half to obtain sector averages with comparable statistical quality to that of sector averages without smoothing. This benefit will encourage researchers not to use full radial average on anisotropic data sacrificing anisotropy for statistical quality. We also confirmed that statistically reasonable estimation of measurement time is feasible on site by evaluating how intensity variances improve with accumulating counts. The noise reduction effect of smoothing will bring benefits to a wide range of applications from efficient use of beamtime at laboratories and large experimental facilities to stroboscopic measurements suffering low statistical quality.

[1]  Christopher Wolverton,et al.  Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experiments , 2018, Science Advances.

[2]  E. Lehmann.  A General Concept of Unbiasedness , 1951 .

[3]  S. Curtarolo,et al.  Accelerated discovery of new magnets in the Heusler alloy family , 2017, Science Advances.

[4]  D. W. Scott,et al.  Variable Kernel Density Estimation , 1992 .

[5]  Heinrich Jiang,et al.  Uniform Convergence Rates for Kernel Density Estimation , 2017, ICML.

[6]  Shin Kiyohara,et al.  Prediction of interface structures and energies via virtual screening , 2016, Science Advances.

[7]  Feifei Li,et al.  Quality and efficiency for kernel density estimates in large data , 2013, SIGMOD '13.

[8]  Jonathan P. Wright,et al.  The fast azimuthal integration Python library: pyFAI , 2015, Journal of applied crystallography.

[9]  G. Brown.  On Small-Sample Estimation , 1947 .

[10]  Shin Kiyohara,et al.  Prediction of grain boundary structure and energy by machine learning , 2015 .

[11]  Atsuto Seko,et al.  Prediction of Low-Thermal-Conductivity Compounds with First-Principles Anharmonic Lattice-Dynamics Calculations and Bayesian Optimization. , 2015, Physical review letters.

[12]  M. Rudemo.  Empirical Choice of Histograms and Kernel Density Estimators , 1982 .

[13]  Fawzi Mohamed,et al.  Towards efficient data exchange and sharing for big-data driven materials science: metadata and data formats , 2017, npj Computational Materials.

[14]  Yang Qi,et al.  Self-learning Monte Carlo method: Continuous-time algorithm , 2017, 1705.06724.

[15]  Elizabeth A. Holm,et al.  A computer vision approach for automated analysis and classification of microstructural image data , 2015 .

[16]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[17]  Bülent Yener,et al.  Image driven machine learning methods for microstructure recognition , 2016 .

[18]  Erin Antono,et al.  Building Data-driven Models with Microstructural Images: Generalization and Interpretability , 2017, ArXiv.

[19]  Olle Eriksson,et al.  High-throughput search for rare-earth free permanent magnets , 2020 .

[20]  S. Sain.  Multivariate locally adaptive density estimation , 2002 .

[21]  B. Silverman,et al.  Weak and Strong Uniform Consistency of the Kernel Estimate of a Density and its Derivatives , 1978 .

[22]  R. Asahi,et al.  Microstructure recognition using convolutional neural networks for prediction of ionic conductivity in ceramics , 2017 .

[23]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[24]  Chiho Kim,et al.  Machine learning in materials informatics: recent applications and prospects , 2017, npj Computational Materials.

[25]  Manh Cuong Nguyen,et al.  On-the-fly machine-learning for high-throughput experiments: search for rare-earth-free permanent magnets , 2014, Scientific Reports.

[26]  Dominik Wied,et al.  Consistency of the kernel density estimator: a survey , 2012 .