Getting High: High Fidelity Simulation of High Granularity Calorimeters with High Speed

Accurate simulation of physical processes is crucial for the success of modern particle physics. However, simulating the development and interaction of particle showers with calorimeter detectors is a time consuming process and drives the computing needs of large experiments at the LHC and future colliders. Recently, generative machine learning models based on deep neural networks have shown promise in speeding up this task by several orders of magnitude. We investigate the use of a new architecture -- the Bounded Information Bottleneck Autoencoder -- for modelling electromagnetic showers in the central region of the Silicon-Tungsten calorimeter of the proposed International Large Detector. Combined with a novel second post-processing network, this approach achieves an accurate simulation of differential distributions including for the first time the shape of the minimum-ionizing-particle peak compared to a full GEANT4 simulation for a high-granularity calorimeter with 27k simulated channels. The results are validated by comparing to established architectures. Our results further strengthen the case of using generative networks for fast simulation and demonstrate that physically relevant differential distributions can be described with high accuracy.

[1]  Bernhard Schölkopf,et al.  A Kernel Method for the Two-Sample-Problem , 2006, NIPS.

[2]  Yutaro Iiyama,et al.  Learning representations of irregular particle-detector geometry with distance-weighted graph networks , 2019, The European Physical Journal C.

[3]  Francesco Pandolfi,et al.  Fast and Accurate Simulation of Particle Detectors Using Generative Adversarial Networks , 2018, Computing and Software for Big Science.

[4]  Frank Gaede,et al.  DD4hep: A Detector Description Toolkit for High Energy Physics Experiments , 2014 .

[5]  Steffen Schumann,et al.  Exploring phase space with Neural Importance Sampling , 2020 .

[6]  Hoang Dai Nghia Nguyen,et al.  Dijet Resonance Search with Weak Supervision Using sqrt[s]=13  TeV pp Collisions in the ATLAS Detector. , 2020, Physical review letters.

[7]  Damian Podareanu,et al.  Event generation and statistical sampling for physics with deep generative models and a density information buffer , 2019, Nature Communications.

[8]  Tilman Plehn,et al.  How to GAN event subtraction , 2019 .

[9]  J. Monk,et al.  Deep learning as a parton shower , 2018, Journal of High Energy Physics.

[10]  Timo Aila,et al.  A Style-Based Generator Architecture for Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Michela Paganini,et al.  CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networks , 2017, ArXiv.

[12]  C. Frye,et al.  JUNIPR: a framework for unsupervised machine learning in particle physics , 2018, The European Physical Journal C.

[13]  David Shih,et al.  Simulation assisted likelihood-free anomaly detection , 2020 .

[14]  Enrico Bothmann,et al.  Reweighting a parton shower using a neural network: the final-state case , 2018, Journal of High Energy Physics.

[15]  Simon Badger,et al.  Using neural networks for efficient evaluation of high multiplicity scattering amplitudes , 2020 .

[16]  David Rousseau,et al.  Further developments of FORM , 2018, Journal of Physics: Conference Series.

[17]  Benjamin Nachman,et al.  Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multilayer Calorimeters. , 2017, Physical review letters.

[18]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[19]  Kyle Cranmer,et al.  Flows for simultaneous manifold learning and density estimation , 2020, NeurIPS.

[20]  Samy Bengio,et al.  Density estimation using Real NVP , 2016, ICLR.

[21]  Roland Wolfgang Jansky,et al.  The ATLAS Fast Monte Carlo Production Chain Project , 2015 .

[22]  Christina Gao,et al.  Event generation with normalizing flows , 2020 .

[23]  Maria Spiropulu,et al.  Variational autoencoders for new physics mining at the Large Hadron Collider , 2018, Journal of High Energy Physics.

[24]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Maurizio Pierini,et al.  Adversarially Learned Anomaly Detection on CMS Open Data: re-discovering the top quark , 2020, The European Physical Journal Plus.

[27]  Luke de Oliveira,et al.  Learning Particle Physics by Example: Location-Aware Generative Adversarial Networks for Physics Synthesis , 2017, Computing and Software for Big Science.

[28]  Yoshua Bengio,et al.  NICE: Non-linear Independent Components Estimation , 2014, ICLR.

[29]  L. Gouskos,et al.  The Machine Learning landscape of top taggers , 2019, SciPost Physics.

[30]  Gregor Kasieczka,et al.  QCD or what? , 2018, SciPost Physics.

[31]  Wei Wei,et al.  Calorimetry with deep learning: particle simulation and reconstruction for collider physics , 2019, The European Physical Journal C.

[32]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[33]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[34]  Tilman Plehn,et al.  How to GAN LHC events , 2019, SciPost Physics.

[35]  Stefano Carrazza,et al.  Lund jet images from generative and cycle-consistent adversarial networks , 2019, ArXiv.

[36]  Joshua Bendavid,et al.  Efficient Monte Carlo Integration Using Boosted Decision Trees and Generative Deep Neural Networks , 2017, 1707.00028.

[37]  Shideh Rezaeifar,et al.  Information bottleneck through variational glasses , 2019, ArXiv.

[38]  D. Shih,et al.  Searching for new physics with deep autoencoders , 2018, Physical Review D.

[39]  Pierre Baldi,et al.  Parameterized neural networks for high-energy physics , 2016, The European Physical Journal C.

[40]  K. Perez Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment , 2014 .

[41]  Martin Erdmann,et al.  Generating and Refining Particle Detector Simulations Using the Wasserstein Distance in Adversarial Networks , 2018, Computing and Software for Big Science.

[42]  Eric Nalisnick,et al.  Normalizing Flows for Probabilistic Modeling and Inference , 2019, J. Mach. Learn. Res..

[43]  SHiP Collaboration Fast simulation of muons produced at the SHiP experiment using Generative Adversarial Networks , 2019, Journal of Instrumentation.

[44]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[45]  O. Amram,et al.  Tag N’ Train: a technique to train improved classifiers on unlabeled data , 2020, Journal of High Energy Physics.

[46]  Sana Ketabchi Haghighat,et al.  DijetGAN: a Generative-Adversarial Network approach for the simulation of QCD dijet events at the LHC , 2019, Journal of High Energy Physics.

[47]  Gregor Kasieczka,et al.  How to GAN away Detector Effects. , 2019 .

[48]  Geoffrey E. Hinton,et al.  Layer Normalization , 2016, ArXiv.

[49]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[50]  J. Maalmi,et al.  Fast simulation of muons produced at the SHiP experiment using Generative Adversarial Networks , 2019 .

[51]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[52]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[53]  The Ild Collaboration International Large Detector: Interim Design Report , 2020, 2003.01116.

[54]  Matthew D. Klimek,et al.  Neural network-based approach to phase space integration , 2018, SciPost Physics.

[55]  C. Villani Optimal Transport: Old and New , 2008 .

[56]  Christophe Royon,et al.  International Large Detector: Interim Design Report , 2020 .

[58]  Navdeep Jaitly,et al.  Adversarial Autoencoders , 2015, ArXiv.

[59]  B. Nachman,et al.  Anomaly Detection for Resonant New Physics with Machine Learning. , 2018, Physical review letters.

[60]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[61]  B. Nachman,et al.  Anomaly detection with density estimation , 2020, Physical Review D.

[62]  Tao Liu,et al.  Novelty Detection Meets Collider Physics , 2018, Physical Review D.

[63]  Martin Erdmann,et al.  Precise Simulation of Electromagnetic Calorimeter Showers Using a Wasserstein Generative Adversarial Network , 2018, Computing and Software for Big Science.

[64]  A. Dell'Acqua,et al.  Geant4—a simulation toolkit , 2003 .

[65]  Shakir Mohamed,et al.  Variational Inference with Normalizing Flows , 2015, ICML.