Transformation of PET raw data into images for event classification using convolutional neural networks.

In positron emission tomography (PET) studies, convolutional neural networks (CNNs) may be applied directly to the reconstructed distribution of radioactive tracers injected into the patient's body, as a pattern recognition tool. Nonetheless, unprocessed PET coincidence data exist in tabular format. This paper develops the transformation of tabular data into n-dimensional matrices, as a preparation stage for classification based on CNNs. This method explicitly introduces a nonlinear transformation at the feature engineering stage and then uses principal component analysis to create the images. We apply the proposed methodology to the classification of simulated PET coincidence events originating from NEMA IEC and anthropomorphic XCAT phantom. Comparative studies of neural network architectures, including multilayer perceptron and convolutional networks, were conducted. The developed method increased the initial number of features from 6 to 209 and gave the best precision results (79.8) for all tested neural network architectures; it also showed the smallest decrease when changing the test data to another phantom.

[1]  Shivani,et al.  Realistic Total-Body J-PET Geometry Optimization -- Monte Carlo Study , 2022, 2212.02285.

[2]  C. DeCarli,et al.  Non‐invasive quantification and SUVR validation of [18F]‐florbetaben with total‐body EXPLORER PET , 2022, Alzheimer's & Dementia.

[3]  C. DeCarli,et al.  Non‐invasive quantification and SUVR validation of [18F]‐florbetaben with total‐body EXPLORER PET , 2022, Alzheimer's & Dementia.

[4]  O. Matar,et al.  Ensemble latent assimilation with deep learning surrogate model: application to drop interaction in a microfluidics device. , 2022, Lab on a chip.

[5]  T. Werner,et al.  Unparalleled and revolutionary impact of PET imaging on research and day to day practice of medicine , 2021, Bio Algorithms Med Syst..

[6]  Shivani,et al.  Positronium imaging with the novel multiphoton PET scanner , 2021, Science advances.

[7]  B. Hiesmayr,et al.  Simulating NEMA characteristics of the modular total-body J-PET scanner—an economic total-body PET from plastic scintillators , 2021, Physics in medicine and biology.

[8]  D. Visvikis,et al.  Advanced Monte Carlo simulations of emission tomography imaging systems with GATE , 2021, Physics in medicine and biology.

[9]  B. Hiesmayr,et al.  Testing CPT symmetry in ortho-positronium decays with positronium annihilation tomography , 2021, Nature Communications.

[10]  Joel S. Karp,et al.  State of the art in total body PET , 2020, EJNMMI Physics.

[11]  Tatsuhiko Tsunoda,et al.  DeepInsight: A methodology to transform a non-image data to an image for convolution neural network architecture , 2019, Scientific Reports.

[12]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[13]  Pengcheng Hu,et al.  First Human Imaging Studies with the EXPLORER Total-Body PET Scanner* , 2019, The Journal of Nuclear Medicine.

[14]  A. Gajos,et al.  Evaluation of Single-Chip, Real-Time Tomographic Data Processing on FPGA SoC Devices , 2018, IEEE Transactions on Medical Imaging.

[15]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[16]  S. Cherry,et al.  Using convolutional neural networks to estimate time-of-flight from PET detector waveforms , 2018, Physics in medicine and biology.

[17]  P. Białas,et al.  Preliminary Studies of J-PET Detector Spatial Resolution , 2017 .

[18]  M. Palka,et al.  J-PET: A New Technology for the Whole-body PET Imaging , 2017, 1710.11369.

[19]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[20]  A. Gajos,et al.  Scatter fraction of the J-PET tomography scanner , 2016, 1602.05402.

[21]  M. Palka,et al.  Time resolution of the plastic scintillator strips with matrix photomultiplier readout for J-PET tomograph , 2016, Physics in medicine and biology.

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[25]  A. Gajos,et al.  Compressive sensing of signals generated in plastic scintillators in a novel J-PET instrument , 2015, 1503.05188.

[26]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  M. Palka,et al.  Test of a single module of the J-PET scanner based on plastic scintillators , 2014, 1407.7395.

[28]  Alberto Landi,et al.  Artificial Neural Networks for nonlinear regression and classification , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[29]  W. Segars,et al.  4D XCAT phantom for multimodality imaging research. , 2010, Medical physics.

[30]  P. Valk,et al.  Positon emission tomography. Basic sciences , 2006 .

[31]  A. Rahmim,et al.  Statistical list-mode image reconstruction for the high resolution research tomograph. , 2004, Physics in medicine and biology.

[32]  D. Visvikis,et al.  GATE: a simulation toolkit for PET and SPECT , 2004, Physics in medicine and biology.

[33]  Joel S Karp,et al.  Optimization of a fully 3D single scatter simulation algorithm for 3D PET. , 2004, Physics in medicine and biology.

[34]  John L. Humm,et al.  From PET detectors to PET scanners , 2003, European Journal of Nuclear Medicine and Molecular Imaging.

[35]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[36]  Jonas Mockus,et al.  Application of Bayesian approach to numerical methods of global and stochastic optimization , 1994, J. Glob. Optim..

[37]  Fionn Murtagh,et al.  Multilayer perceptrons for classification and regression , 1991, Neurocomputing.

[38]  蜂谷 武憲,et al.  Positron Emission Tomography従事者の被爆線量 , 1989 .

[39]  Yufang Jin,et al.  Parameter Flexible Wildfire Prediction Using Machine Learning Techniques: Forward and Inverse Modelling , 2022, Remote. Sens..

[40]  Mohamed Ettaouil,et al.  Multilayer Perceptron: Architecture Optimization and training with mixed activation functions , 2017, BDCA'17.

[41]  C. Watson,et al.  Extension of Single Scatter Simulation to Scatter Correction of Time-of-Flight PET , 2007, IEEE Transactions on Nuclear Science.

[42]  G. Muehllehner,et al.  Positron emission tomography , 2006, Physics in medicine and biology.

[43]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[44]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[45]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .