Rapid Tomographic Image Reconstruction via Large-Scale Parallelization

Synchrotron (x-ray) light sources permit investigation of the structure of matter at extremely small length and time scales. Advances in detector technologies enable increasingly complex experiments and more rapid data acquisition. However, analysis of the resulting data then becomes a bottleneck—preventing near-real-time error detection or experiment steering. We present here methods that leverage highly parallel computers to improve the performance of iterative tomographic image reconstruction applications. We apply these methods to the conventional per-slice parallelization approach and use them to implement a novel in-slice approach that can use many more processors. To address programmability, we implement the introduced methods in high-performance MapReduce-like computing middleware, which is further optimized for reconstruction operations. Experiments with four reconstruction algorithms and two large datasets show that our methods can scale up to 8 K cores on an IBM BG/Q supercomputer with almost perfect speedup and can reduce total reconstruction times for large datasets by more than 95.4 % on 32 K cores relative to 1 K cores. Moreover, the average reconstruction times are improved from \(\sim \)2 h (256 cores) to \(\sim \)1 min (32 K cores), thus enabling near-real-time use.

[1]  Gerhard Wellein,et al.  Pushing the limits for medical image reconstruction on recent standard multicore processors , 2011, Int. J. High Perform. Comput. Appl..

[2]  M.D. Jones,et al.  Hybrid MPI-OpenMP Programming for Parallel OSEM PET Reconstruction , 2006, IEEE Transactions on Nuclear Science.

[3]  Francesco De Carlo,et al.  Maximum a posteriori estimation of crystallographic phases in X-ray diffraction tomography , 2015, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[4]  Dinesh Kumar,et al.  Workflow Management for Real-Time Analysis of Lightsource Experiments , 2014, 2014 9th Workshop on Workflows in Support of Large-Scale Science.

[5]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[6]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[7]  C. Tsoumpas,et al.  STIR: software for tomographic image reconstruction release 2 , 2012, 2006 IEEE Nuclear Science Symposium Conference Record.

[8]  Wei Jiang,et al.  A Map-Reduce System with an Alternate API for Multi-core Environments , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[9]  David R. Kaeli,et al.  Multi GPU implementation of iterative tomographic reconstruction algorithms , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[10]  Charles A. Bouman,et al.  TIMBIR: A Method for Time-Space Reconstruction From Interlaced Views , 2015, IEEE Transactions on Computational Imaging.

[11]  Craig S. Levin,et al.  Fast, Accurate and Shift-Varying Line Projections for Iterative Reconstruction Using the GPU , 2009, IEEE Transactions on Medical Imaging.

[12]  Justin P. Haldar,et al.  Accelerating advanced MRI reconstructions on GPUs , 2008, J. Parallel Distributed Comput..

[13]  Tekin Bicer Supporting Data-Intensive Scientic Computing on Bandwidth and Space Constrained Environments , 2014 .

[14]  Ian Foster,et al.  A high-throughput x-ray microtomography system at the Advanced , 2001 .

[15]  Weichung Wang,et al.  A fast forward projection using multithreads for multirays on GPUs in medical image reconstruction. , 2011, Medical physics.

[16]  C. Phatak,et al.  Iterative reconstruction of magnetic induction using Lorentz transmission electron tomography. , 2015, Ultramicroscopy.

[17]  Er-Wei Bai,et al.  A Fast CT Reconstruction Scheme for a General Multi-Core PC , 2007, Int. J. Biomed. Imaging.

[18]  Marco Stampanoni,et al.  A comparative study of X-ray tomographic microscopy on shales at different synchrotron facilities: ALS, APS and SLS , 2012, Journal of synchrotron radiation.

[19]  Arthur W. Toga,et al.  CUDA optimization strategies for compute- and memory-bound neuroimaging algorithms , 2012, Comput. Methods Programs Biomed..

[20]  José-Jesús Fernández,et al.  Fast tomographic reconstruction on multicore computers , 2011, Bioinform..

[21]  Tony Lanzirotti,et al.  Scientific data exchange: a schema for HDF5-based storage of raw and analyzed data. , 2014, Journal of synchrotron radiation.

[22]  Daniel Kolditz,et al.  Iterative reconstruction methods in X-ray CT. , 2012, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[23]  Zhou Yu,et al.  Recent Advances in CT Image Reconstruction , 2013, Current Radiology Reports.

[24]  Francesco De Carlo,et al.  TomoPy: a framework for the analysis of synchrotron tomographic data , 2014, Optics & Photonics - Optical Engineering + Applications.

[25]  Francesco De Carlo,et al.  Hyperspectral image reconstruction for x-ray fluorescence tomography. , 2015, Optics express.