Using OpenCL to Enable Software-like Development of an FPGA-Accelerated Biophotonic Cancer Treatment Simulator

The simulation of light propagation through tissues is important for medical applications, such as photodynamic therapy (PDT) for cancer treatment. To optimize PDT an inverse problem, which works backwards from a desired distribution of light to the parameters that caused it, must be solved. These problems have no closed-form solution and therefore must be solved numerically using an iterative method. This involves running many forward light propagation simulations which is time-consuming and computationally intensive. Currently, the fastest general software solver for this problem is FulMonteSW. It models complex 3D geometries with tetrahedral meshes and uses Monte Carlo techniques to model photon interactions with tissues. This work presents FullMonteFPGACL: an FPGA-accelerated version of FullMonteSW using an Intel Stratix 10 FPGA and the Intel FPGA SDK for OpenCL. FullMonteFPGACL has been validated and benchmarked using several models and achieves improvements in performance (4x) and energy-efficiency (11x) over the optimized and multi-threaded FullMonteSW implementation. We discuss methods for extending the design to improve the performance and energy-efficiency ratios to 16x and 17x, respectively. We achieved these gains by developing in an agile fashion using OpenCL to facilitate quick prototyping and hardware-software partitioning. However, achieving competitive area and performance required careful design of the hardware pipeline and expression of its structure in OpenCL. This led to a hybrid design style that can improve productivity when developing complex applications on an FPGA.

[1]  Daniel A. Rüfenacht,et al.  Light transport in tissue by 3D Monte Carlo: Influence of boundary voxelization , 2008, Comput. Methods Programs Biomed..

[2]  Vaughn Betz,et al.  Tolerating uncertainty: photodynamic therapy planning with optical property variation , 2019, BiOS.

[3]  S. Jacques,et al.  Light distributions in artery tissue: Monte Carlo simulations for finite‐diameter laser beams , 1989, Lasers in surgery and medicine.

[4]  Lothar Lilge,et al.  High-performance, robustly verified Monte Carlo simulation with FullMonte , 2018, Journal of biomedical optics.

[5]  Aaftab Munshi,et al.  The OpenCL specification , 2009, 2009 IEEE Hot Chips 21 Symposium (HCS).

[6]  Samuel Powell,et al.  Highly parallel Monte-Carlo simulations of the acousto-optic effect in heterogeneous turbid media. , 2012, Journal of biomedical optics.

[7]  Qianqian Fang,et al.  Mesh-based Monte Carlo method using fast ray-tracing in Plücker coordinates , 2010, Biomedical optics express.

[8]  B. Wilson,et al.  The physics, biophysics and technology of photodynamic therapy , 2008, Physics in medicine and biology.

[9]  Alwin Kienle,et al.  Explicit solutions of the radiative transport equation in the P3 approximation. , 2014, Medical physics.

[10]  Jason Luu,et al.  Hardware acceleration of a Monte Carlo simulation for photodynamic treatment planning , 2019 .

[11]  D. Boas,et al.  Three dimensional Monte Carlo code for photon migration through complex heterogeneous media including the adult human head. , 2002, Optics express.

[12]  Haiou Shen,et al.  A tetrahedron-based inhomogeneous Monte Carlo optical simulator , 2010, Physics in medicine and biology.

[13]  Vasilis Ntziachristos,et al.  Looking and listening to light: the evolution of whole-body photonic imaging , 2005, Nature Biotechnology.

[14]  Robert J. Halstead,et al.  Exploring irregular memory accesses on FPGAs , 2011, IA3 '11.

[15]  Makoto Matsumoto,et al.  SIMD-Oriented Fast Mersenne Twister: a 128-bit Pseudorandom Number Generator , 2008 .

[16]  Lothar Lilge,et al.  Fast, Power-Efficient Biophotonic Simulations for Cancer Treatment Using FPGAs , 2014, 2014 IEEE 22nd Annual International Symposium on Field-Programmable Custom Computing Machines.

[17]  Tanner Young-Schultz,et al.  FullMonteCUDA: a fast, flexible, and accurate GPU-accelerated Monte Carlo simulator for light propagation in turbid media. , 2019, Biomedical optics express.

[18]  Timothy C Zhu,et al.  Validation of combined Monte Carlo and photokinetic simulations for the outcome correlation analysis of benzoporphyrin derivative-mediated photodynamic therapy on mice , 2019, Journal of biomedical optics.

[19]  Tomas Svensson,et al.  Parallel computing with graphics processing units for high-speed Monte Carlo simulation of photon migration. , 2008, Journal of biomedical optics.

[20]  B. Wilson,et al.  A Monte Carlo model for the absorption and flux distributions of light in tissue. , 1983, Medical physics.

[21]  Robert A. Leathers,et al.  Monte Carlo Radiative Transfer Simulations for Ocean Optics: A Practical Guide , 2004 .

[22]  L Wang,et al.  MCML--Monte Carlo modeling of light transport in multi-layered tissues. , 1995, Computer methods and programs in biomedicine.

[23]  David A Boas,et al.  Monte Carlo simulation of photon migration in 3D turbid media accelerated by graphics processing units. , 2009, Optics express.

[24]  Alwin Kienle,et al.  Analytical solutions of the radiative transport equation for turbid and fluorescent layered media , 2017, Scientific Reports.

[25]  Fynn Schwiegelshohn,et al.  FullMonte: fast Monte-Carlo light simulator , 2019, European Conference on Biomedical Optics.

[26]  Lothar Lilge,et al.  Automatic interstitial photodynamic therapy planning via convex optimization. , 2018, Biomedical optics express.

[27]  Stefan Andersson-Engels,et al.  Next-generation acceleration and code optimization for light transport in turbid media using GPUs , 2010, Biomedical optics express.

[28]  Lothar Lilge,et al.  FullMonte: a framework for high-performance Monte Carlo simulation of light through turbid media with complex geometry , 2013, Photonics West - Biomedical Optics.

[29]  Min-Yu Tsai,et al.  A Platform-Oblivious Approach for Heterogeneous Computing: A Case Study with Monte Carlo-based Simulation for Medical Applications , 2016, FPGA.