Photoacoustic imaging for surgical guidance: Principles, applications, and outlook

Minimally invasive surgeries often require complicated maneuvers and delicate hand–eye coordination and ideally would incorporate “x-ray vision” to see beyond tool tips and underneath tissues prior to making incisions. Photoacoustic imaging has the potential to offer this feature but not with ionizing x-rays. Instead, optical fibers and acoustic receivers enable photoacoustic sensing of major structures—such as blood vessels and nerves—that are otherwise hidden from view. This imaging process is initiated by transmitting laser pulses that illuminate regions of interest, causing thermal expansion and the generation of sound waves that are detectable with conventional ultrasound transducers. The recorded signals are then converted to images through the beamforming process. Photoacoustic imaging may be implemented to both target and avoid blood-rich surgical contents (and in some cases simultaneously or independently visualize optical fiber tips or metallic surgical tool tips) in order to prevent accidental injury and assist device operators during minimally invasive surgeries and interventional procedures. Novel light delivery systems, counterintuitive findings, and robotic integration methods introduced by the Photoacoustic & Ultrasonic Systems Engineering Lab are summarized in this invited Perspective, setting the foundation and rationale for the subsequent discussion of the author’s views on possible future directions for this exciting frontier known as photoacoustic-guided surgery.

[1]  Muyinatu A. Lediju Bell,et al.  GPU implementation of coherence-based photoacoustic beamforming for autonomous visual servoing , 2019, 2019 IEEE International Ultrasonics Symposium (IUS).

[2]  Lihong V. Wang,et al.  Noninvasive photoacoustic identification of sentinel lymph nodes containing methylene blue in vivo in a rat model. , 2008, Journal of biomedical optics.

[3]  Muyinatu A. Lediju Bell,et al.  A GPU approach to real-time coherence-based photoacoustic imaging and its application to photoacoustic visual servoing , 2020, BiOS.

[4]  Muyinatu A Lediju Bell,et al.  GPU implementation of photoacoustic short-lag spatial coherence imaging for improved image-guided interventions , 2020, Journal of biomedical optics.

[5]  David T. Delpy,et al.  Optical properties of brain tissue , 1993, Photonics West - Lasers and Applications in Science and Engineering.

[6]  R A Deyo,et al.  Lumbar spinal fusion. A cohort study of complications, reoperations, and resource use in the Medicare population. , 1993, Spine.

[7]  Andreas Hauptmann,et al.  Model-Based Learning for Accelerated, Limited-View 3-D Photoacoustic Tomography , 2017, IEEE Transactions on Medical Imaging.

[8]  Muyinatu A. Lediju Bell,et al.  Techniques to distinguish the ureter from the uterine artery in photoacoustic-guided hysterectomies , 2019, BiOS.

[9]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Christopher Fadden,et al.  A Deep Learning Approach to Photoacoustic Wavefront Localization in Deep-Tissue Medium , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[11]  Sebastien Ourselin,et al.  Performance characteristics of an interventional multispectral photoacoustic imaging system for guiding minimally invasive procedures , 2015, Journal of biomedical optics.

[12]  Wiendelt Steenbergen,et al.  Reflection artifact identification in photoacoustic imaging using multi-wavelength excitation. , 2018, Biomedical optics express.

[13]  R. Surendran,et al.  Post pancreaticoduodenectomy haemorrhage: outcome prediction based on new ISGPS Clinical severity grading. , 2008, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[14]  M. Hahn,et al.  The Thickness of Human Vertebral Cortical Bone and its Changes in Aging and Osteoporosis: A Histomorphometric Analysis of the Complete Spinal Column from Thirty‐Seven Autopsy Specimens , 1997, Journal of bone and mineral research : the official journal of the American Society for Bone and Mineral Research.

[15]  Jesse V. Jokerst,et al.  Strategies for Image-Guided Therapy, Surgery, and Drug Delivery Using Photoacoustic Imaging , 2019, Theranostics.

[16]  Tian-Ling Ren,et al.  A Flexible Ultrasound Transducer Array with Micro-Machined Bulk PZT , 2015, Sensors.

[17]  Joshua Shubert,et al.  Photoacoustic-based visual servoing of a needle tip , 2018, Scientific Reports.

[18]  H. Torp,et al.  The Generalized Contrast-to-Noise Ratio: A Formal Definition for Lesion Detectability , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[19]  Lorri A. Lee Risk Factors Associated with Ischemic Optic Neuropathy after Spinal Fusion Surgery , 2012, Anesthesiology.

[20]  K. Abul-Kasim,et al.  The rate of screw misplacement in segmental pedicle screw fixation in adolescent idiopathic scoliosis , 2011, Acta orthopaedica.

[21]  Kelley M Kempski,et al.  Application of the generalized contrast-to-noise ratio to assess photoacoustic image quality. , 2020, Biomedical optics express.

[22]  P. Beard Biomedical photoacoustic imaging , 2011, Interface Focus.

[23]  Jin U. Kang,et al.  In vivo visualization of prostate brachytherapy seeds with photoacoustic imaging , 2014, Journal of biomedical optics.

[24]  Muyinatu A. Lediju Bell,et al.  Simulations and human cadaver head studies to identify optimal acoustic receiver locations for minimally invasive photoacoustic-guided neurosurgery , 2020, Photoacoustics.

[25]  P. Wormald,et al.  Carotid artery injury after endonasal surgery. , 2011, Otolaryngologic clinics of North America.

[26]  Joshua Shubert,et al.  Photoacoustic imaging of a human vertebra: implications for guiding spinal fusion surgeries , 2018, Physics in medicine and biology.

[27]  R. Schwend,et al.  How Accurately Do Novice Surgeons Place Thoracic Pedicle Screws With the Free Hand Technique? , 2008, Spine.

[28]  R. Delamarter,et al.  Spinal Fusion in the United States: Analysis of Trends From 1998 to 2008 , 2012, Spine.

[29]  H. L. Defino,et al.  ESTUDO MORFOMÉTRICO DO PEDÍCULO DAS VÉRTEBRAS LOMBARES MORPHOMETRIC STUDY OF LUMBAR VERTEBRAE'S PEDICLE , 2007 .

[30]  Muyinatu A. Lediju Bell,et al.  A machine learning approach to identifying point source locations in photoacoustic data , 2017, BiOS.

[31]  Fabrizio Romano,et al.  Bleeding in Hepatic Surgery: Sorting through Methods to Prevent It , 2012, HPB surgery : a world journal of hepatic, pancreatic and biliary surgery.

[32]  Ali Hariri,et al.  Development of low-cost photoacoustic imaging systems using very low-energy pulsed laser diodes , 2017, Journal of biomedical optics.

[33]  Georg Schmitz,et al.  Photoacoustic clutter reduction by inversion of a linear scatter model using plane wave ultrasound measurements. , 2016, Biomedical optics express.

[34]  W. Edwards,et al.  Structural features and thickness of the vertebral cortex in the thoracolumbar spine. , 2001, Spine.

[35]  Hamid Moradi,et al.  Toward Robot-Assisted Photoacoustic Imaging: Implementation Using the da Vinci Research Kit and Virtual Fixtures , 2019, IEEE Robotics and Automation Letters.

[36]  Wiendelt Steenbergen,et al.  Photoacoustic needle: minimally invasive guidance to biopsy , 2013, Journal of biomedical optics.

[37]  Eduardo Gonzalez,et al.  In Vivo Demonstration of Photoacoustic Image Guidance and Robotic Visual Servoing for Cardiac Catheter-Based Interventions , 2020, IEEE Transactions on Medical Imaging.

[38]  Wiendelt Steenbergen,et al.  Photoacoustic-guided focused ultrasound (PAFUSion) for identifying reflection artifacts in photoacoustic imaging , 2015, Photoacoustics.

[39]  Valery V. Tuchin,et al.  Optical clearing of human cranial bone by administration of immersion agents , 2006, Saratov Fall Meeting.

[40]  A. Alho,et al.  Accuracy of pedicle screw insertion: A prospective CT study in 30 low back patients , 2005, European Spine Journal.

[41]  Randal R. Betz,et al.  Accuracy of free-hand placement of thoracic pedicle screws in adolescent idiopathic scoliosis: how much of a difference does surgeon experience make? , 2009, European Spine Journal.

[42]  Xosé Luís Deán-Ben,et al.  Deep learning optoacoustic tomography with sparse data , 2019, Nature Machine Intelligence.

[43]  R. Deyo,et al.  Lumbar spinal fusion. A cohort study of complications, reoperations, and resource use in the Medicare population. , 1993, Spine.

[44]  Muyinatu A Lediju Bell,et al.  Design of a multifiber light delivery system for photoacoustic-guided surgery , 2017, Journal of biomedical optics.

[45]  Qifa Zhou,et al.  Stretchable ultrasonic transducer arrays for three-dimensional imaging on complex surfaces , 2018, Science Advances.

[46]  Lihong V. Wang,et al.  Photoacoustic imaging in biomedicine , 2006 .

[47]  Muyinatu A. Lediju Bell,et al.  Photoacoustic Spatial Coherence Theory and Applications to Coherence-Based Image Contrast and Resolution , 2020, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[48]  A. Elixhauser,et al.  Trends in Operating Room Procedures in U.S. Hospitals, 2001–2011 , 2014 .

[49]  M. Laursen,et al.  Long-Term Functional Outcome of Pedicle Screw Instrumentation as a Support for Posterolateral Spinal Fusion: Randomized Clinical Study With a 5-Year Follow-up , 2002, Spine.

[50]  Hao Nan,et al.  Segmentation and artifact removal in microwave-induced thermoacoustic imaging , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[51]  Sanjiv S. Gambhir,et al.  Photoacoustic clinical imaging , 2019, Photoacoustics.

[52]  Erwin Bay,et al.  Three‐Dimensional Optoacoustic Monitoring of Lesion Formation in Real Time During Radiofrequency Catheter Ablation , 2015, Journal of cardiovascular electrophysiology.

[53]  Muyinatu A. Lediju Bell,et al.  Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[54]  Muyinatu A. Lediju Bell,et al.  Improved contrast in laser-diode-based photoacoustic images with short-lag spatial coherence beamforming , 2014, 2014 IEEE International Ultrasonics Symposium.

[55]  Emad M Boctor,et al.  Short-lag spatial coherence beamforming of photoacoustic images for enhanced visualization of prostate brachytherapy seeds. , 2013, Biomedical optics express.

[56]  Muyinatu A. Lediju Bell,et al.  Coherence-based photoacoustic imaging of brachytherapy seeds implanted in a canine prostate , 2014, Medical Imaging.

[57]  Stanislav Emelianov,et al.  Ultrasound-guided photoacoustic imaging: current state and future development , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[58]  Muyinatu A. Lediju Bell,et al.  In vivo demonstration of photoacoustic-guided liver surgery , 2019, BiOS.

[59]  W. Taylor,et al.  LIVER BIOPSY: COMPLICATIONS IN 1000 INPATIENTS AND OUTPATIENTS , 1978 .

[60]  Suhyun Park,et al.  Adaptive beamforming for photoacoustic imaging using linear array transducer , 2007, 2008 IEEE Ultrasonics Symposium.

[61]  Muyinatu A. Lediju Bell,et al.  Photoacoustic based visual servoing of needle tips to improve biopsy on obese patients , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[62]  G.E. Trahey,et al.  A motion-based approach to abdominal clutter reduction , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[63]  Jesse V. Jokerst,et al.  Deep Learning Improves Contrast in Low-Fluence Photoacoustic Imaging , 2020, Biomedical optics express.

[64]  A. Tsourkas,et al.  Photoacoustic-Guided Surgery with Indocyanine Green-Coated Superparamagnetic Iron Oxide Nanoparticle Clusters. , 2017, Small.

[65]  Muyinatu A. Lediju Bell,et al.  Photoacoustic-based approach to surgical guidance performed with and without a da Vinci robot , 2017, Journal of Biomedical Optics.

[66]  Martin Frenz,et al.  In vivo demonstration of reflection artifact reduction in photoacoustic imaging using synthetic aperture photoacoustic-guided focused ultrasound (PAFUSion). , 2016, Biomedical optics express.

[67]  Stephan Antholzer,et al.  Deep learning for photoacoustic tomography from sparse data , 2017, Inverse problems in science and engineering.

[68]  LED-Based Photoacoustic Imaging , 2020, Progress in Optical Science and Photonics.

[69]  Michael C. Kolios,et al.  Improving the quality of photoacoustic images using the short-lag spatial coherence imaging technique , 2013, Photonics West - Biomedical Optics.

[70]  M. Perry,et al.  Carotid Artery Injuries Caused by Blunt Trauma , 1980, Annals of surgery.

[71]  Martin Frenz,et al.  Reduction of background in optoacoustic image sequences obtained under tissue deformation. , 2009, Journal of biomedical optics.

[72]  S. Gertzbein,et al.  Accuracy of Pedicular Screw Placement In Vivo , 1990, Spine.

[73]  Liang Song,et al.  Handheld array-based photoacoustic probe for guiding needle biopsy of sentinel lymph nodes. , 2010, Journal of biomedical optics.

[74]  Adrien E. Desjardins,et al.  Minimally invasive photoacoustic imaging: Current status and future perspectives , 2019, Photoacoustics.

[75]  Stanislav Emelianov,et al.  In vitro photoacoustic visualization of myocardial ablation lesions. , 2014, Heart rhythm.

[76]  Muyinatu A. Lediju Bell,et al.  Dual-wavelength photoacoustic imaging for guidance of hysterectomy procedures , 2020, BiOS.

[77]  Kunihiko Washio Standards for Safe Use of Lasers , 2007 .

[78]  D. Feliciano,et al.  Carotid artery injuries. , 1982, American journal of surgery.

[79]  Steven Guan,et al.  Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact Removal , 2018, IEEE Journal of Biomedical and Health Informatics.

[80]  Abe Fingerhut,et al.  Postpancreatectomy hemorrhage (PPH): an International Study Group of Pancreatic Surgery (ISGPS) definition. , 2007, Surgery.

[81]  Joshua Shubert,et al.  Feasibility of photoacoustic-guided teleoperated hysterectomies , 2018, Journal of medical imaging.

[82]  Stanislav Y. Emelianov,et al.  Photoacoustic imaging of prostate brachytherapy seeds , 2011, Biomedical optics express.

[83]  Stanislav Emelianov,et al.  Intravascular photoacoustic imaging of lipid in atherosclerotic plaques in the presence of luminal blood. , 2012, Optics letters.

[84]  Xinmai Yang,et al.  Photoacoustic image-guided interventions , 2019, Experimental biology and medicine.

[85]  Anastasia K. Ostrowski,et al.  Localization of Transcranial Targets for Photoacoustic-Guided Endonasal Surgeries , 2015, Photoacoustics.

[86]  Oktay Akkus,et al.  Evaluation of Skin and Subcutaneous Adipose Tissue Thickness for Optimal Insulin Injection , 2012 .

[87]  S. Ourselin,et al.  Photoacoustic imaging of the human placental vasculature , 2019, Journal of biophotonics.

[88]  A Taddeucci,et al.  Optical properties of brain tissue. , 1996, Journal of biomedical optics.

[89]  Muyinatu A. Lediju Bell,et al.  A novel drill design for photoacoustic guided surgeries , 2018, BiOS.

[90]  Junjie Yao,et al.  Feature article: A generative adversarial network for artifact removal in photoacoustic computed tomography with a linear-array transducer , 2020, Experimental biology and medicine.

[91]  Janek Gröhl,et al.  Reconstruction of initial pressure from limited view photoacoustic images using deep learning , 2018, BiOS.

[92]  E. Neufeld,et al.  IT’IS Database for Thermal and Electromagnetic Parameters of Biological Tissues , 2012 .

[93]  Gregg E. Trahey,et al.  Quantitative Assessment of the Magnitude, Impact and Spatial Extent of Ultrasonic Clutter , 2008, Ultrasonic imaging.

[94]  Martin Frenz,et al.  Clutter elimination for deep clinical optoacoustic imaging using localised vibration tagging (LOVIT) , 2013, Photoacoustics.

[95]  Scott E Delacroix,et al.  Urinary tract injures: recognition and management. , 2010, Clinics in colon and rectal surgery.

[96]  Paul Kumar Upputuri,et al.  Fast photoacoustic imaging systems using pulsed laser diodes: a review , 2018, Biomedical Engineering Letters.

[97]  Erwin J. Alles,et al.  Photoacoustic clutter reduction using short-lag spatial coherence weighted imaging , 2014, 2014 IEEE International Ultrasonics Symposium.

[98]  L. Lenke,et al.  Computed Tomography Evaluation of Pedicle Screws Placed in the Pediatric Deformed Spine Over an 8-Year Period , 2007, Spine.

[99]  W. Castro,et al.  Accuracy of Pedicle Screw Placement in Lumbar Vertebrae , 1996, Spine.