Subpixel and On-Line Motion Correction for Photoacoustic Dermoscopy

Photoacoustic dermoscopy (PAD) has been proven to visualize the microvascular network within the dermis noninvasively, and has great application potential and advantages. In practice, some subjects are children or unwell and may have difficulty in controlling their breathing or trembling. The artifacts caused by the uncontrollable trembling will degrade the image quality, resulting in deviation of the pathophysiological features. This work introduces a subpixel and on-line motion correction method for clinical application of PAD. The high-accuracy motion correction was realized by the subpixel motion estimation, which was achieved by five-fold upsampling the cross-correlation matrix between A-lines or B-scan images. Since the motion correction algorithm only takes the acquired data as a priori, it can be processed immediately when a B-scan is input, so it can be embedded in the acquisition program, leading to the motion correction during the data acquisition. Moreover, the algorithm was verified by the experimental data of human skin. The results demonstrated that the images after sub-pixel motion correction are obviously improved visually, and the structural similarity index measurement (SSIM) and peak signal-to-noise ratio (PSNR) between adjacent B-scan images after correction are increased by 31.6% and 47.7% compared to the uncorrected images. To conclude, the proposed algorithm can make it robust in terms of accuracy and reliability and will help PAD fulfill its clinical promise.

[1]  Jin Young Kim,et al.  Super Wide-Field Photoacoustic Microscopy of Animals and Humans In Vivo , 2020, IEEE Transactions on Medical Imaging.

[2]  Junjie Yao,et al.  Single-impulse Panoramic Photoacoustic Computed Tomography of Small-animal Whole-body Dynamics at High Spatiotemporal Resolution , 2017, Nature Biomedical Engineering.

[3]  Junjie Yao,et al.  Photoacoustic microscopy , 2013, Laser & photonics reviews.

[4]  Jun Zou,et al.  Multiscale high-speed photoacoustic microscopy based on free-space light transmission and a MEMS scanning mirror. , 2020, Optics letters.

[5]  Vasilis Ntziachristos,et al.  Optical features of human skin revealed by optoacoustic mesoscopy in the visible and short-wave infrared regions. , 2019, Optics letters.

[6]  Zhongwen Cheng,et al.  Switchable optical and acoustic resolution photoacoustic dermoscope dedicated into in vivo biopsy-like of human skin , 2020 .

[7]  Wolfram Sterry,et al.  Confocal laser-scanning microscopy of capillaries in normal and psoriatic skin , 2012, Journal of biomedical optics.

[8]  Jihoon Park,et al.  A Novel 2-D Synthetic Aperture Focusing Technique for Acoustic-Resolution Photoacoustic Microscopy , 2019, IEEE Transactions on Medical Imaging.

[9]  Da Xing,et al.  Noninvasive and high-resolving photoacoustic dermoscopy of human skin. , 2016, Biomedical optics express.

[10]  Vasilis Ntziachristos,et al.  Motion Quantification and Automated Correction in Clinical RSOM , 2019, IEEE Transactions on Medical Imaging.

[11]  Vasilis Ntziachristos,et al.  Optoacoustic Dermoscopy of the Human Skin: Tuning Excitation Energy for Optimal Detection Bandwidth With Fast and Deep Imaging in vivo , 2017, IEEE Transactions on Medical Imaging.

[12]  Liang Song,et al.  Motion Correction in Optical Resolution Photoacoustic Microscopy , 2019, IEEE Transactions on Medical Imaging.

[13]  Tsutomu Kume,et al.  In vivo corneal neovascularization imaging by optical-resolution photoacoustic microscopy , 2014, Photoacoustics.

[14]  Vasilis Ntziachristos,et al.  Optoacoustic mesoscopy for biomedicine , 2019, Nature Biomedical Engineering.

[15]  Vasilis Ntziachristos,et al.  Motion correction in optoacoustic mesoscopy , 2017, Scientific Reports.

[16]  Vasilis Ntziachristos,et al.  Dual‐wavelength hybrid optoacoustic‐ultrasound biomicroscopy for functional imaging of large‐scale cerebral vascular networks , 2018, Journal of biophotonics.

[17]  Lihong V. Wang,et al.  High-speed label-free functional photoacoustic microscopy of mouse brain in action , 2015, Nature Methods.

[18]  Zhongwen Cheng,et al.  Fast linear confocal scanning photoacoustic dermoscopy for non-invasive assessment of chromatodermatosis , 2018, Applied Physics Letters.

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  Lihong V. Wang,et al.  In vivo photoacoustic microscopy of human cuticle microvasculature with single-cell resolution , 2016, Journal of biomedical optics.

[21]  Jin Young Kim,et al.  Fast optical-resolution photoacoustic microscopy using a 2-axis water-proofing MEMS scanner , 2015, Scientific Reports.

[22]  Ruikang K. Wang,et al.  Long ranging swept-source optical coherence tomography-based angiography outperforms its spectral-domain counterpart in imaging human skin microcirculations , 2017, Journal of biomedical optics.

[23]  Liang Song,et al.  Three-dimensional Hessian matrix-based quantitative vascular imaging of rat iris with optical-resolution photoacoustic microscopy in vivo , 2018, Journal of biomedical optics.

[24]  M. L. Li,et al.  Optoacoustic imaging with synthetic aperture focusing and coherence weighting. , 2004, Optics letters.

[25]  Ruikang K. Wang,et al.  Automatic motion correction for in vivo human skin optical coherence tomography angiography through combined rigid and nonrigid registration , 2017, Journal of biomedical optics.

[26]  Wei Liu,et al.  Dual-view acoustic-resolution photoacoustic microscopy with enhanced resolution isotropy. , 2018, Optics letters.

[27]  Zhongwen Cheng,et al.  Miniaturized photoacoustic probe for in vivo imaging of subcutaneous microvessels within human skin. , 2019, Quantitative imaging in medicine and surgery.

[28]  Vasilis Ntziachristos,et al.  Optoacoustic mesoscopy analysis and quantitative estimation of specific imaging metrics in Fitzpatrick skin phototypes II to V , 2019, Journal of biophotonics.

[29]  Yizhi Liang,et al.  Wide-field polygon-scanning photoacoustic microscopy of oxygen saturation at 1-MHz A-line rate , 2020, Photoacoustics.

[30]  Carlo Tomasi,et al.  Automated non-rigid registration and mosaicing for robust imaging of distinct retinal capillary beds using speckle variance optical coherence tomography , 2013, Biomedical optics express.

[31]  V. Ntziachristos,et al.  Precision assessment of label-free psoriasis biomarkers with ultra-broadband optoacoustic mesoscopy , 2017, Nature Biomedical Engineering.

[32]  Lei Xi,et al.  Portable optical resolution photoacoustic microscopy (pORPAM) for human oral imaging. , 2017, Optics letters.

[33]  Lei Xi,et al.  Ultracompact high-resolution photoacoustic microscopy. , 2018, Optics letters.

[34]  Wang Wei,et al.  Shape-adapting panoramic photoacoustic endomicroscopy , 2019, Optics Letters.

[35]  Junjie Yao,et al.  Double-illumination photoacoustic microscopy. , 2012, Optics letters.

[36]  Yizhi Liang,et al.  Optical-resolution photoacoustic microscopy of oxygen saturation with nonlinear compensation. , 2019, Biomedical optics express.

[37]  Minqiang Jiang,et al.  On enhancing H.264/AVC video rate control by PSNR-based frame complexity estimation , 2005, IEEE Trans. Consumer Electron..

[38]  Maurizio Cutolo,et al.  Assessing microvascular changes in systemic sclerosis diagnosis and management , 2010, Nature Reviews Rheumatology.

[39]  Liang Song,et al.  Multiscale Vascular Enhancement Filter Applied to In Vivo Morphologic and Functional Photoacoustic Imaging of Rat Ocular Vasculature , 2019, IEEE Photonics Journal.

[40]  Jianjun Lei,et al.  Rate control for HEVC based on spatio-temporal context and motion complexity , 2017, Multimedia Tools and Applications.

[41]  Jun Zou,et al.  In vivo label-free photoacoustic flow cytography and on-the-spot laser killing of single circulating melanoma cells , 2016, Scientific Reports.

[42]  Zhongwen Cheng,et al.  3D depth-coded photoacoustic microscopy with a large field of view for human skin imaging , 2018 .

[43]  Chulhong Kim,et al.  3D PHOVIS: 3D photoacoustic visualization studio , 2020, Photoacoustics.