A Study on Image Quality in Polarization-Resolved Second Harmonic Generation Microscopy

Second harmonic generation (SHG) microscopy represents a very powerful tool for tissue characterization. Polarization-resolved SHG (PSHG) microscopy extends the potential of SHG, by exploiting the dependence of SHG signals on the polarization state of the excitation beam. Among others, this dependence translates to the fact that SHG images collected under different polarization configurations exhibit distinct characteristics in terms of content and appearance. These characteristics hold deep implications over image quality, as perceived by human observers or by image analysis methods custom designed to automatically extract a quality factor from digital images. Our work addresses this subject, by investigating how basic image properties and the outputs of no-reference image quality assessment methods correlate to human expert opinion in the case of PSHG micrographs. Our evaluation framework is based on SHG imaging of collagen-based ocular tissues under different linear and elliptical polarization states of the incident light.

[1]  Pablo Artal,et al.  Performance evaluation of a sensorless adaptive optics multiphoton microscope , 2016, Journal of microscopy.

[2]  F. Kao,et al.  Polarization resolved second harmonic microscopy. , 2017, Methods.

[3]  Alex ChiChung Kot,et al.  A Fast Approach for No-Reference Image Sharpness Assessment Based on Maximum Local Variation , 2014, IEEE Signal Processing Letters.

[4]  Hans Georg Breunig,et al.  Two-photon spectral fluorescence lifetime and second-harmonic generation imaging of the porcine cornea with a 12-femtosecond laser microscope , 2016, Journal of biomedical optics.

[5]  Takeshi Yasui,et al.  Determination of collagen fiber orientation in human tissue by use of polarization measurement of molecular second-harmonic-generation light. , 2004, Applied optics.

[6]  C. Vinegoni,et al.  Real-time high dynamic range laser scanning microscopy , 2016, Nature Communications.

[7]  Marie-Claire Schanne-Klein,et al.  Polarization-resolved second-harmonic generation in tendon upon mechanical stretching. , 2012, Biophysical journal.

[8]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jianxin Chen,et al.  Theoretical simulation study of linearly polarized light on microscopic second-harmonic generation in collagen type I. , 2009, Journal of biomedical optics.

[10]  S. Stanciu,et al.  Improved quantification of collagen anisotropy with polarization‐resolved second harmonic generation microscopy , 2017, Journal of biophotonics.

[11]  Hervé Rigneault,et al.  Generic model of the molecular orientational distribution probed by polarization-resolved second-harmonic generation , 2012 .

[12]  Paul Campagnola,et al.  Second Harmonic Generation Imaging Distinguishes Both High-Grade Dysplasia and Cancer from Normal Colonic Mucosa , 2014, Digestive Diseases and Sciences.

[13]  Z. Werb,et al.  The extracellular matrix: A dynamic niche in cancer progression , 2012, The Journal of cell biology.

[14]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[15]  Ivan V. Bajic,et al.  No-reference image quality assessment using statistical wavelet-packet features , 2016, Pattern Recognit. Lett..

[16]  Virginijus Barzda,et al.  Ultrastructural features of collagen in thyroid carcinoma tissue observed by polarization second harmonic generation microscopy. , 2015, Biomedical optics express.

[17]  Chen-Yuan Dong,et al.  Characterizing the thermally induced structural changes to intact porcine eye, part 1: second harmonic generation imaging of cornea stroma. , 2005, Journal of biomedical optics.

[18]  Atsushi Takahara,et al.  Three-dimensional analysis of collagen lamellae in the anterior stroma of the human cornea visualized by second harmonic generation imaging microscopy. , 2011, Investigative ophthalmology & visual science.

[19]  Oscar del Barco,et al.  Second harmonic generation signal in collagen fibers: role of polarization, numerical aperture, and wavelength. , 2012, Journal of biomedical optics.

[20]  Sergey Plotnikov,et al.  Second harmonic generation microscopy for quantitative analysis of collagen fibrillar structure , 2012, Nature Protocols.

[21]  Virginijus Barzda,et al.  Nonlinear optical properties of type I collagen fibers studied by polarization dependent second harmonic generation microscopy. , 2011, The journal of physical chemistry. B.

[22]  Pablo Artal,et al.  Adaptive optics multiphoton microscopy to study ex vivo ocular tissues. , 2010, Journal of biomedical optics.

[23]  Jürgen Popp,et al.  From molecular structure to tissue architecture: collagen organization probed by SHG microscopy , 2013, Journal of biophotonics.

[24]  Hui Ma,et al.  Reconstruction of complementary images in second harmonic generation microscopy. , 2006, Optics express.

[25]  W. Webb,et al.  Live tissue intrinsic emission microscopy using multiphoton-excited native fluorescence and second harmonic generation , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Juan M. Bueno,et al.  Perspectives on combining Nonlinear Laser Scanning Microscopy and Bag-of-Features data classification strategies for automated disease diagnostics , 2016 .

[27]  Yu Han,et al.  Novel no-reference image blur metric based on block-based discrete cosine transform statistics , 2010 .

[28]  Gaël Latour,et al.  In vivo structural imaging of the cornea by polarization-resolved second harmonic microscopy , 2011, Biomedical optics express.

[29]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[30]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[31]  Juan M Bueno,et al.  Polarization response of second-harmonic images for different collagen spatial distributions , 2016, Journal of biomedical optics.

[32]  Francisco J. Ávila,et al.  Analysis and quantification of collagen organization with the structure tensor in second harmonic microscopy images of ocular tissues. , 2015, Applied optics.

[33]  Brian Seed,et al.  Dynamic imaging of collagen and its modulation in tumors in vivo using second-harmonic generation , 2003, Nature Medicine.

[34]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[35]  Asm Shihavuddin,et al.  Smooth 2D manifold extraction from 3D image stack , 2017, Nature Communications.

[36]  Alberto Diaspro,et al.  Three‐dimensional (3D) backward and forward second harmonic generation (SHG) microscopy of biological tissues , 2008, Journal of biophotonics.

[37]  Sophie Brasselet,et al.  Polarization-resolved nonlinear microscopy: application to structural molecular and biological imaging , 2011 .

[38]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[39]  Karsten König,et al.  Motionless polarization-resolved second harmonic generation imaging of corneal collagen , 2015, Photonics West - Biomedical Optics.

[40]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Meisam Rakhshanfar,et al.  Sparsity-based no-reference image quality assessment for automatic denoising , 2018, Signal Image Video Process..

[42]  Chen-Yuan Dong,et al.  Multiphoton autofluorescence and second-harmonic generation imaging of the ex vivo porcine eye. , 2006, Investigative ophthalmology & visual science.

[43]  Juan M. Bueno,et al.  Analysis of spatial lamellar distribution from adaptive-optics second harmonic generation corneal images , 2013, Biomedical optics express.

[44]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[45]  John E. Eriksson,et al.  Image Quality Ranking Method for Microscopy , 2016, Scientific Reports.

[46]  Mark G. Eramian,et al.  Histogram equalization using neighborhood metrics , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[47]  Leslie M Loew,et al.  Second-harmonic imaging microscopy for visualizing biomolecular arrays in cells, tissues and organisms , 2003, Nature Biotechnology.

[48]  George A. Stanciu,et al.  SUM-MODIFIED-LAPLACIAN FUSION METHODS EXPERIMENTED ON IMAGE STACKS OF PHOTONIC QUANTUM RING LASER DEVICES COLLECTED BY CONFOCAL SCANNING LASER MICROSCOPY , 2011 .

[49]  Weisi Lin,et al.  No-Reference Image Blur Assessment Based on Discrete Orthogonal Moments , 2016, IEEE Transactions on Cybernetics.

[50]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[51]  Francisco J. Ávila,et al.  Polarization dependence of aligned collagen tissues imaged with second harmonic generation microscopy , 2015, Journal of biomedical optics.

[52]  Lina J. Karam,et al.  A no-reference perceptual image sharpness metric based on a cumulative probability of blur detection , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[53]  S. Gabarda,et al.  Blind image quality assessment through anisotropy. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[54]  A. Pena,et al.  Second harmonic imaging and scoring of collagen in fibrotic tissues. , 2007, Optics express.

[55]  K. C. A. Smith,et al.  An automatic focusing and astigmatism correction system for the SEM and CTEM , 1982 .

[56]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[57]  Anne E Carpenter,et al.  Workflow and Metrics for Image Quality Control in Large-Scale High-Content Screens , 2012, Journal of biomolecular screening.

[58]  Patrick Stoller,et al.  Polarization-modulated second harmonic generation in collagen. , 2002, Biophysical journal.

[59]  Roy E. Welsch,et al.  Experimenting Liver Fibrosis Diagnostic by Two Photon Excitation Microscopy and Bag-of-Features Image Classification , 2014, Scientific Reports.

[60]  Josef Bille,et al.  Second harmonic generation imaging of collagen fibrils in cornea and sclera. , 2005, Optics express.

[61]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[62]  Dinu Coltuc,et al.  Automated compensation of light attenuation in confocal microscopy by exact histogram specification , 2010, Microscopy research and technique.

[63]  R Redondo,et al.  Quality evaluation of microscopy and scanned histological images for diagnostic purposes. , 2012, Micron.

[64]  Jon Yngve Hardeberg,et al.  Full-Reference Image Quality Metrics , 2012 .

[65]  Trevor M. Benson,et al.  Effect of submicron deformations on the transmission of all-solid photonic bandgap fibre , 2016 .

[66]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[67]  Watt W Webb,et al.  Interpreting second-harmonic generation images of collagen I fibrils. , 2005, Biophysical journal.

[68]  Jon Y. Hardeberg,et al.  Full-Reference Image Quality Metrics: Classification and Evaluation , 2012, Found. Trends Comput. Graph. Vis..