Applications of hyperspectral imaging in the detection and diagnosis of solid tumors

Hyperspectral imaging (HSI) is an emerging new technology in solid tumor diagnosis and detection. It incorporates traditional imaging and spectroscopy together to obtain both spatial and spectral information from tissues simultaneously in a non-invasive manner. This imaging modality is based on the principle that different tissues inherit different spectral reflectance responses that present as unique spectral fingerprints. HSI captures those composition-specific fingerprints to identify cancerous and normal tissues. It becomes a promising tool for performing tumor diagnosis and detection from the label-free histopathological examination to real-time intraoperative assistance. This review introduces the basic principles of HSI and summarizes its methodology and recent advances in solid tumor detection. In particular, the advantages of HSI applied to solid tumors are highlighted to show its potential for clinical use.

[1]  G. Menzies,et al.  Fourier transform infrared for noninvasive optical diagnosis of oral, oropharyngeal, and laryngeal cancer. , 2014, Translational research : the journal of laboratory and clinical medicine.

[2]  Y. Kosugi,et al.  Cancer detection using infrared hyperspectral imaging , 2011, Cancer science.

[3]  R. Weissleder,et al.  Advancing biomedical imaging , 2015, Proceedings of the National Academy of Sciences.

[4]  Klaus Gerwert,et al.  Quantum Cascade Laser-Based Infrared Microscopy for Label-Free and Automated Cancer Classification in Tissue Sections , 2018, Scientific reports.

[5]  Sebastien Ourselin,et al.  Intraoperative multispectral and hyperspectral label‐free imaging: A systematic review of in vivo clinical studies , 2019, Journal of biophotonics.

[6]  Dmitry G. Revin,et al.  Sensitivity Advantage of QCL Tunable-Laser Mid-Infrared Spectroscopy Over FTIR Spectroscopy , 2015 .

[7]  Esther Kho,et al.  Hyperspectral Imaging for Resection Margin Assessment during Cancer Surgery , 2019, Clinical Cancer Research.

[8]  Anouk L. Post,et al.  Imaging depth variations in hyperspectral imaging: Development of a method to detect tumor up to the required tumor‐free margin width , 2019, Journal of biophotonics.

[9]  Max Diem,et al.  Immunohistochemistry, histopathology and infrared spectral histopathology of colon cancer tissue sections , 2013, Journal of biophotonics.

[10]  A. N. Bashkatov,et al.  Optical properties of human skin, subcutaneous and mucous tissues in the wavelength range from 400 to 2000 nm , 2005 .

[11]  Guolan Lu,et al.  Framework for hyperspectral image processing and quantification for cancer detection during animal tumor surgery , 2015, Journal of biomedical optics.

[12]  Olaf Hellwich,et al.  A review of graph-based methods for image analysis in digital histopathology , 2015 .

[13]  J. Popp,et al.  Tumor margin identification and prediction of the primary tumor from brain metastases using FTIR imaging and support vector machines. , 2013, The Analyst.

[14]  M. Kon,et al.  Classification of malignant and benign tumors of the lung by infrared spectral histopathology (SHP) , 2015, Laboratory Investigation.

[15]  Michel Manfait,et al.  Combination of FTIR spectral imaging and chemometrics for tumour detection from paraffin-embedded biopsies. , 2008, The Analyst.

[16]  Keerthana Prasad,et al.  Medical imaging techniques and computer aided diagnostic approaches for the detection of breast cancer with an emphasis on thermography - a review , 2016, Int. J. Medical Eng. Informatics.

[17]  J. Cadeddu,et al.  Assessment of renal oxygenation during partial nephrectomy using hyperspectral imaging. , 2010, Journal of Urology.

[18]  Nihal Simsek Ozek,et al.  Fourier Transform Infrared Spectroscopy and Imaging in Cancer Diagnosis and Characterization , 2015 .

[19]  D. Ferris,et al.  Multimodal Hyperspectral Imaging for the Noninvasive Diagnosis of Cervical Neoplasia , 2001, Journal of lower genital tract disease.

[20]  Tingting Fang,et al.  A study of structural differences between liver cancer cells and normal liver cells using FTIR spectroscopy , 2015 .

[21]  Vishal K. Varma,et al.  Infrared spectroscopic imaging: Label-free biochemical analysis of stroma and tissue fibrosis. , 2017, The international journal of biochemistry & cell biology.

[22]  Tomasz S. Tkaczyk,et al.  Multimodal snapshot spectral imaging for oral cancer diagnostics: a pilot study , 2013, Biomedical optics express.

[23]  M. Mihm,et al.  The performance of MelaFind: a prospective multicenter study. , 2011, Archives of dermatology.

[24]  M. Diem,et al.  Resolving Interobserver Discrepancies in Lung Cancer Diagnoses by Spectral Histopathology. , 2018, Archives of pathology & laboratory medicine.

[25]  M. Diem,et al.  Spectral histopathology of the lung: A review of two large studies , 2019, Journal of biophotonics.

[26]  Antonella I. Mazur,et al.  Cancer screening via infrared spectral cytopathology (SCP): results for the upper respiratory and digestive tracts. , 2016, The Analyst.

[27]  Xiguang Wang,et al.  Image enhancement based on in vivo hyperspectral gastroscopic images: a case study , 2016, Journal of biomedical optics.

[28]  C. Sotiriou,et al.  Characterization of human breast cancer tissues by infrared imaging. , 2016, The Analyst.

[29]  B. S. Manjunath,et al.  Utility of multispectral imaging for nuclear classification of routine clinical histopathology imagery , 2007, BMC Cell Biology.

[30]  Benjamin Bird,et al.  The Infrared Spectral Signatures of Disease: Extracting the Distinguishing Spectral Features between Normal and Diseased States , 2009, Applied spectroscopy.

[31]  Nicholas Stone,et al.  Mid-IR hyperspectral imaging for label-free histopathology and cytology , 2018 .

[32]  Dang Khoa Nguyen,et al.  Intraoperative video-rate hemodynamic response assessment in human cortex using snapshot hyperspectral optical imaging , 2016, Neurophotonics.

[33]  Sajib Chakraborty,et al.  The difficulties in cancer treatment , 2012, Ecancermedicalscience.

[34]  Baowei Fei,et al.  In-Vivo and Ex-Vivo Tissue Analysis through Hyperspectral Imaging Techniques: Revealing the Invisible Features of Cancer , 2019, Cancers.

[35]  Boreom Lee,et al.  Smartphone-based multispectral imaging: system development and potential for mobile skin diagnosis. , 2016, Biomedical optics express.

[36]  M. Dewhirst,et al.  Hyperspectral imaging of hemoglobin saturation in tumor microvasculature and tumor hypoxia development. , 2005, Journal of biomedical optics.

[37]  B. Hooper Optical-thermal response of laser-irradiated tissue , 1996 .

[38]  Amy Y. Chen,et al.  Detection and delineation of squamous neoplasia with hyperspectral imaging in a mouse model of tongue carcinogenesis , 2018, Journal of biophotonics.

[39]  Liang Gao,et al.  Optical hyperspectral imaging in microscopy and spectroscopy – a review of data acquisition , 2015, Journal of biophotonics.

[40]  Henricus J C M Sterenborg,et al.  Hyperspectral imaging for tissue classification, a way toward smart laparoscopic colorectal surgery , 2019, Journal of biomedical optics.

[41]  Max Diem,et al.  Statistical analysis of a lung cancer spectral histopathology (SHP) data set. , 2015, The Analyst.

[42]  Nicolas Guerineau,et al.  Miniature and cooled hyperspectral camera for outdoor surveillance applications in the mid-infrared. , 2016, Optics letters.

[43]  Dongsheng Wang,et al.  Spectral-spatial classification for noninvasive cancer detection using hyperspectral imaging , 2014, Journal of biomedical optics.

[44]  E. Goormaghtigh,et al.  Application of Fourier Transform Infrared (FTIR) Spectroscopy and Atomic Force Microscopy in Stroke- Affected Brain Tissue. , 2016 .

[45]  L. Stassen,et al.  Near-Infrared Fluorescence Imaging for Real-Time Intraoperative Anatomical Guidance in Minimally Invasive Surgery: A Systematic Review of the Literature , 2015, World Journal of Surgery.

[46]  Chao Wang,et al.  Multimodal Biomedical Optical Imaging Review: Towards Comprehensive Investigation of Biological Tissues , 2015 .

[47]  P. Gardner,et al.  Quantum Cascade Laser Spectral Histopathology: Breast Cancer Diagnostics Using High Throughput Chemical Imaging. , 2017, Analytical chemistry.

[48]  J. Fujimoto,et al.  Optical coherence tomography: an emerging technology for biomedical imaging and optical biopsy. , 2000, Neoplasia.

[49]  A. Singh,et al.  Inflammation, immunosuppressive microenvironment and breast cancer: opportunities for cancer prevention and therapy. , 2019, Annals of translational medicine.

[50]  K. Kochan,et al.  Biomedical Application of Raman and FT‐IR Spectroscopies: Label‐Free Imaging of Liver Insult , 2017 .

[51]  Freddy T. Nguyen,et al.  Optical coherence tomography: a review of clinical development from bench to bedside. , 2007, Journal of biomedical optics.

[52]  Benjamin Bird,et al.  Detection of breast micro-metastases in axillary lymph nodes by infrared micro-spectral imaging. , 2009, The Analyst.

[53]  Shiwu Zhang,et al.  Multi-scale hyperspectral imaging of cervical neoplasia , 2016, Archives of Gynecology and Obstetrics.

[54]  Jörg Bendix,et al.  Hyperspectral Imaging Using Flexible Endoscopy for Laryngeal Cancer Detection , 2016, Sensors.

[55]  Ihtesham ur Rehman,et al.  Advances in Fourier transform infrared (FTIR) spectroscopy of biological tissues , 2017 .

[56]  Qionghai Dai,et al.  Snapshot Hyperspectral Volumetric Microscopy , 2016, Scientific Reports.

[57]  E Goormaghtigh,et al.  Infrared imaging of primary melanomas reveals hints of regional and distant metastases. , 2015, The Analyst.

[58]  B. Wilson,et al.  Measurement of Ex Vivo and In Vivo Tissue Optical Properties: Methods and Theories , 2010 .

[59]  James V. Little,et al.  Label-free reflectance hyperspectral imaging for tumor margin assessment: a pilot study on surgical specimens of cancer patients , 2017, Journal of biomedical optics.

[60]  Yoshihiko Hamamoto,et al.  Use of hyperspectral imaging technology to develop a diagnostic support system for gastric cancer , 2015, Journal of biomedical optics.

[61]  D. Manolakis,et al.  Hyperspectral Imaging Remote Sensing: Physics, Sensors, and Algorithms , 2016 .

[62]  Laura Marcu,et al.  Label-free optical imaging technologies for rapid translation and use during intraoperative surgical and tumor margin assessment , 2017, Journal of biomedical optics.

[63]  Guang-Zhong Yang,et al.  Spatio-spectral classification of hyperspectral images for brain cancer detection during surgical operations , 2018, PloS one.

[64]  In vivo hyperspectral analysis of skin hemoglobin and melanin content for neoplasia detection , 2018, Journal of Biomedical Photonics & Engineering.

[65]  Ran Li,et al.  Imaging infrared spectroscopy for fixation-free liver tumor detection , 2014, Photonics West - Biomedical Optics.

[66]  Ji-Xin Cheng,et al.  Nonlinear Optical Imaging to Evaluate the Impact of Obesity on Mammary Gland and Tumor Stroma , 2007, Molecular imaging.

[67]  Thomas Brüning,et al.  Marker-free automated histopathological annotation of lung tumour subtypes by FTIR imaging. , 2015, The Analyst.

[68]  Alex Henderson,et al.  Infrared spectral histopathology using haematoxylin and eosin (H&E) stained glass slides: a major step forward towards clinical translation. , 2017, The Analyst.

[69]  A. Jemal,et al.  Cancer statistics in China, 2015 , 2016, CA: a cancer journal for clinicians.

[70]  Guolan Lu,et al.  Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging , 2017, Journal of biomedical optics.

[71]  G. Steiner,et al.  Identification of kidney tumor tissue by infrared spectroscopy of extracellular matrix. , 2014, Journal of biomedical optics.

[72]  Hoong-Ta Lim,et al.  A four-dimensional snapshot hyperspectral video-endoscope for bio-imaging applications , 2016, Scientific Reports.

[73]  Guang-Zhong Yang,et al.  An Intraoperative Visualization System Using Hyperspectral Imaging to Aid in Brain Tumor Delineation , 2018, Sensors.

[74]  Umberto Veronesi,et al.  Global cancer surgery: delivering safe, affordable, and timely cancer surgery. , 2015, The Lancet. Oncology.

[75]  Wolfgang A Weber,et al.  Monitoring cancer treatment with PET/CT: does it make a difference? , 2007, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[76]  S. Riethdorf Detection of microRNAs in circulating tumor cells , 2018 .

[77]  Martin Halicek,et al.  Optical biopsy of head and neck cancer using hyperspectral imaging and convolutional neural networks , 2018, BiOS.

[78]  Masahiro Ishikawa,et al.  Tissue classification of liver pathological tissue specimens image using spectral features , 2017, Medical Imaging.

[79]  Andreas Tünnermann,et al.  5D hyperspectral imaging: fast and accurate measurement of surface shape and spectral characteristics using structured light. , 2018, Optics express.

[80]  Shiwu Zhang,et al.  Hyperspectral wide gap second derivative analysis for in vivo detection of cervical intraepithelial neoplasia , 2015, Journal of biomedical optics.

[81]  Nita Ahuja,et al.  Automated diagnosis of colon cancer using hyperspectral sensing , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[82]  Da-Wen Sun,et al.  Hyperspectral imaging technique for evaluating food quality and safety during various processes: A review of recent applications , 2017 .

[83]  James V. Little,et al.  Detection of Head and Neck Cancer in Surgical Specimens Using Quantitative Hyperspectral Imaging , 2017, Clinical Cancer Research.

[84]  D. Seehofer,et al.  Hyperspectral Imaging (HSI) in anatomic left liver resection , 2019, International journal of surgery case reports.

[85]  M. Bawendi,et al.  A colloidal quantum dot spectrometer , 2015, Nature.

[86]  M. Pilling,et al.  Fundamental Developments in Infrared Spectroscopic Imaging for Biomedical Applications , 2016 .

[87]  Rohit Bhargava,et al.  Development of a practical spatial-spectral analysis protocol for breast histopathology using Fourier transform infrared spectroscopic imaging. , 2016, Faraday discussions.

[88]  S. Kozlov,et al.  In vivo hyperspectral imaging of skin malignant and benign tumors in visible spectrum , 2018 .

[89]  Yoshihiko Hamamoto,et al.  New method for detection of gastric cancer by hyperspectral imaging: a pilot study , 2013, Journal of biomedical optics.

[90]  Dirk Schadendorf,et al.  Metastatic status of sentinel lymph nodes in melanoma determined noninvasively with multispectral optoacoustic imaging , 2015, Science Translational Medicine.

[91]  Shuai Yuan,et al.  Integrated Optical Coherence Tomography (OCT) and Fluorescence Laminar Optical Tomography (FLOT) , 2010, IEEE Journal of Selected Topics in Quantum Electronics.

[92]  Christine Fink,et al.  Diagnostic performance of the MelaFind device in a real‐life clinical setting , 2017, Journal der Deutschen Dermatologischen Gesellschaft = Journal of the German Society of Dermatology : JDDG.

[93]  Behdad Dashtbozorg,et al.  Broadband hyperspectral imaging for breast tumor detection using spectral and spatial information. , 2019, Biomedical optics express.

[94]  R. Sahoo,et al.  Hyperspectral Remote Sensing , 2013, Encyclopedia of Mathematical Geosciences.

[95]  Guang-Zhong Yang,et al.  In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection , 2019, IEEE Access.

[96]  Martin Hohmann,et al.  In‐vivo multispectral video endoscopy towards in‐vivo hyperspectral video endoscopy , 2017, Journal of biophotonics.

[97]  E. Livingston,et al.  Characterization of a near-infrared laparoscopic hyperspectral imaging system for minimally invasive surgery. , 2007, Analytical chemistry.

[98]  Michael Walsh,et al.  Deep learning for FTIR histology: leveraging spatial and spectral features with convolutional neural networks. , 2019, The Analyst.

[99]  B. Wood,et al.  Comparison of FTIR transmission and transfection substrates for canine liver cancer detection. , 2015, The Analyst.

[100]  Christian A. Rees,et al.  Molecular portraits of human breast tumours , 2000, Nature.

[101]  James E. Evans,et al.  Multimodal hyperspectral optical microscopy , 2017 .

[102]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[103]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[104]  Vasilis Ntziachristos,et al.  Advances in real-time multispectral optoacoustic imaging and its applications , 2015, Nature Photonics.

[105]  Dongrong Xu,et al.  Review of spectral imaging technology in biomedical engineering: achievements and challenges , 2013, Journal of biomedical optics.

[106]  Dan Zhu,et al.  Visible and near-infrared spectroscopy for distinguishing malignant tumor tissue from benign tumor and normal breast tissues in vitro , 2013, Journal of biomedical optics.

[107]  A. Welch,et al.  Definitions and Overview of Tissue Optics , 2010 .

[108]  P. Lasch,et al.  Diagnosing benign and malignant lesions in breast tissue sections by using IR-microspectroscopy. , 2006, Biochimica et biophysica acta.

[109]  Nasir M. Rajpoot,et al.  Texture based classification of hyperspectral colon biopsy samples using CLBP , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[110]  M. Kon,et al.  Infrared spectral histopathology (SHP): a novel diagnostic tool for the accurate classification of lung cancer , 2012, Laboratory Investigation.

[111]  Yang Li,et al.  Optical molecular imaging for tumor detection and image-guided surgery. , 2018, Biomaterials.

[112]  Roberto Quevedo,et al.  Evaluation of Food Quality and Safety with Hyperspectral Imaging (HSI) , 2016, Food Engineering Reviews.

[113]  A. Giaccia,et al.  The unique physiology of solid tumors: opportunities (and problems) for cancer therapy. , 1998, Cancer research.

[114]  E. Goormaghtigh,et al.  Changes in the microenvironment of invading melanoma and carcinoma cells identified by FTIR imaging , 2015 .

[115]  E. Snellman,et al.  Hyperspectral imaging in detecting dermal invasion in lentigo maligna melanoma , 2017, The British journal of dermatology.

[116]  Dongsheng Wang,et al.  A Minimum Spanning Forest-Based Method for Noninvasive Cancer Detection With Hyperspectral Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[117]  Hagen Malberg,et al.  Hyperspectral imaging for monitoring oxygen saturation levels during normothermic kidney perfusion , 2016 .

[118]  Yoshihiko Hamamoto,et al.  Development of a Gastric Cancer Diagnostic Support System with a Pattern Recognition Method Using a Hyperspectral Camera , 2016, J. Sensors.

[119]  K. Lima,et al.  A decade (2004 – 2014) of FTIR prostate cancer spectroscopy studies: An overview of recent advancements , 2016 .