Deep learning and artificial intelligence methods for Raman and surface-enhanced Raman scattering

Abstract Machine learning is shaping up our lives in many ways. In analytical sciences, machine learning provides an unprecedented opportunity to extract information from complex or big datasets in chromatography, mass spectrometry, NMR, and spectroscopy, among others. This is especially the case in Raman and surface-enhanced Raman scattering (SERS) techniques where vibrational spectra of complex chemical mixtures are acquired as large datasets for the analysis or imaging of chemical systems. The classical linear methods of processing the information no longer suffice and thus machine learning methods for extracting the chemical information from Raman and SERS experiments have been implemented recently. In this review, we will provide a brief overview of the most common machine learning techniques employed in Raman, a guideline for new users to implement machine learning in their data analysis process, and an overview of modern applications of machine learning in Raman and SERS.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  J Popp,et al.  Micro-Raman spectroscopic identification of bacterial cells of the genus Staphylococcus and dependence on their cultivation conditions. , 2005, The Analyst.

[3]  Zou Xiaobo,et al.  Variables selection methods in near-infrared spectroscopy. , 2010, Analytica chimica acta.

[4]  D. Ni,et al.  Design of a silver nanoparticle for sensitive surface enhanced Raman spectroscopy detection of carmine dye. , 2017, Food chemistry.

[5]  R. V. Van Duyne,et al.  Seeing through bone with surface-enhanced spatially offset Raman spectroscopy. , 2013, Journal of the American Chemical Society.

[6]  Rong Chen,et al.  Application of silver nanoparticle‐based SERS spectroscopy for DNA analysis in radiated nasopharyngeal carcinoma cells , 2013 .

[7]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[8]  Ji-Ho Park,et al.  Exosome Classification by Pattern Analysis of Surface-Enhanced Raman Spectroscopy Data for Lung Cancer Diagnosis. , 2017, Analytical chemistry.

[9]  Dong Liang,et al.  Detection of Pirimiphos-Methyl in Wheat Using Surface-Enhanced Raman Spectroscopy and Chemometric Methods , 2019, Molecules.

[10]  Saba Ranjbar,et al.  SERS-based Odor Compass: Locating Multiple Chemical Sources and Pathogens. , 2019, ACS sensors.

[11]  Linnéa Ahlinder,et al.  On the use of spectra from portable Raman and ATR-IR instruments in synthesis route attribution of a chemical warfare agent by multivariate modeling. , 2018, Talanta.

[12]  Yun Xu,et al.  Support Vector Machines: A Recent Method for Classification in Chemometrics , 2006 .

[13]  Kan Wang,et al.  Breath Analysis Based on Surface-Enhanced Raman Scattering Sensors Distinguishes Early and Advanced Gastric Cancer Patients from Healthy Persons. , 2016, ACS nano.

[14]  E. Fortunato,et al.  Label-free nanosensing platform for breast cancer exosome profiling. , 2019, ACS sensors.

[15]  Belle R. Upadhyaya,et al.  Chemometric Data Analysis Using Artificial Neural Networks , 1993 .

[16]  Giancarlo Zaccone Getting Started with TensorFlow , 2016 .

[17]  K. Kachrimanis,et al.  Artificial neural networks (ANNs) and partial least squares (PLS) regression in the quantitative analysis of cocrystal formulations by Raman and ATR‐FTIR spectroscopy , 2018, Journal of pharmaceutical and biomedical analysis.

[18]  C. Gasser,et al.  Stand-off Hyperspectral Raman Imaging and Random Decision Forest Classification: A Potent Duo for the Fast, Remote Identification of Explosives. , 2019, Analytical chemistry.

[19]  Ian R. Lewis,et al.  Raman spectrometry and neural networks for the classification of wood types—1 , 1994 .

[20]  Alan X. Wang,et al.  Trace Detection of Tetrahydrocannabinol in Body Fluid via Surface-Enhanced Raman Scattering and Principal Component Analysis. , 2019, ACS sensors.

[21]  Lutgarde M. C. Buydens,et al.  Breaking with trends in pre-processing? , 2013 .

[22]  Tara N. Sainath,et al.  Deep convolutional neural networks for LVCSR , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Steven R. Emory,et al.  Probing Single Molecules and Single Nanoparticles by Surface-Enhanced Raman Scattering , 1997, Science.

[25]  S. Xie,et al.  Label-free detection of nasopharyngeal and liver cancer using surface-enhanced Raman spectroscopy and partial lease squares combined with support vector machine. , 2018, Biomedical optics express.

[26]  Kyle C. Doty,et al.  Differentiation of human blood from animal blood using Raman spectroscopy: A survey of forensically relevant species. , 2018, Forensic science international.

[27]  David I. Ellis,et al.  Metabolic fingerprinting in disease diagnosis: biomedical applications of infrared and Raman spectroscopy. , 2006, The Analyst.

[28]  T. Ciodaro,et al.  Online particle detection with Neural Networks based on topological calorimetry information , 2012 .

[29]  Y. Huang,et al.  Non-invasive detection of hepatocellular carcinoma serum metabolic profile through surface-enhanced Raman spectroscopy. , 2016, Nanomedicine : nanotechnology, biology, and medicine.

[30]  Kyle C. Doty,et al.  Differentiating Donor Age Groups Based on Raman Spectroscopy of Bloodstains for Forensic Purposes , 2018, ACS central science.

[31]  K. Chawla,et al.  A micro-Raman and chemometric study of urinary tract infection-causing bacterial pathogens in mixed cultures , 2019, Analytical and Bioanalytical Chemistry.

[32]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[33]  Zhimin Zhang,et al.  Deep learning-based component identification for the Raman spectra of mixtures. , 2019, The Analyst.

[34]  Yibin Ying,et al.  Deep learning for vibrational spectral analysis: Recent progress and a practical guide. , 2019, Analytica chimica acta.

[35]  D B Kell,et al.  Rapid identification of urinary tract infection bacteria using hyperspectral whole-organism fingerprinting and artificial neural networks. , 1998, Microbiology.

[36]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[37]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[38]  Ankit Bansal,et al.  Chemometrics tools used in analytical chemistry: an overview. , 2014, Talanta.

[39]  I. Lednev,et al.  Determining Gender by Raman Spectroscopy of a Bloodstain. , 2017, Analytical chemistry.

[40]  Youtao Song,et al.  Raman spectroscopy combined with principal component analysis and k nearest neighbour analysis for non-invasive detection of colon cancer , 2016 .

[41]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[42]  Pavel Zemánek,et al.  Rapid identification of staphylococci by Raman spectroscopy , 2017, Scientific Reports.

[43]  Asifullah Khan,et al.  Analysis of dengue infection based on Raman spectroscopy and support vector machine (SVM). , 2016, Biomedical optics express.

[44]  P. Guttmann,et al.  Optical Nanosensing of Lipid Accumulation due to Enzyme Inhibition in Live Cells. , 2019, ACS nano.

[45]  Royston Goodacre,et al.  Rapid identification of closely related muscle foods by vibrational spectroscopy and machine learning. , 2005, The Analyst.

[46]  N. Nuntawong,et al.  Tuberculosis determination using SERS and chemometric methods. , 2018, Tuberculosis.

[47]  Vaishali Ganganwar,et al.  An overview of classification algorithms for imbalanced datasets , 2012 .

[48]  Margarita Osadchy,et al.  Deep Convolutional Neural Networks for Raman Spectrum Recognition: A Unified Solution , 2017, The Analyst.

[49]  Brendan J. Frey,et al.  Deep learning of the tissue-regulated splicing code , 2014, Bioinform..

[50]  Tianyue Yang,et al.  Noninvasive liver diseases detection based on serum surface enhanced Raman spectroscopy and statistical analysis. , 2015, Optics express.

[51]  J. Qin,et al.  Label-free Raman imaging of live osteosarcoma cells with multivariate analysis , 2019, Applied Microbiology and Biotechnology.

[52]  Asifullah Khan,et al.  Raman spectroscopy based analysis of milk using random forest classification , 2018, Vibrational Spectroscopy.

[53]  Dieter Naumann,et al.  Infrared and NIR Raman spectroscopy in medical microbiology , 1998, Photonics West - Biomedical Optics.

[54]  David I. Ellis,et al.  A tutorial review: Metabolomics and partial least squares-discriminant analysis--a marriage of convenience or a shotgun wedding. , 2015, Analytica chimica acta.

[55]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[56]  Tamiki Komatsuzaki,et al.  High-Resolution Raman Microscopic Detection of Follicular Thyroid Cancer Cells with Unsupervised Machine Learning. , 2019, The journal of physical chemistry. B.

[57]  An Hendrix,et al.  Identification of Individual Exosome-Like Vesicles by Surface Enhanced Raman Spectroscopy. , 2016, Small.

[58]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[59]  S. Mor-Yosef,et al.  Ranking the Risk Factors for Cesarean: Logistic Regression Analysis of a Nationwide Study , 1990, Obstetrics and gynecology.

[60]  Bin Xu,et al.  Elucidating fentanyls differentiation from morphines in chemical and biological samples with surface‐enhanced Raman spectroscopy , 2019, Electrophoresis.

[61]  Lars Kai Hansen,et al.  Detection of skin cancer by classification of Raman spectra , 2004, IEEE Transactions on Biomedical Engineering.

[62]  Cees Otto,et al.  Label-Free Prostate Cancer Detection by Characterization of Extracellular Vesicles Using Raman Spectroscopy , 2018, Analytical chemistry.

[63]  Z. Nagy,et al.  Application of artificial neural networks for Process Analytical Technology-based dissolution testing. , 2019, International journal of pharmaceutics.

[64]  H. Wulf,et al.  Diagnosis of Basal Cell Carcinoma by Raman Spectroscopy , 1997 .

[65]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  E. K. Kemsley,et al.  A comparison of mid-infrared and raman spectroscopies for the authentication of edible oils , 1998 .

[67]  I. Lednev,et al.  Bloodstains, paintings, and drugs: Raman spectroscopy applications in forensic science , 2018 .

[68]  C. Meinhart,et al.  Dielectrophoretic Nanoparticle Aggregation for On-Demand Surface Enhanced Raman Spectroscopy Analysis. , 2018, Analytical chemistry.

[69]  Edgar Guevara,et al.  Use of Raman spectroscopy to screen diabetes mellitus with machine learning tools. , 2018, Biomedical optics express.

[70]  B. Frey,et al.  The human splicing code reveals new insights into the genetic determinants of disease , 2015, Science.

[71]  Haihua Xu,et al.  Maximum F1-Score Discriminative Training Criterion for Automatic Mispronunciation Detection , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[72]  Effendi Widjaja,et al.  A novel method for human gender classification using Raman spectroscopy of fingernail clippings. , 2008, The Analyst.

[73]  Tao Zhang,et al.  Tongue squamous cell carcinoma discrimination with Raman spectroscopy and convolutional neural networks , 2019, Vibrational Spectroscopy.

[74]  I. Boyaci,et al.  Determination of butter adulteration with margarine using Raman spectroscopy. , 2013, Food chemistry.

[75]  Xiaoyu Cui,et al.  Analysis and classification of kidney stones based on Raman spectroscopy , 2018, Biomedical optics express.

[76]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[77]  D. Ni,et al.  Rapid qualitative and quantitative determination of food colorants by both Raman spectra and Surface-enhanced Raman Scattering (SERS). , 2018, Food chemistry.

[78]  Hongbin Pu,et al.  Determination of trace thiophanate-methyl and its metabolite carbendazim with teratogenic risk in red bell pepper (Capsicumannuum L.) by surface-enhanced Raman imaging technique. , 2017, Food chemistry.

[79]  Qingbo Li,et al.  An improved k-nearest neighbour method to diagnose breast cancer. , 2018, The Analyst.

[80]  Michelle A. Brusatori,et al.  Rapid Detection of Clostridium difficile Toxins in Stool by Raman Spectroscopy. , 2019, The Journal of surgical research.

[81]  Royston Goodacre,et al.  Quantitative Analysis of the Banned Food Dye Sudan-1 Using Surface Enhanced Raman Scattering with Multivariate Chemometrics† , 2010 .

[82]  Asifullah Khan,et al.  Analysis of hepatitis C infection using Raman spectroscopy and proximity based classification in the transformed domain. , 2018, Biomedical optics express.

[83]  Vladimir Estivill-Castro,et al.  Why so many clustering algorithms: a position paper , 2002, SKDD.

[84]  J. Yu,et al.  Highly Reproducible Au-Decorated ZnO Nanorod Array on a Graphite Sensor for Classification of Human Aqueous Humors. , 2017, ACS applied materials & interfaces.

[85]  M. Omid,et al.  Determining quality of caviar from Caspian Sea based on Raman spectroscopy and using artificial neural networks. , 2013, Talanta.

[86]  Rong Chen,et al.  A noninvasive cancer detection strategy based on gold nanoparticle surface-enhanced raman spectroscopy of urinary modified nucleosides isolated by affinity chromatography. , 2017, Biosensors & bioelectronics.

[87]  G. Bitan,et al.  A Label-Free Platform for Identification of Exosomes from Different Sources. , 2019, ACS sensors.

[88]  Jinling Zhao,et al.  Fast detection of fenthion on fruit and vegetable peel using dynamic surface-enhanced Raman spectroscopy and random forests with variable selection. , 2018, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[89]  Asifullah Khan,et al.  Random Forest-Based Evaluation of Raman Spectroscopy for Dengue Fever Analysis , 2017, Applied spectroscopy.

[90]  Yeonho Choi,et al.  Identification of Newly Emerging Influenza Viruses by Detecting the Virally Infected Cells Based on Surface Enhanced Raman Spectroscopy and Principal Component Analysis. , 2019, Analytical chemistry.

[91]  N. Shah,et al.  Surface-enhanced Raman spectroscopy. , 2008, Annual review of analytical chemistry.

[92]  Jürgen Popp,et al.  Culture independent Raman spectroscopic identification of urinary tract infection pathogens: a proof of principle study. , 2013, Analytical chemistry.

[93]  R. Dasari,et al.  Single Molecule Detection Using Surface-Enhanced Raman Scattering (SERS) , 1997 .

[94]  J. Yu,et al.  Paper-Based Surface-Enhanced Raman Spectroscopy for Diagnosing Prenatal Diseases in Women. , 2018, ACS nano.

[95]  Carlos Escobedo,et al.  Rapid identification and quantification of illicit drugs on nanodendritic surface-enhanced Raman scattering substrates , 2018 .

[96]  Itthi Chatnuntawech,et al.  A simple paper-based surface enhanced Raman scattering (SERS) platform and magnetic separation for cancer screening , 2019, Sensors and Actuators B: Chemical.

[97]  Nicholas Stone,et al.  Current trends in machine-learning methods applied to spectroscopic cancer diagnosis , 2014 .

[98]  J. Masson,et al.  Machine-Learning-Driven Surface-Enhanced Raman Scattering Optophysiology Reveals Multiplexed Metabolite Gradients Near Cells. , 2019, ACS nano.

[99]  Robert P. Sheridan,et al.  Deep Neural Nets as a Method for Quantitative Structure-Activity Relationships , 2015, J. Chem. Inf. Model..

[100]  Pierre Margot,et al.  Identification of pharmaceutical tablets by Raman spectroscopy and chemometrics. , 2010, Talanta.

[101]  Arman Mohseni-Kabir,et al.  Machine learning algorithms enhance the specificity of cancer biomarker detection using SERS-based immunoassays in microfluidic chips , 2019, RSC advances.

[102]  Stefano Ermon,et al.  Rapid identification of pathogenic bacteria using Raman spectroscopy and deep learning , 2019, Nature Communications.