A Fast, Automated, Polynomial-Based Cosmic Ray Spike–Removal Method for the High-Throughput Processing of Raman Spectra

Raman spectra often contain undesirable, randomly positioned, intense, narrow-bandwidth, positive, unidirectional spectral features generated when cosmic rays strike charge-coupled device cameras. These must be removed prior to analysis, but doing so manually is not feasible for large data sets. We developed a quick, simple, effective, semi-automated procedure to remove cosmic ray spikes from spectral data sets that contain large numbers of relatively homogenous spectra. Although some inhomogeneous spectral data sets can be accommodated—it requires replacing excessively modified spectra with the originals and removing their spikes with a median filter instead—caution is advised when processing such data sets. In addition, the technique is suitable for interpolating missing spectra or replacing aberrant spectra with good spectral estimates. The method is applied to baseline-flattened spectra and relies on fitting a third-order (or higher) polynomial through all the spectra at every wavenumber. Pixel intensities in excess of a threshold of 3 × the noise standard deviation above the fit are reduced to the threshold level. Because only two parameters (with readily specified default values) might require further adjustment, the method is easily implemented for semi-automated processing of large spectral sets.

[1]  J Popp,et al.  Micro-Raman spectroscopic identification of bacterial cells of the genus Staphylococcus and dependence on their cultivation conditions. , 2005, The Analyst.

[2]  H. G. Schulze,et al.  A Model-Free, Fully Automated Baseline-Removal Method for Raman Spectra , 2011, Applied spectroscopy.

[3]  Sheng Li,et al.  An Improved Algorithm to Remove Cosmic Spikes in Raman Spectra for Online Monitoring , 2011, Applied spectroscopy.

[4]  Yukihiro Ozaki,et al.  Practical Algorithm for Reducing Convex Spike Noises on a Spectrum , 2003, Applied spectroscopy.

[5]  G. Stein,et al.  Self‐renewal of human embryonic stem cells is supported by a shortened G1 cell cycle phase , 2006, Journal of cellular physiology.

[6]  Gavin Jell,et al.  Non‐invasive analysis of cell cycle dynamics in single living cells with Raman micro‐spectroscopy , 2008, Journal of cellular biochemistry.

[7]  Andrew Jirasek,et al.  Investigation of Selected Baseline Removal Techniques as Candidates for Automated Implementation , 2005, Applied spectroscopy.

[8]  H. G. Schulze,et al.  A Small-Window Moving Average-Based Fully Automated Baseline Estimation Method for Raman Spectra , 2012, Applied spectroscopy.

[9]  Hideo Takeuchi,et al.  Simple and Efficient Method to Eliminate Spike Noise from Spectra Recorded on Charge-Coupled Device Detectors , 1993 .

[10]  Ute B. Cappel,et al.  Removing Cosmic Ray Features from Raman Map Data by a Refined Nearest Neighbor Comparison Method as a Precursor for Chemometric Analysis , 2010, Applied spectroscopy.

[11]  T. Keiderling,et al.  Novel Use of a Static Modification of Two-Dimensional Correlation Analysis. Part I: Comparison of the Secondary Structure Sensitivity of Electronic Circular Dichroism, FT-IR, and Raman Spectra of Proteins , 1999 .

[12]  Jun Zhao,et al.  Image Curvature Correction and Cosmic Removal for High-Throughput Dispersive Raman Spectroscopy , 2003, Applied spectroscopy.

[13]  Jerilyn A. Timlin,et al.  Preprocessing Strategies to Improve MCR Analyses of Hyperspectral Images. , 2012 .

[14]  F Ehrentreich,et al.  Spike removal and denoising of Raman spectra by wavelet transform methods. , 2001, Analytical chemistry.

[15]  Michael D. Morris,et al.  Automated Raman spectral preprocessing of bone and other musculoskeletal tissues , 2009, BiOS.

[16]  J. Thomson,et al.  Embryonic stem cell lines derived from human blastocysts. , 1998, Science.

[17]  H Georg Schulze,et al.  Automated Estimation of White Gaussian Noise Level in a Spectrum with or without Spike Noise Using a Spectral Shifting Technique , 2006, Applied spectroscopy.

[18]  Lin Zhang,et al.  A Practical Algorithm to Remove Cosmic Spikes in Raman Imaging Data for Pharmaceutical Applications , 2007, Applied spectroscopy.

[19]  Christoph Krafft,et al.  Studies on stress-induced changes at the subcellular level by Raman microspectroscopic mapping. , 2006, Analytical chemistry.

[20]  H. Georg Schulze,et al.  Raman Microscopy-Based Cytochemical Investigations of Potential Niche-Forming Inhomogeneities Present in Human Embryonic Stem Cell Colonies , 2011, Applied spectroscopy.

[21]  Michael D. Morris,et al.  Identification of Outliers in Hyperspectral Raman Image Data by Nearest Neighbor Comparison , 2002 .

[22]  Wee Chew,et al.  Information‐theoretic chemometric analyses of Raman data for chemical reaction studies , 2011 .

[23]  H. G. Schulze,et al.  In situ analysis of living embryonic stem cells by coherent anti-stokes Raman microscopy. , 2007, Analytical chemistry.

[24]  D. E. Aston,et al.  Automatic Baseline Subtraction of Vibrational Spectra Using Minima Identification and Discrimination via Adaptive, Least-Squares Thresholding , 2012, Applied spectroscopy.