A Practical Algorithm to Remove Cosmic Spikes in Raman Imaging Data for Pharmaceutical Applications

Raman dispersive microscopic imaging techniques are finding ever-increasing applications in pharmaceutical research for their ability to provide spatial and spectral information about the sample. Spectral data acquired from dispersive Raman instruments utilizing charge-coupled device detectors are characterized by occasional high intensity spikes arising from cosmic ray events. These random cosmic spikes are superimposed on chemically meaningful spectra. Due to their high intensity and potential influence on variance structures, it is often crucial to filter cosmic spikes from data prior to the use of multivariate algorithms to extract chemical information from the image cube. Some extremely challenging cosmic spikes are found to seriously interfere with multivariate data analysis for our application, e.g., spikes with bandwidth greater than the bandwidth from species of interest, spikes in neighboring image pixels occurring at the same spectral channels, spikes right on top of the band of interest, etc. A practical algorithm is proposed for semi-automated cosmic spike removal. The algorithm is computationally efficient, conceptually simple, and easy to implement. It is an alternative to methods using repetitive measurements by taking advantage of the spatial characteristic of imaging techniques and existing knowledge from the formulation. The algorithm has been shown to generate recovered spectra with negligible spectral distortion. The utility of the algorithm will be illustrated by the analysis of Raman images of pharmaceutical samples.

[1]  Joel M. Harris,et al.  Polynomial filters for data sets with outlying or missing observations: application to charge-coupled-device-detected Raman spectra contaminated by cosmic rays , 1990 .

[2]  F Ehrentreich,et al.  Spike removal and denoising of Raman spectra by wavelet transform methods. , 2001, Analytical chemistry.

[3]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[4]  W. Hill,et al.  Spike-correction of weak signals from charge-coupled devices and its application to Raman spectroscopy , 1992 .

[5]  Lin Zhang,et al.  Drug Characterization in Low Dosage Pharmaceutical Tablets Using Raman Microscopic Mapping , 2006, Applied spectroscopy.

[6]  Conrad Bessant,et al.  Principal components analysis for the visualisation of multidimensional chemical data acquired by scanning Raman microspectroscopy. , 2002, The Analyst.

[7]  Volker Deckert,et al.  Application of principal component analysis to detect outliers and spectral deviations in near-field surface-enhanced Raman spectra , 2001 .

[8]  S. Sonja Sekulic,et al.  Multivariate data analysis for Raman imaging of a model pharmaceutical tablet , 2005 .

[9]  Dor Ben-Amotz,et al.  Stripping of Cosmic Spike Spectral Artifacts Using a New Upper-Bound Spectrum Algorithm , 2001 .

[10]  Dor Ben-Amotz,et al.  Removal of Cosmic Spikes from Hyper-Spectral Images Using a Hybrid Upper-Bound Spectrum Method , 2002 .

[11]  F. Clarke,et al.  Chemical image fusion. The synergy of FT-NIR and Raman mapping microscopy to enable a more complete visualization of pharmaceutical formulations. , 2001, Analytical chemistry.

[12]  Hideo Takeuchi,et al.  Simple and Efficient Method to Eliminate Spike Noise from Spectra Recorded on Charge-Coupled Device Detectors , 1993 .

[13]  Michael D. Morris,et al.  Identification of Outliers in Hyperspectral Raman Image Data by Nearest Neighbor Comparison , 2002 .

[14]  Dor Ben-Amotz,et al.  Single Scan Cosmic Spike Removal Using the Upper Bound Spectrum Method , 2003, Applied spectroscopy.

[15]  Jun Zhao,et al.  Image Curvature Correction and Cosmic Removal for High-Throughput Dispersive Raman Spectroscopy , 2003, Applied spectroscopy.

[16]  Yukihiro Ozaki,et al.  Practical Algorithm for Reducing Convex Spike Noises on a Spectrum , 2003, Applied spectroscopy.

[17]  Martin J. Snowden,et al.  A comparison of Raman chemical images produced by univariate and multivariate data processing—a simulation with an example from pharmaceutical practice , 2004 .