Generalized unmixing model for multispectral flow cytometry utilizing nonsquare compensation matrices

Multispectral and hyperspectral flow cytometry (FC) instruments allow measurement of fluorescence or Raman spectra from single cells in flow. As with conventional FC, spectral overlap results in the measured signal in any given detector being a mixture of signals from multiple labels present in the analyzed cells. In contrast to traditional polychromatic FC, these devices utilize a number of detectors (or channels in multispectral detector arrays) that is larger than the number of labels, and no particular detector is a priori dedicated to the measurement of any particular label. This data‐acquisition modality requires a rigorous study and understanding of signal formation as well as unmixing procedures that are employed to estimate labels abundance. The simplest extension of the traditional compensation procedure to multispectral data sets is equivalent to an ordinary least‐square (LS) solution for estimating abundance of labels in individual cells. This process is identical to the technique employed for unmixing spectral data in various imaging fields. The present study shows that multispectral FC data violate key assumptions of the LS process, and use of the LS method may lead to unmixing artifacts, such as population distortion (spreading) and the presence of negative values in biomarker abundances. Various alternative unmixing techniques were investigated, including relative‐error minimization and variance‐stabilization transformations. The most promising results were obtained by performing unmixing using Poisson regression with an identity‐link function within a generalized linear model framework. This formulation accounts for the presence of Poisson noise in the model of signal formation and subsequently leads to superior unmixing results, particularly for dim fluorescent populations. The proposed Poisson unmixing technique is demonstrated using simulated 8‐channel, 2‐fluorochrome data and real 32‐channel, 6‐fluorochrome data. The quality of unmixing is assessed by computing absolute and relative errors, as well as by calculating the symmetrized Kullback–Leibler divergence between known and approximated populations. These results are applicable to any flow‐based system with more detectors than labels where Poisson noise is the dominant contributor to the overall system noise and highlight the fact that explicit incorporation of appropriate noise models is the key to accurately estimating the true label abundance on the cells. © 2013 International Society for Advancement of Cytometry