Automatic batch-invariant color segmentation of histological cancer images

We propose an automatic color segmentation system that (1) incorporates domain knowledge to guide histological image segmentation and (2) normalizes images to reduce sensitivity to batch effects. Color segmentation is an important, yet difficult, component of image-based diagnostic systems. User-interactive guidance by domain experts—i.e., pathologistsߞoften leads to the best color segmentation or “ground truth” regardless of stain color variations in different batches. However, such guidance limits the objectivity, reproducibility and speed of diagnostic systems. Our system uses knowledge from pre-segmented reference images to normalize and classify pixels in patient images. The system then refines the segmentation by re-classifying pixels in the original color space. We test our system on four batches of H&E stained images and, in comparison to a system with no normalization (39% average accuracy), we obtain an average segmentation accuracy of 85%.