Linear color segmentation and its implementation

A framework for color image segmentation is presented, which combines color histogram analysis and region merging approach. Its main goal is to segment an image at material boundaries (i.e., discontinuities of reflectance properties) while ignoring spatial color inhomogeneities of uniformly pigmented (colored) objects, caused by accidents of illumination and viewing geometry. Theoretical examination of light spectrum transformations upon light reflection from material surfaces and upon interaction with a sensor system shows that in a wide variety of viewed scenes (even containing interreflections and highlight areas) uniformly pigmented objects are projected to the color space of the sensor as planar, linear, or point-like clusters, depending on lighting and viewing conditions and object geometry. To detect such clusters in the color space, three methods are suggested: Generalized Hough Transform method, gradient descent method, and eigenvectors method. A framework algorithm of color segmentation based on region merging approach is developed, which can use any of these methods. Testing this algorithm with both artificially generated and real images shows quite reliable results.