Clifford Algebra Bundles to Multidimensional Image Segmentation

Abstract.We present a new theoretical framework for multidimensional image processing using Clifford algebras. The aim of the paper is to detect edges by computing the first fundamental form of a surface associated to an image. We propose to construct this metric in the Clifford bundles setting. A nD image, i.e. an image of dimension n, is considered as a section of a trivial Clifford bundle $$(CT(D), \widetilde{\pi}, D)$$ over the domain D of the image and with fiber $$Cl({\mathbb{R}}^n, \parallel\parallel_2)$$. Due to the triviality, any connection $$\nabla_1$$ on the given bundle is the sum of the trivial connection $$\widetilde{\nabla}_0$$ with ω, a 1-form on D with values in End(CT(D)). We show that varying ω and derivating well-chosen sections with respect to $$\nabla_1$$ provides all the information needed to perform various kind of segmentation. We present several illustrations of our results, dealing with color (n=3) and color/infrared (n=4) images. As an example, let us mention the problem of detecting regions of a given color with constraints on temperature; the segmentation results from the computation of $$\nabla_1(I) = \widetilde{\nabla}_0(I) + (dx+dy)\otimes\mu{I}$$, where I is the image section and μ is a vector section coding the given color.

[1]  Guillermo Sapiro,et al.  Color Snakes , 1997, Comput. Vis. Image Underst..

[2]  G. Sommer Geometric computing with Clifford algebras: theoretical foundations and applications in computer vision and robotics , 2001 .

[3]  M. Blau Connections on Clifford bundles and the Dirac operator , 1987 .

[4]  Ron Kimmel,et al.  A general framework for low level vision , 1998, IEEE Trans. Image Process..

[5]  Stephen J. Sangwine,et al.  Colour-sensitive edge detection using hypercomplex filters , 2000, 2000 10th European Signal Processing Conference.

[6]  Michael H. Brill,et al.  Color appearance models , 1998 .

[7]  Reiner Lenz,et al.  COLOR EDGE DETECTORS FOR CONICAL COLOR SPACES , 2000 .

[8]  Theo Gevers,et al.  Classifying color transitions into shadow-geometry, illumination, highlight or material edges , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[9]  Thomas Batard,et al.  A Metric Approach to nD Images Edge Detection with Clifford Algebras , 2009, Journal of Mathematical Imaging and Vision.

[10]  Stephen J. Sangwine,et al.  Colour image filters based on hypercomplex convolution , 2000 .

[11]  Utpal Roy,et al.  Color Based Image Segmentation , 2008, 2008 International Conference on Information Technology.

[12]  Mahdi Nezamabadi,et al.  Color Appearance Models , 2014, J. Electronic Imaging.

[13]  Gerald Sommer,et al.  Geometric Computing with Clifford Algebras , 2001, Springer Berlin Heidelberg.

[14]  D. Hestenes,et al.  Clifford Algebra to Geometric Calculus , 1984 .

[15]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..