A Modular Framework for 2D/3D and Multi-modal Segmentation with Joint Super-Resolution

A versatile multi-image segmentation framework for 2D/3D or multi-modal segmentation is introduced in this paper with possible application in a wide range of machine vision problems. The framework performs a joint segmentation and super-resolution to account for images of unequal resolutions gained from different imaging sensors. This allows to combine high resolution details of one modality with the distinctiveness of another modality. A set of measures is introduced to weight measurements according to their expected reliability and it is utilized in the segmentation as well as the super-resolution. The approach is demonstrated with different experimental setups and the effect of additional modalities as well as of the parameters of the framework are shown.

[1]  Qingxiong Yang,et al.  Automatic Natural Video Matting with Depth , 2007 .

[2]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007 .

[4]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  C Wählby,et al.  Combining intensity, edge and shape information for 2D and 3D segmentation of cell nuclei in tissue sections , 2004, Journal of microscopy.

[6]  Michael Werman,et al.  Fusing Time-of-Flight Depth and Color for Real-Time Segmentation and Tracking , 2009, Dyn3D.

[7]  Reinhard Koch,et al.  Dynamic 3D Imaging, DAGM 2009 Workshop, Dyn3D 2009, Jena, Germany, September 9, 2009. Proceedings , 2009, Dyn3D.

[8]  Fabian Jager,et al.  Contour-based segmentation and coding for depth map compression , 2011, 2011 Visual Communications and Image Processing (VCIP).

[9]  Otmar Loffeld,et al.  MULTI-MODAL BACKGROUND SUBTRACTION USING GAUSSIAN MIXTURE MODELS , 2010 .

[10]  Olaf Kähler,et al.  On fusion of range and intensity information using Graph-Cut for planar patch segmentation , 2008, Int. J. Intell. Syst. Technol. Appl..

[11]  Olivier Basset,et al.  Segmentation of ultrasound images--multiresolution 2D and 3D algorithm based on global and local statistics , 2003, Pattern Recognit. Lett..