A Novel Real-time Edge-Preserving Smoothing Filter

The segmentation of textured and noisy areas in images is a very challenging task due to the large variety of objects and materials in natural environments, which cannot be solved by a single similarity measure. In this paper, we address this problem by proposing a novel edge-preserving texture filter, which smudges the color values inside uniformly textured areas, thus making the processed image more workable for color-based image segmentation. Due to the highly parallel structure of the method, the implementation on a GPU runs in realtime, allowing us to process standard images within tens of milliseconds. By preprocessing images with this novel filter before applying a recent real-time color-based image segmentation method, we obtain significant improvements in performance for images from the Berkeley dataset, outperforming an alternative version using a standard bilateral filter for preprocessing. We further show that our combined approach leads to better segmentations in terms of a standard performance measure than graph-based and mean-shift segmentation for the Berkeley image dataset.

[1]  Azriel Rosenfeld,et al.  Iterative Enhancemnent of Noisy Images , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Takao Hinamoto,et al.  A realization of edge-preserving smoothing filters using layered neural networks , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[3]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[4]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[6]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[7]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Wesley E. Snyder,et al.  Adaptive demosaicking , 2003, J. Electronic Imaging.

[9]  M. Baker,et al.  Applications of a bilateral denoising filter in biological electron microscopy. , 2003, Journal of structural biology.

[10]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Anil K. Jain,et al.  A wrapper-based approach to image segmentation and classification , 2004, IEEE Transactions on Image Processing.

[12]  Michael Elad,et al.  Multiframe demosaicing and super-resolution of color images , 2006, IEEE Transactions on Image Processing.

[13]  Hui Cheng,et al.  Bilateral Filtering-Based Optical Flow Estimation with Occlusion Detection , 2006, ECCV.

[14]  Frédo Durand,et al.  A Topological Approach to Hierarchical Segmentation using Mean Shift , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[16]  A. Aydin Alatan,et al.  Depth Assisted Object Segmentation in Multi-View Video , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[17]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Narendra Ahuja,et al.  SVM for edge-preserving filtering , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Wenliang Du,et al.  A dynamic threshold edge-preserving smoothing segmentation algorithm for anterior chamber OCT images based on modified histogram , 2011, 2011 4th International Congress on Image and Signal Processing.

[20]  Babette Dellen,et al.  Real-Time Segmentation of Stereo Videos on a Portable System With a Mobile GPU , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Alexey Abramov,et al.  Compression of visual data into symbol-like descriptors in terms of a cognitive real-time vision system , 2012 .

[22]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .