Coherence-enhancing line drawing for color images

Line drawing plays an important role in many image-based non-photorealistic applications. However, most existing approaches use a grayscale edge detector for line extraction, so that only luminance differences between nearby image pixels is taken into account, but the chrominance differences is ignored. This leads to the undesirable consequence that visually significant edges in adjacent regions with different colors of similar luminance cannot be detected. To address this limitation, we present a novel enhanced line drawing method based on a flow-based difference-of-Gaussians (FDoG) filter. Because of an inherent property of the thresholded DoG edge model, captured lines may appear dislodged from the true edges in the image. To this end, we provide a gradient-guided warping technique so that smooth and coherent lines can be extracted in the correct location. The GPU implementation of the proposed algorithms allows real-time performance, and experimental examples with various color images demonstrate the method’s superior qualitative performance over previous approaches.

[1]  Yunjin Lee,et al.  Abstract Line Drawings from 2D Images , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[2]  Craig Gotsman,et al.  Enhancement by image-dependent warping , 1999, IEEE Trans. Image Process..

[3]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[4]  Martin Cadík,et al.  Perceptual Evaluation of Color‐to‐Grayscale Image Conversions , 2008, Comput. Graph. Forum.

[5]  Neil A. Dodgson,et al.  Decolorize: Fast, contrast enhancing, color to grayscale conversion , 2007, Pattern Recognit..

[6]  Hyung W. Kang,et al.  A unified scheme for adaptive stroke-based rendering , 2006, The Visual Computer.

[7]  Panos E. Trahanias,et al.  Vector order statistics operators as color edge detectors , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[8]  Seungyong Lee,et al.  Flow-Based Image Abstraction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[9]  Dirk Bartz,et al.  Stylized augmented reality for improved immersion , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[10]  Mongi A. Abidi,et al.  Data fusion: color edge detection and surface reconstruction through regularization , 1996, IEEE Trans. Ind. Electron..

[11]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[13]  Peter Meer,et al.  Edge Detection with Embedded Confidence , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[15]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[16]  Jürgen Döllner,et al.  Image Abstraction by Structure Adaptive Filtering , 2008, TPCG.

[17]  Pascal Barla,et al.  Structure-preserving manipulation of photographs , 2007, NPAR '07.

[18]  Jürgen Döllner,et al.  Image and Video Abstraction by Anisotropic Kuwahara Filtering , 2009, Comput. Graph. Forum.

[19]  Karol Myszkowski,et al.  Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video , 2008, Comput. Graph. Forum.

[20]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[21]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[22]  Mark A. Ruzon,et al.  Early vision using distributions , 2000 .

[23]  László Neumann,et al.  An Efficient Perception-based Adaptive Color to Gray Transformation , 2007, CAe.

[24]  Henry Kang,et al.  Image and Video Abstraction by Coherence‐Enhancing Filtering , 2011, Comput. Graph. Forum.

[25]  Felice Andrea Pellegrino,et al.  Edge detection revisited , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Voicu Popescu,et al.  The Soft Shadow Occlusion Camera , 2007 .

[27]  Guang-Zhong Yang,et al.  Structure adaptive anisotropic image filtering , 1996, Image Vis. Comput..

[28]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[29]  Carlo Tomasi,et al.  Color edge detection with the compass operator , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[30]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[31]  J. Canny A Computational Approach toEdgeDetection , 1986 .

[32]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, SIGGRAPH 2005.

[33]  Seungyong Lee,et al.  Robust color-to-gray via nonlinear global mapping , 2009, ACM Trans. Graph..

[34]  Yasuyuki Matsushita,et al.  Illumination Brush: Interactive Design of All-Frequency Lighting , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[35]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).