Colorization of black-and-white cartoons

We introduce a novel colorization framework for old black-and-white cartoons originally produced by a cel or paper based technology. In this case, the dynamic part of the scene is represented by a set of outlined homogeneous regions which superimpose the static background. To reduce a large amount of manual intervention we combine unsupervised image segmentation, background reconstruction, and structural prediction. Our system allows the user to specify the brightness of applied colors unlike the most of previous approaches which operate only with hue and saturation. We also present simple but effective color modulation, composition and dust spot removal techniques able to produce color images in broadcast quality without additional user intervention.

[1]  Suh-Yin Lee,et al.  Automatic Cel Painting in Computer-assisted Cartoon Production using Similarity Recognition , 1997, Comput. Animat. Virtual Worlds.

[2]  Josef Kittler,et al.  Relaxation labelling algorithms - a review , 1986, Image Vis. Comput..

[3]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[5]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[6]  Jeff Lenburg.  The Encyclopedia of Animated Cartoons , 1981 .

[7]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[8]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[9]  Gérard G. Medioni,et al.  Fast Convolution with Laplacian-of-Gaussian Masks , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[11]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  J. Galayda.  Edge Focusing , 1981, IEEE Transactions on Nuclear Science.

[13]  Wilson Markle.  The Development and Application of Colorization , 1984 .

[14]  Guillermo Sapiro.  Inpainting the colors , 2005, IEEE International Conference on Image Processing 2005.

[15]  Markus H. Gross,et al.  An approach to computer-supported cartooning , 2005, The Visual Computer.

[16]  Ying Sun,et al.  A hierarchical approach to color image segmentation using homogeneity , 2000, IEEE Trans. Image Process..

[17]  Kim L. Boyer,et al.  The laplacian-of-gaussian kernel: A formal analysis and design procedure for fast, accurate convolution and full-frame output , 1989, Comput. Vis. Graph. Image Process..

[18]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[19]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[20]  Takahiko Horiuchi,et al.  Estimation of color for gray-level image by probabilistic relaxation , 2002, Object recognition supported by user interaction for service robots.

[21]  Yi-Ping Hung,et al.  Fast block matching algorithm based on the winner-update strategy , 2001, IEEE Trans. Image Process..

[22]  Mark S. Drew,et al.  Full search content independent block matching based on the fast Fourier transform , 2002, Proceedings. International Conference on Image Processing.

[23]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[24]  Anil C. Kokaram,et al.  Motion picture restoration - digital algorithms for artefact suppression in degraded motion picture film and video , 2001 .

[25]  Quan Chen,et al.  Computer-assisted auto coloring by region matching , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[26]  G. Sapiro,et al.  Geometric partial differential equations and image analysis [Book Reviews] , 2001, IEEE Transactions on Medical Imaging.

[27]  Jirí Zára,et al.  Segmentation of black and white cartoons , 2003, SCCG '03.

[28]  Flo Leibowitz.  Movie Colorization and the Expression of Mood , 1991 .

[29]  Seah Hock Soon,et al.  Computer-assisted coloring by matching line drawings , 2000, The Visual Computer.

[30]  Jean-Marc Odobez,et al.  Robust Multiresolution Estimation of Parametric Motion Models , 1995, J. Vis. Commun. Image Represent..

[31]  Christoph Meinel,et al.  GRAYSCALE IMAGE MATTING AND COLORIZATION , 2004 .

[32]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[33]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[34]  James J. Clark.  Authenticating Edges Produced by Zero-Crossing Algorithms , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Young Serk Shim,et al.  A fast hierarchical motion vector estimation algorithm using mean pyramid , 1995, IEEE Trans. Circuits Syst. Video Technol..

[36]  Josef Kittler,et al.  Region-Based Object Recognition: Pruning Multiple Representations and Hypotheses , 2000, BMVC.

[37]  Jirí Zára,et al.  Unsupervised colorization of black-and-white cartoons , 2004, NPAR '04.

[38]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[39]  R. Cooper.  Colorization and Moral Rights: Should the United States Adopt Unified Protection for Artists? , 1991 .

[40]  Alex P. Pentland,et al.  From Pixels to Predicates: Recent Advances in Computational and Robotic Vision , 1986, IEEE Expert.

[41]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[42]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[43]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[44]  Gérard G. Medioni,et al.  Detection of Intensity Changes with Subpixel Accuracy Using Laplacian-Gaussian Masks , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Suh-Yin Lee,et al.  Automatic cel painting in computer-assisted cartoon production using similarity recognition , 1997 .

[46]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[47]  Zhigeng Pan,et al.  A New Algorithm for Adding Color to Video or Animation Clips , 2004, WSCG.

[48]  Chunhong Pan,et al.  An Iterative Bayesian Approach for Digital Matting , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[49]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[50]  Takahiko Horiuchi,et al.  Colorization algorithm for grayscale image by propagating seed pixels , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[51]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..