A Computer-Assisted Colorization Approach Based on Efficient Belief Propagation and Graph Matching

Region-based approaches have been proposed to computer-assisted colorization problem, typically using shape similarity and topology relations between regions. Given a colored frame, the objective is to automatically colorize consecutive frames, minimizing the user effort to colorize the remaining regions. We propose a new colorization algorithm based on graph matching, using Belief Propagation to explore the spatial relations between sites through Markov Random Fields. Each frame is represented by a graph with each region being associated to a vertex. A colored frame is chosen as a `model' and the colors are propagated to uncolored frames by computing a correspondence between regions, exploring the spatial relations between vertices, considering three types of information: adjacency, distance and orientation. Experiments are shown in order to demonstrate the importance of the spatial relations when comparing two graphs with strong deformations and with `topological' differences.

[1]  Roberto Marcondes Cesar Junior,et al.  Structural Image Segmentation with Interactive Model Generation , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Terry Caelli,et al.  Graphical models for graph matching: Approximate models and optimal algorithms , 2005, Pattern Recognit. Lett..

[3]  Roberto Marcondes Cesar Junior,et al.  Structural Matching of 2D Electrophoresis Gels using Graph Models , 2008, 2008 XXI Brazilian Symposium on Computer Graphics and Image Processing.

[4]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[5]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Luiz Velho,et al.  A Computer-Assisted Colorization Algorithm based on Topological Difference , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[7]  Edwin E. Catmull,et al.  The problems of computer-assisted animation , 1978, SIGGRAPH.

[8]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.