Semi-automatic cartoon generation by motion planning

To reduce tedious work in cartoon animation, some computer-assisted systems including automatic Inbetweening and cartoon reusing systems have been proposed. In existing automatic Inbetweening systems, accurate correspondence construction, which is a prerequisite for Inbetweening, cannot be achieved. For cartoon reusing systems, the lack of efficient similarity estimation method and reusing mechanism makes it impractical for the users. The semi-supervised graph-based cartoon reusing approach proposed in this paper aims at generating smooth cartoons from the existing data. In this approach, the similarity between cartoon frames can be accurately evaluated by calculating the distance based on local shape context, which is expected to be rotation and scaling invariant. By the semi-supervised algorithm, given an initial frame, the most similar cartoon frames in the cartoon library are selected as candidates of the next frame. The smooth cartoons can be generated by carrying out the algorithm repeatedly to select new cartoon frames after the cartoonists specifying the motion path in a background image. Experimental results of the candidate frame selection in our cartoon dataset suggest the effectiveness of the proposed local shape context for similarity evaluation. The other experiments show the excellent performance on cartoon generation of our approach.

[1]  Seah Hock Soon,et al.  Computer-assisted cel animation: post-processing after inbetweening , 2003, GRAPHITE '03.

[2]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[3]  Dacheng Tao,et al.  Biased Discriminant Euclidean Embedding for Content-Based Image Retrieval , 2010, IEEE Transactions on Image Processing.

[4]  Jean-Daniel Fekete,et al.  TicTacToon: a paperless system for professional 2D animation , 1995, SIGGRAPH.

[5]  Adam Finkelstein,et al.  Shadows for cel animation , 2000, SIGGRAPH.

[6]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[7]  Dacheng Tao,et al.  Bregman Divergence-Based Regularization for Transfer Subspace Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[8]  Charles X. Durand,et al.  The "TOON" project: Requirements for a computerized 2D animation system , 1991, Comput. Graph..

[9]  Yueting Zhuang,et al.  Adaptive control in cartoon data reusing , 2007, Comput. Animat. Virtual Worlds.

[10]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Christoph Bregler,et al.  Turning to the masters: motion capturing cartoons , 2002, ACM Trans. Graph..

[12]  Dacheng Tao,et al.  Biologically Inspired Feature Manifold for Scene Classification , 2010, IEEE Transactions on Image Processing.

[13]  Richard E. Parent,et al.  Automated generation of control skeletons for use in animation , 2002, The Visual Computer.

[14]  Suh-Yin Lee,et al.  Automatic Cel Painting in Computer-assisted Cartoon Production using Similarity Recognition , 1997, Comput. Animat. Virtual Worlds.

[15]  Erika Chuang,et al.  Performance Driven Facial Animation using Blendshape Interpolation , 2002 .

[16]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[17]  Feng Tian,et al.  DBSC-based animation enhanced with feature and motion: Research Articles , 2006 .

[18]  Xindong Wu,et al.  Manifold elastic net: a unified framework for sparse dimension reduction , 2010, Data Mining and Knowledge Discovery.

[19]  Xuelong Li,et al.  Geometric Mean for Subspace Selection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[21]  Bobby Bodenheimer,et al.  Cartoon textures , 2004, SCA '04.

[22]  M A WALLACH,et al.  On psychological similarity. , 1958, Psychological review.

[23]  Meng Wang,et al.  Unified Video Annotation via Multigraph Learning , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Yi Yang,et al.  Ranking with local regression and global alignment for cross media retrieval , 2009, ACM Multimedia.

[25]  Alexander Kort,et al.  Computer aided inbetweening , 2002, NPAR '02.

[26]  Meng Wang,et al.  Beyond Distance Measurement: Constructing Neighborhood Similarity for Video Annotation , 2009, IEEE Transactions on Multimedia.

[27]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Adam Finkelstein,et al.  Texture mapping for cel animation , 1998, SIGGRAPH.

[29]  Quan Chen,et al.  DBSC‐based animation enhanced with feature and motion , 2006, Comput. Animat. Virtual Worlds.

[30]  Edwin E. Catmull,et al.  The problems of computer-assisted animation , 1978, SIGGRAPH.

[31]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[32]  Bernhard Schölkopf,et al.  Transductive Classification via Local Learning Regularization , 2007, AISTATS.

[33]  Xuelong Li,et al.  Patch Alignment for Dimensionality Reduction , 2009, IEEE Transactions on Knowledge and Data Engineering.

[34]  Jun Yu,et al.  Perspective-aware cartoon clips synthesis , 2008 .

[35]  David H. Krantz,et al.  The dimensional representation and the metric structure of similarity data , 1970 .