Animated Construction of Chinese Brush Paintings

In this paper, we present a method for reconstructing the drawing process of Chinese brush paintings. We demonstrate the possibility of computing an artistically reasonable drawing order from a static brush painting that is consistent with the rules of art. We map the key principles of drawing composition to our computational framework, which first organizes the strokes in three stages and then optimizes stroke ordering with natural evolution strategies. Our system produces reasonable animated constructions of Chinese brush paintings with minimal or no user intervention. We test our algorithm on a range of input paintings with varying degrees of complexity and structure and then evaluate the results via a user study. We discuss the applications of the proposed system to painting instruction, painting animation, and image stylization, especially in the context of art teaching.

[1]  Xuelong Li,et al.  Constrained Nonnegative Matrix Factorization for Image Representation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Ligang Liu,et al.  Animated construction of line drawings , 2011, ACM Trans. Graph..

[3]  Alexander Soper,et al.  The Tao of Painting, a Study of the Ritual Disposition of Chinese Painting , 1957 .

[4]  M. Babcock,et al.  Perception of dynamic information in static handwritten forms. , 1988, The American journal of psychology.

[5]  Irfan A. Essa,et al.  Image and video based painterly animation , 2004, NPAR '04.

[6]  Enhua Wu,et al.  Feature-oriented writing process reproduction of Chinese calligraphic artwork , 2014, SIGGRAPH ASIA Technical Briefs.

[7]  Ren-Jie Wang,et al.  Image-Based Color Ink Diffusion Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[8]  Tom Schaul,et al.  Natural Evolution Strategies , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[9]  Oliver Deussen,et al.  Image stylization with a painting machine using semantic hints , 2013, Comput. Graph..

[10]  Feiyue Huang,et al.  Animated construction of ink-wash paintings , 2014, SIGGRAPH ASIA Posters.

[11]  Fenghui Yao,et al.  Painting brush control techniques in Chinese painting robot , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[12]  En-Hua Wu,et al.  Stroke-based real-time ink wash painting style rendering for geometric models , 2012, SIGGRAPH 2012.

[13]  Gabriel J. Brostow,et al.  Modeling 2.5D Plants from Ink Paintings , 2010, SBIM.

[14]  Dawn Ho Delbanco,et al.  The Mustard Seed Garden Manual of Painting , 1979 .

[15]  Chunyan Miao,et al.  Learning to name faces: a multimodal learning scheme for search-based face annotation , 2013, SIGIR.

[16]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[17]  David Salesin,et al.  Animating Chinese paintings through stroke-based decomposition , 2006, TOGS.

[18]  Björn Ommer,et al.  Reconstructing the drawing process of reproductions from medieval images , 2011, 2011 18th IEEE International Conference on Image Processing.

[19]  Hongbo Fu,et al.  Dynamic sketching: simulating the process of observational drawing , 2014, CAe@Expressive.

[20]  Shehroz S. Khan,et al.  Evaluating visual aesthetics in photographic portraiture , 2012, CAe '12.

[21]  Xiaogang Jin,et al.  Real-time image-based chinese ink painting rendering , 2012, Multimedia Tools and Applications.

[22]  Tien-Tsin Wong,et al.  Region-based structure line detection for cartoons , 2015, Computational Visual Media.

[23]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Alexander Mendiburu,et al.  A preliminary study on EDAs for permutation problems based on marginal-based models , 2011, GECCO '11.

[25]  Yotam I. Gingold,et al.  Decomposing time-lapse paintings into layers , 2015, ACM Trans. Graph..

[26]  B. Tversky,et al.  Cognitive constraints on ordering operations: the case of geometric analogies. , 1987, Journal of experimental psychology. General.

[27]  Masashi Sugiyama,et al.  Artist Agent: A Reinforcement Learning Approach to Automatic Stroke Generation in Oriental Ink Painting , 2012, ICML.

[28]  Lijie Yang,et al.  Animating Chinese ink painting through generating reproducible brush strokes , 2012, Science China Information Sciences.

[29]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[30]  Yangsheng Xu,et al.  A calligraphy robot — Callibot: Design, analysis and applications , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[31]  Jintae Lee.  Simulating Oriental Black-Ink Painting , 1999, IEEE Computer Graphics and Applications.

[32]  Ralph R. Martin,et al.  Video-based running water animation in Chinese painting style , 2009, Science in China Series F: Information Sciences.

[33]  James M. Rehg,et al.  Projector-guided painting , 2006, UIST.

[34]  Chiew-Lan Tai,et al.  MoXi: real-time ink dispersion in absorbent paper , 2005, SIGGRAPH '05.