Deep Learning-Based Creative Intention Understanding and Color Suggestions for Illustration

With the gradually maturity of deep learning and model training, machine learning is increasingly used in image processing, including style transfer, image repair, image generation, etc. In these studies, although artificial intelligence could accurately reproduce different artistic styles and be able to generate realistic images, illustrators’ creative experiences were ignored. Machine replaces almost all the work of human in these applications. But human’s desire for the painting experience and ability will not disappear. We believe that based on learning the creative intentions of illustrators, machine can make suggestions for illustrators’ problems and help them improve their capabilities. It will be a more harmonious cooperation direction for human and artificial intelligence in illustration field. This paper takes color suggestion as an example. We analyze the difficulties and needs of illustrators when they color the paintings. And we propose a method of using machine learning to assist illustrators in improving their coloring ability. Based on the color of the input works from illustrators, it will optimize the choice of colors, the arrangement and proportion of different colors in canvas to help illustrators understand their weakness in coloring and improvement directions visually.

[1]  Deepu Rajan,et al.  Image colorization using similar images , 2012, ACM Multimedia.

[2]  Julie Delon,et al.  Automatic color palette , 2005, IEEE International Conference on Image Processing 2005.

[3]  Chunxia Xiao,et al.  Palette-Based Image Recoloring Using Color Decomposition Optimization , 2017, IEEE Transactions on Image Processing.

[4]  Jun-Cheng Chen,et al.  An adaptive edge detection based colorization algorithm and its applications , 2005, ACM Multimedia.

[5]  Erik-Jan van der Linden,et al.  Generating Color Palettes using Intuitive Parameters , 2008, Comput. Graph. Forum.