Automatic stylistic manga layout

Manga layout is a core component in manga production, characterized by its unique styles. However, stylistic manga layouts are difficult for novices to produce as it requires hands-on experience and domain knowledge. In this paper, we propose an approach to automatically generate a stylistic manga layout from a set of input artworks with user-specified semantics, thus allowing less-experienced users to create high-quality manga layouts with minimal efforts. We first introduce three parametric style models that encode the unique stylistic aspects of manga layouts, including layout structure, panel importance, and panel shape. Next, we propose a two-stage approach to generate a manga layout: 1) an initial layout is created that best fits the input artworks and layout structure model, according to a generative probabilistic framework; 2) the layout and artwork geometries are jointly refined using an efficient optimization procedure, resulting in a professional-looking manga layout. Through a user study, we demonstrate that our approach enables novice users to easily and quickly produce higher-quality layouts that exhibit realistic manga styles, when compared to a commercially-available manual layout tool.

[1]  Hiroaki Tobita.  Comic Engine: interactive system for creating and browsing comic books with attention cuing , 2010, AVI.

[2]  Ariel Shamir,et al.  Generating comics from 3D interactive computer graphics , 2006, IEEE Computer Graphics and Applications.

[3]  Scott McCloud.  Understanding comics: the invisible art = Memahami komik / Scott McCloud; penerjemah S. Kinanti , 2001 .

[4]  David Salesin,et al.  Adaptive grid-based document layout , 2003, ACM Trans. Graph..

[5]  Jonathan Cagan,et al.  A survey of computational approaches to three-dimensional layout problems , 2002, Comput. Aided Des..

[6]  Ruck Thawonmas,et al.  Comic Layout for Automatic Comic Generation from Game Log , 2008, ECS.

[7]  Barry O'Sullivan,et al.  Creating personalized documents: an optimization approach , 2003, DocEng '03.

[8]  Soo-Hyun Park,et al.  CINETOON: A Semi-automated System for Rendering Black/White Comic Books from Video Streams , 2008, 2008 IEEE 8th International Conference on Computer and Information Technology Workshops.

[9]  Jörn Loviscach,et al.  From movie to comic, informed by the screenplay , 2007, SIGGRAPH '07.

[10]  Maneesh Agrawala,et al.  Interactive furniture layout using interior design guidelines , 2011, SIGGRAPH 2011.

[11]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[12]  Janko Calic,et al.  Efficient Layout of Comic-Like Video Summaries , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[14]  Alexander C. Loui,et al.  Using Genetic Algorithms for Album Page Layouts , 2003, IEEE Multim..

[15]  Chi-Keung Tang,et al.  Make it home: automatic optimization of furniture arrangement , 2011, ACM Trans. Graph..

[16]  A. Narayanan.  Maximum Likelihood Estimation of the Parameters of the Dirichlet Distribution , 1991 .

[17]  Adam Finkelstein,et al.  Video tapestries with continuous temporal zoom , 2010, SIGGRAPH 2010.

[18]  Tien-Tsin Wong,et al.  Richness-preserving manga screening , 2008, SIGGRAPH 2008.

[19]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[20]  Duncan Rowland,et al.  Automics: souvenir generating photoware for theme parks , 2011, CHI.

[21]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[22]  Vladlen Koltun,et al.  Computer-generated residential building layouts , 2010, ACM Trans. Graph..

[23]  Antoni B. Chan,et al.  Adaptive figure-ground classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[25]  David Salesin,et al.  Schematic storyboarding for video visualization and editing , 2006, SIGGRAPH 2006.

[26]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[27]  Yukinobu Taniguchi,et al.  PanoramaExcerpts: extracting and packing panoramas for video browsing , 1997, MULTIMEDIA '97.

[28]  David Salesin,et al.  Comic Chat , 1996, SIGGRAPH.

[29]  Tien-Tsin Wong,et al.  Manga colorization , 2006, ACM Trans. Graph..

[30]  Shingo Uchihashi,et al.  Summarizing video using a shot importance measure and a frame-packing algorithm , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[31]  Chi-Keung Tang,et al.  Make it home: automatic optimization of furniture arrangement , 2011, SIGGRAPH 2011.

[32]  Gilbert Strang,et al.  Introduction to applied mathematics , 1988 .

[33]  Andreas Girgensohn,et al.  A fast layout algorithm for visual video summaries , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[34]  A. Lewis.  Making Comics: Storytelling Secrets of Comics, Manga and Graphic Novels , 2007 .

[35]  Clayton Brian Atkins.  Adaptive photo collection page layout , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[36]  Steven K. Feiner,et al.  A Survey of Automated Layout Techniques for Information Presentations , 2005 .

[37]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.