Predicting Moves-on-Stills for Comic Art Using Viewer Gaze Data

Comic art consists of a sequence of panels of different shapes and sizes that visually communicate the narrative to the reader. The move-on-stills technique allows such still images to be retargeted for digital displays via camera moves. Today, moves-on-stills can be created by software applications given user-provided parameters for each desired camera move. The proposed algorithm uses viewer gaze as input to computationally predict camera move parameters. The authors demonstrate their algorithm on various comic book panels and evaluate its performance by comparing their results with a professional DVD.

[1]  W. Eisner.  Comics and Sequential Art , 1985 .

[2]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[3]  Thomas Martinetz,et al.  Variability of eye movements when viewing dynamic natural scenes. , 2010, Journal of vision.

[4]  Joan E. Hart,et al.  Film Directing Shot by Shot: Visualizing from Concept to Screen , 1991 .

[5]  Yaser Sheikh,et al.  Inferring artistic intention in comic art through viewer gaze , 2012, SAP.

[6]  Meng Wang,et al.  Movie2Comics: Towards a Lively Video Content Presentation , 2012, IEEE Transactions on Multimedia.

[7]  Jessika Weiss,et al.  Vision Science Photons To Phenomenology , 2016 .

[8]  Carol O'Sullivan,et al.  Predicting and Evaluating Saliency for Simplified Polygonal Models , 2005, TAP.

[9]  Rynson W. H. Lau,et al.  Look over here , 2014, ACM Trans. Graph..

[10]  Thierry Baccino,et al.  New insights into ambient and focal visual fixations using an automatic classification algorithm , 2011, i-Perception.

[11]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[12]  Yaser Sheikh,et al.  Gaze-Driven Video Re-Editing , 2015, TOGS.

[13]  J. Antes.  The time course of picture viewing. , 1974, Journal of experimental psychology.

[14]  Ariel Shamir,et al.  Generating comics from 3D interactive computer graphics , 2006, IEEE Computer Graphics and Applications.

[15]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.