Comics Story Representation System Based on Genre

Comics is usually classified into broad categories called "genres" according to its contents such as comedy, horror, science fiction, etc. Because a genre expresses a comics story briefly, people read comics which has contents based on their interest, by relying on comics genres. However, giving only one genre to one comic cannot express the detailed difference of the story. In this paper, we propose a system for generating comics story representation as a sub-sequence of genres. Our comics story representation can be applied to a new search engine based on stories or to a recommendation system which analyzes the tastes of the user's favorite comics by finding comics with similar story representation. We use a deep neural network to classify each page into the corresponding genre. Experimental results confirm the advantage of the proposed system.

[1]  Larry S. Davis,et al.  The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narratives , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Rynson W. H. Lau,et al.  Dynamic Manga: Animating Still Manga via Camera Movement , 2017, IEEE Transactions on Multimedia.

[3]  Kiyoharu Aizawa,et al.  Sketch-based manga retrieval using manga109 dataset , 2015, Multimedia Tools and Applications.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Charles Lima Sanches,et al.  Manga content analysis using physiological signals , 2016, MANPU@ICPR.

[6]  Koichi Kise,et al.  Emotional arousal estimation while reading comics based on physiological signal analysis , 2016, MANPU@ICPR.

[7]  Motoi Iwata,et al.  Comic Story Analysis Based on Genre Classification , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.