Automatic preview generation of comic episodes for digitized comic search

This research proposes a novel method to present "thumbnails" of episodes of digitized comics, in order to improve the efficiency of comic search. Comic episode thumbnails are generated based on image analysis technologies developed especially for comic images. Namely, the following procedures are developed for our system: automatic comic frame segmentation, text balloon extraction, and a linear regression based model to calculate the importance score of each extracted frame. The system then selects frames from each episode with high importance score, and aligns the selected frames to create the episode thumbnail, which is presented to the system user as a compact preview of the episode. User experiments conducted with actual Japanese comic images prove that the proposed method significantly decreases the time necessary to search for specific episodes from a large scaled comic data collection.

[1]  Edward M. Riseman,et al.  TextFinder: An Automatic System to Detect and Recognize Text In Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Anil K. Jain,et al.  Text information extraction in images and video: a survey , 2004, Pattern Recognit..

[3]  Rahmat Budiarto,et al.  Comic Image Decomposition for Reading Comics on Cellular Phones , 2004, IEICE Trans. Inf. Syst..

[4]  Kenji Shoji,et al.  Layout Analysis of Tree-Structured Scene Frames in Comic Images , 2007, IJCAI.

[5]  Kohei Arai,et al.  Automatic E-Comic Content Adaptation , 2010 .

[6]  Qinglian Guo,et al.  An algorithm for extracting text strings from comic strips , 2006, SIGGRAPH '06.

[7]  Kohei Arai,et al.  Method for Automatic E-Comic Scene Frame Extraction for Reading Comic on Mobile Devices , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[8]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Hiroshi Watanabe,et al.  A STUDY ON FRAME POSITION DETECTION OF DIGITIZED COMICS IMAGES , 2010 .