Multi-label Movie Genre Detection from a Movie Poster Using Knowledge Transfer Learning

The task of predicting a movie genre from its poster can be very challenging owing to the high variability of movie posters. A novel approach for the generation of a multi-label movie genre prediction from its poster using neural networks that employ knowledge transfer learning has been proposed in this paper. This approach works on two fronts; one is aimed at creating a large, diverse and balanced dataset for movie genre prediction. The second front involves reframing the problem to simpler single-label multi-class classification and generating a multi-label multi-class prediction on a given movie poster as input. The experimental evaluation suggests that our approach generates a remarkable accuracy which is a result of a larger, evenly distributed dataset, simplifying the problem to a single-label multi-class classification problem and because of the use of knowledge transfer learning to extract higher-level feature.

[1]  Wei-Ta Chu,et al.  Movie Genre Classification based on Poster Images with Deep Neural Networks , 2017, MUSA2@MM.

[2]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[3]  Manan Shah,et al.  Biometric authentication and image encryption for image security in cloud framework , 2019, Multiscale and Multidisciplinary Modeling, Experiments and Design.

[4]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[5]  Aalap Doshi,et al.  A comprehensive review on automation in agriculture using artificial intelligence , 2019, Artificial Intelligence in Agriculture.

[6]  Manan Shah,et al.  Buildout of Methodology for Meticulous Diagnosis of K-Complex in EEG for Aiding the Detection of Alzheimer’s by Artificial Intelligence , 2019, Augmented Human Research.

[7]  Mubarak Shah,et al.  Movie genre classification by exploiting audio-visual features of previews , 2002, Object recognition supported by user interaction for service robots.

[8]  Yin-Fu Huang,et al.  Movie Genre Classification Using SVM with Audio and Video Features , 2012, AMT.

[9]  James M. Rehg,et al.  Movie genre classification via scene categorization , 2010, ACM Multimedia.

[10]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[11]  Wen-Hsing Hsu,et al.  Film classification based on low-level visual effect features , 2008, J. Electronic Imaging.

[12]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Grigorios Tsoumakas,et al.  Random k -Labelsets: An Ensemble Method for Multilabel Classification , 2007, ECML.

[14]  Rodrigo C. Barros,et al.  Movie genre classification: A multi-label approach based on convolutions through time , 2017, Appl. Soft Comput..

[15]  Rodrigo C. Barros,et al.  Order embeddings and character-level convolutions for multimodal alignment , 2017, Pattern Recognit. Lett..

[16]  ZhangGuangquan,et al.  Transfer learning using computational intelligence , 2015 .

[17]  Claus Nebauer,et al.  Evaluation of convolutional neural networks for visual recognition , 1998, IEEE Trans. Neural Networks.

[18]  Manan Shah,et al.  Panacea of challenges in real-world application of big data analytics in healthcare sector , 2019, Journal of Data, Information and Management.

[19]  Wen-Hsing Hsu,et al.  A Film Classifier Based on Low-level Visual Features , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[20]  Barry L. Shoop,et al.  Three-dimensional interconnection scheme for color error diffusion , 2008, J. Electronic Imaging.

[21]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[22]  Miran Pobar,et al.  Movie posters classification into genres based on low-level features , 2014, 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).