Multimedia recommender systems

This tutorial introduces multimedia recommender systems (MMRS), in particular, recommender systems that leverage multimedia content to recommend different media types. In contrast to the still most frequently adopted collaborative filtering approaches, we focus on content-based MMRS and on hybrids of collaborative filtering and content-based filtering. The target recommendation domains of the tutorial are movies, music and images. We present state-of-the-art approaches for multimedia feature extraction (text, audio, visual), including deep learning methods, and recommendation approaches tailored to the multimedia domain. Furthermore, by introducing common evaluation techniques, pointing to publicly available datasets specific to the multimedia domain, and discussing the grand challenges in MMRS research, this tutorial provides the audience with a profound introduction to MMRS and an inspiration to conduct further research.

[1]  Francesco Ricci,et al.  Location-aware music recommendation using auto-tagging and hybrid matching , 2013, RecSys.

[2]  Markus Schedl,et al.  Music Playlist Continuation by Learning from Hand-Curated Examples and Song Features: Alleviating the Cold-Start Problem for Rare and Out-of-Set Songs , 2017, DLRS@RecSys.

[3]  Markus Schedl,et al.  MMTF-14K: a multifaceted movie trailer feature dataset for recommendation and retrieval , 2018, MMSys.

[4]  Alexandros Karatzoglou,et al.  DLRS 2017: Second Workshop on Deep Learning for Recommender Systems , 2017, RecSys.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Peter Knees,et al.  A survey of music similarity and recommendation from music context data , 2013, ACM Trans. Multim. Comput. Commun. Appl..

[7]  Paolo Cremonesi,et al.  Exploring the Semantic Gap for Movie Recommendations , 2017, RecSys.

[8]  Markus Schedl,et al.  Audio-visual encoding of multimedia content for enhancing movie recommendations , 2018, RecSys.

[9]  Radomír Mech,et al.  Photo Aesthetics Ranking Network with Attributes and Content Adaptation , 2016, ECCV.

[10]  Franca Garzotto,et al.  Recommending Movies Based on Mise-en-Scene Design , 2016, CHI Extended Abstracts.

[11]  Bracha Shapira,et al.  Recommender Systems Handbook , 2015, Springer US.

[12]  Markus Schedl,et al.  Content-Based Multimedia Recommendation Systems: Definition and Application Domains , 2018, IIR.

[13]  Markus Schedl,et al.  The effect of different video summarization models on the quality of video recommendation based on low-level visual features , 2017, CBMI.

[14]  Jens Grivolla,et al.  Multimodal Music Mood Classification Using Audio and Lyrics , 2008, 2008 Seventh International Conference on Machine Learning and Applications.

[15]  Balázs Hidasi,et al.  Initializing Matrix Factorization Methods on Implicit Feedback Databases , 2013, J. Univers. Comput. Sci..

[16]  Peter Knees,et al.  Conversations with Expert Users in Music Retrieval and Research Challenges for Creative MIR , 2016, ISMIR.

[17]  Balázs Hidasi,et al.  General factorization framework for context-aware recommendations , 2014, Data Mining and Knowledge Discovery.

[18]  Peter Knees,et al.  Building Physical Props for Imagining Future Recommender Systems , 2017, HUMANIZE@IUI.

[19]  Domonkos Tikk,et al.  Enhancing matrix factorization through initialization for implicit feedback databases , 2012, CaRR '12.

[20]  Thierry Bertin-Mahieux,et al.  The Million Song Dataset , 2011, ISMIR.

[21]  Yashar Deldjoo Enhancing Children’s Experience with Recommendation Systems , 2017 .

[22]  Markus Schedl,et al.  Timbral modeling for music artist recognition using i-vectors , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[23]  Hamed Zamani,et al.  Current challenges and visions in music recommender systems research , 2017, International Journal of Multimedia Information Retrieval.

[24]  M. Constantin MMTF-14 K : A Multifaceted Movie Trailer Dataset for Recommendation and Retrieval , 2018 .

[25]  Alexandros Karatzoglou,et al.  Deep Learning for Recommender Systems , 2017, RecSys.

[26]  Paolo Cremonesi,et al.  Using visual features based on MPEG-7 and deep learning for movie recommendation , 2018, International Journal of Multimedia Information Retrieval.

[27]  Peter Knees,et al.  Music Recommender Systems , 2015, Recommender Systems Handbook.

[28]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..