Moodplay: Interactive Mood-based Music Discovery and Recommendation

A large body of research in recommender systems focuses on optimizing prediction and ranking. However, recent work has highlighted the importance of other aspects of the recommendations, including transparency, control and user experience in general. Building on these aspects, we introduce MoodPlay, a hybrid recommender system music which integrates content and mood-based filtering in an interactive interface. We show how MoodPlay allows the user to explore a music collection by latent affective dimensions, and we explain how to integrate user input at recommendation time with predictions based on a pre-existing user profile. Results of a user study (N=240) are discussed, with four conditions being evaluated with varying degrees of visualization, interaction and control. Results show that visualization and interaction in a latent space improve acceptance and understanding of both metadata and item recommendations. However, too much of either can result in cognitive overload and a negative impact on user experience.

[1]  Sung-Bae Cho,et al.  A Context-Aware Music Recommendation System Using Fuzzy Bayesian Networks with Utility Theory , 2006, FSKD.

[2]  G. Breukelen.  Analysis of covariance (ANCOVA) , 2010 .

[3]  Jun Guo,et al.  SFViz: interest-based friends exploration and recommendation in social networks , 2011, VINCI '11.

[4]  S. Koelsch.  A Neuroscientific Perspective on Music Therapy , 2009, Annals of the New York Academy of Sciences.

[5]  Marina Fruehauf,et al.  Encyclopedia Of Research Design , 2016 .

[6]  Denis Parra,et al.  Walk the talk: analyzing the relation between implicit and explicit feedback for preference elicitation , 2011, UMAP'11.

[7]  Tobias Höllerer,et al.  TasteWeights: a visual interactive hybrid recommender system , 2012, RecSys.

[8]  Robin Burke,et al.  Context-aware music recommendation based on latenttopic sequential patterns , 2012, RecSys.

[9]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[10]  Li Chen,et al.  Usability Guidelines for Product Recommenders Based on Example Critiquing Research , 2011, Recommender Systems Handbook.

[11]  David S. Rosenblum,et al.  Context-aware mobile music recommendation for daily activities , 2012, ACM Multimedia.

[12]  I. G. BONNER CLAPPISON.  Editor , 1960, The Electric Power Engineering Handbook - Five Volume Set.

[13]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[14]  Katrien Verbert,et al.  Interactive recommender systems: A survey of the state of the art and future research challenges and opportunities , 2016, Expert Syst. Appl..

[15]  Barry Smyth,et al.  PeerChooser: visual interactive recommendation , 2008, CHI.

[16]  Christoph Trattner,et al.  See what you want to see: visual user-driven approach for hybrid recommendation , 2014, IUI.

[17]  Michelle X. Zhou,et al.  Who is Doing What and When: Social Map-Based Recommendation for Content-Centric Social Web Sites , 2011, TIST.

[18]  Tobias Höllerer,et al.  SmallWorlds: Visualizing Social Recommendations , 2010, Comput. Graph. Forum.

[19]  Thierry Bertin-Mahieux,et al.  The Million Song Dataset , 2011, ISMIR.

[20]  Yi-Hsuan Yang,et al.  Mr. Emo: music retrieval in the emotion plane , 2008, ACM Multimedia.

[21]  Iván Cantador,et al.  An Emotion Dimensional Model Based on Social Tags: Crossing Folksonomies and Enhancing Recommendations , 2013, EC-Web.

[22]  Julita Vassileva,et al.  Understanding and controlling the filter bubble through interactive visualization: a user study , 2014, HT.

[23]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[24]  G. L. Collier.  Beyond valence and activity in the emotional connotations of music , 2007 .

[25]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[26]  Gustavo González,et al.  Embedding Emotional Context in Recommender Systems , 2007, 2007 IEEE 23rd International Conference on Data Engineering Workshop.

[27]  Andreas Nürnberger,et al.  Adaptive music retrieval–a state of the art , 2013, Multimedia Tools and Applications.

[28]  Òscar Celma,et al.  A new approach to evaluating novel recommendations , 2008, RecSys '08.

[29]  Marko Tkalcic,et al.  Using affective parameters in a content-based recommender system for images , 2010, User Modeling and User-Adapted Interaction.

[30]  Gert R. G. Lanckriet,et al.  Large-scale music similarity search with spatial trees , 2011, ISMIR.

[31]  Erik Duval,et al.  Visualizing recommendations to support exploration, transparency and controllability , 2013, IUI '13.

[32]  John Riedl,et al.  Recommender systems: from algorithms to user experience , 2012, User Modeling and User-Adapted Interaction.

[33]  Michael J. Albers.  Cognitive strain as a factor in effective document design , 1997, SIGDOC '97.

[34]  Linas Baltrunas,et al.  Towards Time-Dependant Recommendation based on Implicit Feedback , 2009 .

[35]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[36]  Neil Salkind,et al.  Encyclopedia of research design , 2010 .

[37]  Beth Logan,et al.  Music Recommendation from Song Sets , 2004, ISMIR.

[38]  J. Russell.  A circumplex model of affect. , 1980 .

[39]  Li Chen,et al.  Interaction design guidelines on critiquing-based recommender systems , 2009, User Modeling and User-Adapted Interaction.

[40]  Paul Lamere,et al.  Steerable Playlist Generation by Learning Song Similarity from Radio Station Playlists , 2009, ISMIR.

[41]  Marko Tkalcic,et al.  Affective recommender systems: The role of emotions in recommender systems , 2011 .

[42]  Marcel Zentner amp Eerola,et al.  Self-report measures and models , 2011 .

[43]  Enric Plaza,et al.  Case-Based Sequential Ordering of Songs for Playlist Recommendation , 2006, ECCBR.

[44]  Judith Masthoff,et al.  The Pursuit of Satisfaction: Affective State in Group Recommender Systems , 2005, User Modeling.

[45]  Shogo Nishida,et al.  The relation between user intervention and user satisfaction for information recommendation , 2012, SAC '12.

[46]  Alfred Kobsa,et al.  Inspectability and control in social recommenders , 2012, RecSys.

[47]  Seungmin Rho,et al.  Music emotion classification and context-based music recommendation , 2010, Multimedia Tools and Applications.

[48]  Boi Faltings,et al.  Designing example-critiquing interaction , 2004, IUI '04.