Effects of recommendations on the playlist creation behavior of users

The digitization of music, the emergence of online streaming platforms and mobile apps have dramatically changed the ways we consume music. Today, much of the music that we listen to is organized in some form of a playlist, and many users of modern music platforms create playlists for themselves or to share them with others. The manual creation of such playlists can however be demanding, in particular due to the huge amount of possible tracks that are available online. To help users in this task, music platforms like Spotify provide users with interactive tools for playlist creation. These tools usually recommend additional songs to include given a playlist title or some initial tracks. Interestingly, little is known so far about the effects of providing such a recommendation functionality. We therefore conducted a user study involving 270 subjects, where one half of the participants—the treatment group—were provided with automated recommendations when performing a playlist construction task. We then analyzed to what extent such recommendations are adopted by users and how they influence their choices. Our results, among other aspects, show that about two thirds of the treatment group made active use of the recommendations. Further analyses provide additional insights about the underlying reasons why users selected certain recommendations. Finally, our study also reveals that the mere presence of the recommendations impacts the choices of the participants, even in cases when none of the recommendations was actually chosen.

[1]  Dietmar Jannach,et al.  Interacting with Recommenders—Overview and Research Directions , 2017, ACM Trans. Interact. Intell. Syst..

[2]  Jarno Ojala,et al.  Evaluating MoodPic - a Concept for Collaborative Mood Music Playlist Creation , 2013, 2013 17th International Conference on Information Visualisation.

[3]  David Arnott,et al.  Cognitive biases and decision support systems development: a design science approach , 2006, Inf. Syst. J..

[4]  Markus Schedl,et al.  Location-Aware Music Artist Recommendation , 2014, MMM.

[5]  Dietmar Jannach,et al.  Sequence-Aware Recommender Systems , 2018, UMAP.

[6]  Izak Benbasat,et al.  E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact , 2007, MIS Q..

[7]  M. Frueh Music In Everyday Life , 2016 .

[8]  Anne Boyer,et al.  Are Item Attributes a Good Alternative to Context Elicitation in Recommender Systems? , 2017, UMAP.

[9]  Bart P. Knijnenburg,et al.  Explaining the user experience of recommender systems , 2012, User Modeling and User-Adapted Interaction.

[10]  René F. Kizilcec How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface , 2016, CHI.

[11]  Eva Zangerle,et al.  Towards a Context-Aware Music Recommendation Approach: What is Hidden in the Playlist Name? , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[12]  Marcelo Armentano,et al.  Applying the Technology Acceptance Model to Evaluation of Recommender Systems , 2015, Polytech. Open Libr. Int. Bull. Inf. Technol. Sci..

[13]  Tobias Höllerer,et al.  TasteWeights: a visual interactive hybrid recommender system , 2012, RecSys.

[14]  Dietmar Jannach,et al.  Biases in Automated Music Playlist Generation: A Comparison of Next-Track Recommending Techniques , 2016, UMAP.

[15]  Markus Schedl,et al.  A hybrid approach to music playlist continuation based on playlist-song membership , 2018, SAC.

[16]  John Riedl,et al.  Recommender systems: from algorithms to user experience , 2012, User Modeling and User-Adapted Interaction.

[17]  Dietmar Jannach,et al.  Recommendation quality, transparency, and website quality for trust-building in recommendation agents , 2016, Electron. Commer. Res. Appl..

[18]  Torsten Möller,et al.  TagFlip: Active Mobile Music Discovery with Social Tags , 2016, IUI.

[19]  Simone Stumpf,et al.  When users generate music playlists: When words leave off, music begins? , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[20]  David S. Rosenblum,et al.  Context-aware mobile music recommendation for daily activities , 2012, ACM Multimedia.

[21]  Dietmar Jannach,et al.  Investigating Mere-Presence Effects of Recommendations on the Consumer Choice Process , 2016, IntRS@RecSys.

[22]  John T. Gourville,et al.  Overchoice and Assortment Type: When and Why Variety Backfires , 2005 .

[23]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[24]  Gert R. G. Lanckriet,et al.  Smarter than Genius? Human Evaluation of Music Recommender Systems , 2009, ISMIR.

[25]  Arto Lehtiniemi Evaluating SuperMusic: streaming context-aware mobile music service , 2008, ACE '08.

[26]  Dietmar Jannach,et al.  User Perception of Next-Track Music Recommendations , 2017, UMAP.

[27]  B. Fogg The ethics of persuasive technology , 2003 .

[28]  Berry Eggen,et al.  Realization and User Evaluation of an Automatic Playlist Generator , 2003, ISMIR.

[29]  Jin Ha Lee,et al.  Understanding User Requirements for Music Information Services , 2012, ISMIR.

[30]  John O'Donovan,et al.  Moodplay: Interactive music recommendation based on Artists' mood similarity , 2019, Int. J. Hum. Comput. Stud..

[31]  Nicolas Jones User Perceived Qualities and Acceptance of Recommender Systems , 2010 .

[32]  Adrian C. North,et al.  Uses of Music in Everyday Life , 2004 .

[33]  P. Todd,et al.  Can There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload , 2010 .

[34]  Andreas Butz,et al.  Who needs interaction anyway: exploring mobile playlist creation from manual to automatic , 2011, IUI '11.

[35]  Matti Mäntymäki,et al.  Gratifications from using freemium music streaming services: Differences between basic and premium users , 2015, ICIS.

[36]  Robin Burke,et al.  Context-aware music recommendation based on latenttopic sequential patterns , 2012, RecSys.

[37]  Rebecca Webb,et al.  Short- and long-term musical preferences: what makes a favourite piece of music? , 2010 .

[38]  Hamed Zamani,et al.  Current challenges and visions in music recommender systems research , 2017, International Journal of Multimedia Information Retrieval.

[39]  D. O’Keefe Persuasion , 1990, The Handbook of Communication Skills.

[40]  Katrien Verbert,et al.  How Do Different Levels of User Control Affect Cognitive Load and Acceptance of Recommendations? , 2017, IntRS@RecSys.

[41]  Benjamin Fields,et al.  Contextualize Your Listening: The Playlist as Recommendation Engine , 2011 .

[42]  Christoph Lofi,et al.  Sequences of Diverse Song Recommendations: An Exploratory Study in a Commercial System , 2017, UMAP.

[43]  Kyung Hyan Yoo,et al.  Persuasive Recommender Systems - Conceptual Background and Implications , 2012, Springer Briefs in Electrical and Computer Engineering.

[44]  Justin A. Zupnick,et al.  Cascading Reminiscence Bumps in Popular Music , 2013, Psychological science.

[45]  Dietmar Jannach,et al.  New Hidden Persuaders: An Investigation of Attribute-Level Anchoring Effects of Product Recommendations , 2019, Journal of Retailing.

[46]  Yvonne Kammerer,et al.  How the interface design influences users' spontaneous trustworthiness evaluations of web search results: comparing a list and a grid interface , 2010, ETRA.

[47]  Dietmar Jannach,et al.  Persuasive Online-Selling in Quality and Taste Domains , 2006, EC-Web.

[48]  Dietmar Jannach,et al.  How Automated Recommendations Affect the Playlist Creation Behavior of Users , 2018, IUI Workshops.

[49]  Dietmar Jannach,et al.  Automated Generation of Music Playlists: Survey and Experiments , 2014, ACM Comput. Surv..

[50]  Anja Nylund Hagen The Playlist Experience: Personal Playlists in Music Streaming Services , 2015 .

[51]  Armelle Brun,et al.  When Diversity Is Needed... But Not Expected , 2013 .

[52]  Bart P. Knijnenburg,et al.  Evaluating Recommender Systems with User Experiments , 2015, Recommender Systems Handbook.

[53]  Sally Jo Cunningham,et al.  'More of an Art than a Science': Supporting the Creation of Playlists and Mixes , 2006, ISMIR.

[54]  Andreas Butz,et al.  Rush: repeated recommendations on mobile devices , 2010, IUI '10.

[55]  Ana Paula Couto da Silva,et al.  Mixtape: Using Real-Time User Feedback to Navigate Large Media Collections , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[56]  Bernd Ludwig,et al.  InCarMusic: Context-Aware Music Recommendations in a Car , 2011, EC-Web.

[57]  Shawn P. Curley,et al.  Recommender systems, consumer preferences, and anchoring effects , 2011, RecSys 2011.

[58]  Jin Ha Lee,et al.  How Similar Is Too Similar?: Exploring Users' Perceptions of Similarity in Playlist Evaluation , 2011, ISMIR.

[59]  Peter Emerson,et al.  The original Borda count and partial voting , 2013, Soc. Choice Welf..

[60]  Mouzhi Ge,et al.  Recommender Systems in Computer Science and Information Systems-a Landscape of Research , 2012 .

[61]  Torsten Möller,et al.  A Survey on Music Listening and Management Behaviours , 2012, ISMIR.

[62]  Dietmar Jannach,et al.  Beyond "Hitting the Hits": Generating Coherent Music Playlist Continuations with the Right Tracks , 2015, RecSys.

[63]  R. Nosofsky,et al.  Seven plus or minus two: a commentary on capacity limitations. , 1994, Psychological review.

[64]  Li Chen,et al.  A user-centric evaluation framework for recommender systems , 2011, RecSys '11.

[65]  M. Lepper,et al.  The Construction of Preference: When Choice Is Demotivating: Can One Desire Too Much of a Good Thing? , 2006 .

[66]  Ricardo Dias,et al.  From manual to assisted playlist creation: a survey , 2017, Multimedia Tools and Applications.

[67]  Gert R. G. Lanckriet,et al.  Hypergraph Models of Playlist Dialects , 2012, ISMIR.

[68]  Ulrike Gretzel,et al.  Persuasion in Recommender Systems , 2006, Int. J. Electron. Commer..

[69]  Denis Parra,et al.  Moodplay: Interactive Mood-based Music Discovery and Recommendation , 2016, UMAP.

[70]  Li Chen,et al.  Eye-Tracking Study of User Behavior in Recommender Interfaces , 2010, UMAP.

[71]  Dan Conway,et al.  How to Recommend?: User Trust Factors in Movie Recommender Systems , 2017, IUI.

[72]  Hiromu Yakura,et al.  FocusMusicRecommender: A System for Recommending Music to Listen to While Working , 2018, IUI.

[73]  Dong Liu,et al.  Visual Analyses of Music History: A User-Centric Approach , 2017, ArXiv.

[74]  Saverio Perugini Recommender Systems Research , 2005 .

[75]  Gregory W. Corder,et al.  Nonparametric Statistics : A Step-by-Step Approach , 2014 .

[76]  Sally Jo Cunningham,et al.  Finding New Music: A Diary Study of Everyday Encounters with Novel Songs , 2007, ISMIR.

[77]  Kirsten Swearingen,et al.  Interaction Design for Recommender Systems , 2002 .

[78]  Yngvar Kjus,et al.  Musical exploration via streaming services: The Norwegian experience , 2016 .

[79]  Rashmi R. Sinha,et al.  Comparing Recommendations Made by Online Systems and Friends , 2001, DELOS.

[80]  Dietmar Jannach,et al.  Analyzing the Characteristics of Shared Playlists for Music Recommendation , 2014, RSWeb@RecSys.