Automatic playlist generation using Convolutional Neural Networks and Recurrent Neural Networks

Nowadays, a great part of music consumption on music streaming services are based on playlists. Playlists are still mainly manually generated by expert curators, or users, process that in several cases is not a feasible with huge amount of music to deal with. There is the need of effective automatic playlist generation techniques. Traditional approaches to the problem are based on building a sequence of music pieces that satisfies some manually defined criteria. However, being the playlist generation a highly subjective procedure, to define an a-priori criterion can be an hard task in several cases. In this study we propose an automatic playlist generation approach which analyses hand-crafted playlists, understands their structure and evolution and generates new playlists accordingly. We adopt Recurrent Neural Network (RNN) for the sequence modelling. Moreover, since the representation model adopted to describe each song is determinant and is also connected to the human perception, we take advantages of Convolutions Neural Network (CNN) to learn meaningful audio descriptors.

[1]  S. C. Kremer,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[2]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[3]  James C. French,et al.  Flycasting: using collaborative filtering to generate a playlist for online radio , 2001, Proceedings First International Conference on WEB Delivering of Music. WEDELMUSIC 2001.

[4]  Lewis B. Sheiner,et al.  Some suggestions for measuring predictive performance , 1981, Journal of Pharmacokinetics and Biopharmaceutics.

[5]  Peter Knees,et al.  Accessing Music Collections Via Representative Cluster Prototypes in a Hierarchical Organization Scheme , 2008, ISMIR.

[6]  Marios Hadjieleftheriou,et al.  R-Trees - A Dynamic Index Structure for Spatial Searching , 2008, ACM SIGSPATIAL International Workshop on Advances in Geographic Information Systems.

[7]  Syed Sibte Raza Abidi,et al.  A Web Recommender System for Recommending, Predicting and Personalizing Music Playlists , 2009, WISE.

[8]  Juan Pablo Bello,et al.  Automated Music Emotion Recognition: A Systematic Evaluation , 2010 .

[9]  Jane Yung-jen Hsu,et al.  A Reinforcement Learning Approach to Emotion-based Automatic Playlist Generation , 2010, 2010 International Conference on Technologies and Applications of Artificial Intelligence.

[10]  João André Ferro Fernandes Automatic Playlist Generation via Music Mood Analysis , 2010 .

[11]  J. K. Roberts,et al.  Explained Variance in Multilevel Models , 2010 .

[12]  Gert R. G. Lanckriet,et al.  The Natural Language of Playlists , 2011, ISMIR.

[13]  Thorsten Joachims,et al.  Learning to Embed Songs and Tags for Playlist Prediction , 2012, ISMIR.

[14]  Gert R. G. Lanckriet,et al.  Hypergraph Models of Playlist Dialects , 2012, ISMIR.

[15]  Thorsten Joachims,et al.  Playlist prediction via metric embedding , 2012, KDD.

[16]  Benjamin Schrauwen,et al.  Deep content-based music recommendation , 2013, NIPS.

[17]  Dietmar Jannach,et al.  Automated Generation of Music Playlists: Survey and Experiments , 2014, ACM Comput. Surv..

[18]  Dietmar Jannach,et al.  Beyond "Hitting the Hits": Generating Coherent Music Playlist Continuations with the Right Tracks , 2015, RecSys.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Mark B. Sandler,et al.  Towards Playlist Generation Algorithms Using RNNs Trained on Within-Track Transitions , 2016, UMAP.

[21]  Markus Schedl,et al.  Music Playlist Continuation by Learning from Hand-Curated Examples and Song Features: Alleviating the Cold-Start Problem for Rare and Out-of-Set Songs , 2017, DLRS@RecSys.

[22]  Juho Kim,et al.  Kapre: On-GPU Audio Preprocessing Layers for a Quick Implementation of Deep Neural Network Models with Keras , 2017, ArXiv.

[23]  Mark Sandler,et al.  Transfer Learning for Music Classification and Regression Tasks , 2017, ISMIR.

[24]  Markus Schedl,et al.  The Importance of Song Context and Song Order in Automated Music Playlist Generation , 2018, ArXiv.