Listener Modeling and Context-Aware Music Recommendation Based on Country Archetypes

Music preferences are strongly shaped by the cultural and socio-economic background of the listener, which is reflected, to a considerable extent, in country-specific music listening profiles. Previous work has already identified several country-specific differences in the popularity distribution of music artists listened to. In particular, what constitutes the "music mainstream" strongly varies between countries. To complement and extend these results, the article at hand delivers the following major contributions: First, using state-of-the-art unsupervised learning techniques, we identify and thoroughly investigate (1) country profiles of music preferences on the fine-grained level of music tracks (in contrast to earlier work that relied on music preferences on the artist level) and (2) country archetypes that subsume countries sharing similar patterns of listening preferences. Second, we formulate four user models that leverage the user's country information on music preferences. Among others, we propose a user modeling approach to describe a music listener as a vector of similarities over the identified country clusters or archetypes. Third, we propose a context-aware music recommendation system that leverages implicit user feedback, where context is defined via the four user models. More precisely, it is a multi-layer generative model based on a variational autoencoder, in which contextual features can influence recommendations through a gating mechanism. Fourth, we thoroughly evaluate the proposed recommendation system and user models on a real-world corpus of more than one billion listening records of users around the world (out of which we use 369 million in our experiments) and show its merits vis-a-vis state-of-the-art algorithms that do not exploit this type of context information.

[1]  Young Min Baek,et al.  Relationship Between Cultural Distance and Cross-Cultural Music Video Consumption on YouTube , 2015 .

[2]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[3]  Tally Katz‐Gerro,et al.  Cultural Consumption and Social Stratification: Leisure Activities, Musical Tastes, and Social Location , 1999 .

[4]  Richard Layard,et al.  World happiness report 2016 - update , 2016 .

[5]  Philippe Coulangeon La stratification sociale des goûts musicaux , 2003 .

[6]  David Beer Genre, Boundary Drawing and the Classificatory Imagination , 2013 .

[7]  Xiao Hu,et al.  Cross-cultural similarities and differences in music mood perception , 2014 .

[8]  Paul DiMaggio,et al.  Cultural entrepreneurship in nineteenth-century Boston: the creation of an organizational base for high culture in America , 1982 .

[9]  J. Stephen Downie,et al.  "The Pain, the Pain": Modelling Music Information Behavior and the Songs We Hate , 2005, ISMIR.

[10]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[11]  Peter Knees,et al.  Music Recommender Systems , 2015, Recommender Systems Handbook.

[12]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[13]  Markus Schedl,et al.  Deep Learning in Music Recommendation Systems , 2019, Front. Appl. Math. Stat..

[14]  Bethany Bryson,et al.  What about the univores? Musical dislikes and group-based identity construction among Americans with low levels of education , 1997 .

[15]  Matthew D. Hoffman,et al.  Variational Autoencoders for Collaborative Filtering , 2018, WWW.

[16]  Fabio Aiolli,et al.  Efficient top-n recommendation for very large scale binary rated datasets , 2013, RecSys.

[17]  Bruce Ferwerda,et al.  Large-Scale Analysis of Group-Specific Music Genre Taste from Collaborative Tags , 2017, 2017 IEEE International Symposium on Multimedia (ISM).

[18]  Bruce Ferwerda,et al.  Indicators of Country Similarity in Terms of Music Taste, Cultural, and Socio-economic Factors , 2017, 2017 IEEE International Symposium on Multimedia (ISM).

[19]  B. Martens,et al.  Language, Copyright and Geographic Segmentation in the EU Digital, Single Market for Music and Film , 2015 .

[20]  Markus Schedl,et al.  Investigating country-specific music preferences and music recommendation algorithms with the LFM-1b dataset , 2017, International Journal of Multimedia Information Retrieval.

[21]  Thierry Bertin-Mahieux,et al.  The Million Song Dataset , 2011, ISMIR.

[22]  Jef Vlegels,et al.  Music classification, genres, and taste patterns: A ground-up network analysis on the clustering of artist preferences , 2017 .

[23]  Christine Bauer,et al.  Leveraging Multi-Method Evaluation for Multi-Stakeholder Settings , 2019, ImpactRS@RecSys.

[24]  Philippe Coulangeon,et al.  Testing the "Omnivore/Univore" Hypothesis in a Cross-National Perspective. On the Social Meaning of Ecletism in Musical Tastes , 2005 .

[25]  Jordi López-Sintas,et al.  Music access patterns: A social interpretation , 2014 .

[26]  A. Venrooij The aesthetic discourse space of popular music: 1985-86 and 2004-05 , 2009 .

[27]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[28]  G. Hofstede,et al.  Cultures and Organizations: Software of the Mind , 1991 .

[29]  Gediminas Adomavicius,et al.  Context-aware recommender systems , 2008, RecSys '08.

[30]  Timothy C. G. Fisher,et al.  Evolution, extinction, or status quo? Canadian performing arts audiences in the 1990s ? 1 This resea , 2003 .

[31]  Markus Schedl,et al.  Online Music Listening Culture of Kids and Adolescents: Listening Analysis and Music Recommendation Tailored to the Young , 2019, ArXiv.

[32]  Ann Colley,et al.  Young People's Musical Taste: Relationship With Gender and Gender‐Related Traits1 , 2008 .

[33]  M. Delsing,et al.  Intergenerational Continuity of Taste: Parental and Adolescent Music Preferences , 2011 .

[34]  Dietmar Jannach,et al.  Are we really making much progress? A worrying analysis of recent neural recommendation approaches , 2019, RecSys.

[35]  Philippe Coulangeon La stratification sociale des goûts musicaux : Le modèle de la légitimité culturelle en question , 2003 .

[36]  Karen Spärck Jones A statistical interpretation of term specificity and its application in retrieval , 2021, J. Documentation.

[37]  John Rust,et al.  Age trends in musical preferences in adulthood: 2. Sources of social influences as determinants of preferences , 2018 .

[38]  Markus Schedl,et al.  The LFM-1b Dataset for Music Retrieval and Recommendation , 2016, ICMR.

[39]  Thorsten Joachims,et al.  Taste Space Versus the World: an Embedding Analysis of Listening Habits and Geography , 2014, ISMIR.

[40]  E. Jephcott,et al.  Dialectic of Enlightenment , 2002 .

[41]  John Sonnett,et al.  Ambivalence, indifference, distinction: A comparative netfield analysis of implicit musical boundaries , 2016 .

[42]  Markus Schedl,et al.  Genre-based Analysis of Social Media Data on Music Listening Behavior: Are Fans of Classical Music Really Averse to Social Media? , 2014, WISMM '14.

[43]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[44]  Mohan S. Kankanhalli,et al.  Exploring User-Specific Information in Music Retrieval , 2017, SIGIR.

[45]  Oliver Budzinski,et al.  Do preferences for pop music converge across countries? – Empirical evidence from the Eurovision Song Contest , 2017 .

[46]  Christine Bauer,et al.  Global and country-specific mainstreaminess measures: Definitions, analysis, and usage for improving personalized music recommendation systems , 2019, PloS one.

[47]  Markus Schedl,et al.  Order, context and popularity bias in next-song recommendations , 2019, International Journal of Multimedia Information Retrieval.

[48]  Eva Zangerle,et al.  Culture-Aware Music Recommendation , 2018, UMAP.

[49]  Derwin Suhartono,et al.  Music Recommender System Based on Genre using Convolutional Recurrent Neural Networks , 2019, Procedia Computer Science.

[50]  María N. Moreno García,et al.  A collaborative filtering method for music recommendation using playing coefficients for artists and users , 2016, Expert Syst. Appl..

[51]  Ichiro Fujinaga,et al.  Automatic Music Recommendation Systems: Do Demographic, Profiling, and Contextual Features Improve Their Performance? , 2016, ISMIR.

[52]  Christine Bauer,et al.  On the Importance of Considering Country-specific Aspects on the Online-Market: An Example of Music Recommendation Considering Country-Specific Mainstream , 2018, HICSS.

[53]  S. Gosling,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES The Do Re Mi’s of Everyday Life: The Structure and Personality Correlates of Music Preferences , 2003 .

[54]  Eva Zangerle,et al.  Mining Culture-Specific Music Listening Behavior from Social Media Data , 2017, 2017 IEEE International Symposium on Multimedia (ISM).

[55]  M. Guerzoni,et al.  Beyond Class Stratification: The Rise of the Eclectic Music Consumer in the Modern Age , 2018, Cultural Sociology.

[56]  Renzo Bianchi,et al.  On the relevance of music genre-based analysis in research on musical tastes , 2020, Psychology of Music.

[57]  Daniel G. Brown,et al.  On Cultural, Textual and Experiential Aspects of Music Mood , 2014, ISMIR.

[58]  Michael Seman,et al.  The Production and Consumption of Music in the Digital Age , 2018 .

[59]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[60]  Shin-Jye Lee,et al.  A social recommendation method based on the integration of social relationship and product popularity , 2019, Int. J. Hum. Comput. Stud..

[61]  R. Peterson,et al.  CHANGING HIGHBROW TASTE: FROM SNOB TO OMNIVORE* , 1996 .

[62]  William E. Huntzicker Highbrow/Lowbrow: The Emergence of Cultural Hierarchy in America , 1990 .

[63]  Hamed Zamani,et al.  Current challenges and visions in music recommender systems research , 2017, International Journal of Multimedia Information Retrieval.

[64]  Catherine J. Stevens,et al.  Music Perception and Cognition: A Review of Recent Cross-Cultural Research , 2012, Top. Cogn. Sci..

[65]  Morris B. Holbrook,et al.  Disentangling Effacement, Omnivore, and Distinction Effects on the Consumption of Cultural Activities: An Illustration , 2002 .

[66]  Michael I. Jordan,et al.  An Introduction to Variational Methods for Graphical Models , 1999, Machine Learning.

[67]  Man K. Xu,et al.  Music through the ages: Trends in musical engagement and preferences from adolescence through middle adulthood. , 2013, Journal of personality and social psychology.

[68]  Philippe Coulangeon,et al.  Social Stratification of Musical Tastes : Questioning the Cultural Legitimacy Model , 2005 .

[69]  Sushil Kumar,et al.  Location Aware Personalized News Recommender System Based on Twitter Popularity , 2018, ICCSA.

[70]  Tally Katz-Gerro,et al.  Highbrow Cultural Consumption and Class Distinction in Italy, Israel, West Germany, Sweden, and the United States , 2002 .

[71]  Bruce Ferwerda,et al.  Predicting Genre Preferences from Cultural and Socio-Economic Factors for Music Retrieval , 2017, ECIR.

[72]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[73]  Richard A. Peterson,et al.  The instability of omnivorous cultural taste over time , 2015 .

[74]  Steven M. Demorest,et al.  Cultural constraints on music perception and cognition. , 2009, Progress in brain research.

[75]  Cihan Kaleli,et al.  A review on deep learning for recommender systems: challenges and remedies , 2018, Artificial Intelligence Review.

[76]  Thomas Schäfer,et al.  Can personality traits predict musical style preferences? A meta-analysis , 2017 .