A smartphone-based activity-aware system for music streaming recommendation

Abstract Contextual information is helpful in building systems that can meet users’ needs more efficiently and practically. Human activity provides a special kind of contextual information that can be combined with the perceived environmental data to determine appropriate service actions. In this study, we develop a smartphone-based mobile system that includes two core modules for recognizing human activities and then making music streaming recommendation accordingly. Machine learning methods with feature selection techniques are used to perform activity recognition from smartphone signals, and collaborative filtering methods are adopted for music recommendation. A series of experiments are conducted to evaluate the performance of our activity-aware framework. Moreover, we implement a mobile music streaming recommendation system on a smartphone-cloud platform to demonstrate that the proposed approach is practical and applicable to real-world applications.

[1]  Mehrnoush Shamsfard,et al.  Matrix Factorization with Explicit Trust and Distrust Side Information for Improved Social Recommendation , 2014, TOIS.

[2]  Jialie Shen,et al.  On Effective Location-Aware Music Recommendation , 2016, ACM Trans. Inf. Syst..

[3]  Marc Leman,et al.  D-Jogger: Syncing Music with Walking , 2010 .

[4]  Wan-Yu Deng,et al.  Cross-person activity recognition using reduced kernel extreme learning machine , 2014, Neural Networks.

[5]  Zhenyu He,et al.  Activity recognition from acceleration data based on discrete consine transform and SVM , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[6]  E. Schellenberg,et al.  Misery loves company: mood-congruent emotional responding to music. , 2011, Emotion.

[7]  Matthias Budde,et al.  ActiServ: Activity Recognition Service for mobile phones , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[8]  Markus Schedl,et al.  The neglected user in music information retrieval research , 2013, Journal of Intelligent Information Systems.

[9]  Francesco Ricci,et al.  Location-aware music recommendation using auto-tagging and hybrid matching , 2013, RecSys.

[10]  Léon Bottou,et al.  The Tradeoffs of Large Scale Learning , 2007, NIPS.

[11]  Eibe Frank,et al.  Large-scale attribute selection using wrappers , 2009, 2009 IEEE Symposium on Computational Intelligence and Data Mining.

[12]  Bill Tomlinson,et al.  PersonalSoundtrack: context-aware playlists that adapt to user pace , 2006, CHI Extended Abstracts.

[13]  Claudio Bettini,et al.  COSAR: hybrid reasoning for context-aware activity recognition , 2011, Personal and Ubiquitous Computing.

[14]  David S. Rosenblum,et al.  Context-aware mobile music recommendation for daily activities , 2012, ACM Multimedia.

[15]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[16]  Eulàlia Puig Abril,et al.  Tracking Myself: Assessing the Contribution of Mobile Technologies for Self-Trackers of Weight, Diet, or Exercise , 2016, Journal of health communication.

[17]  Diane J. Cook,et al.  Activity Discovery and Activity Recognition: A New Partnership , 2013, IEEE Transactions on Cybernetics.

[18]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[19]  Daniele Quercia,et al.  Recommending Social Events from Mobile Phone Location Data , 2010, 2010 IEEE International Conference on Data Mining.

[20]  Sanjay Kumar Dubey,et al.  A Novel Data Mining Scheme for Smartphone Activity Recognition by Accelerometer Sensor , 2015, FICTA.

[21]  Guandong Xu,et al.  Exploring user emotion in microblogs for music recommendation , 2015, Expert Syst. Appl..

[22]  Seungmin Rho,et al.  Music emotion classification and context-based music recommendation , 2010, Multimedia Tools and Applications.

[23]  Peter Knees,et al.  A survey of music similarity and recommendation from music context data , 2013, ACM Trans. Multim. Comput. Commun. Appl..

[24]  Filip De Turck,et al.  Novel Applications Integrate Location and Context Information , 2012, IEEE Pervasive Computing.

[25]  Bernd Ludwig,et al.  Context relevance assessment and exploitation in mobile recommender systems , 2012, Personal and Ubiquitous Computing.

[26]  Chia-Chin Chong,et al.  From Mobile Phones to Personal Wellness Dashboards , 2010, IEEE Pulse.

[27]  Anupriya Ankolekar,et al.  Foxtrot: a soundtrack for where you are , 2011, IwS '11.

[28]  Victor C. M. Leung,et al.  SAfeDJ , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[29]  Franco Zambonelli,et al.  Looking ahead in pervasive computing: Challenges and opportunities in the era of cyber-physical convergence , 2012, Pervasive Mob. Comput..

[30]  Francesco Ricci,et al.  Context-Aware Recommender Systems , 2011, AI Mag..

[31]  Wazir Zada Khan,et al.  Mobile Phone Sensing Systems: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[32]  Susanne Robra-Bissantz,et al.  AmbiTune: Bringing Context-Awareness to Music Playlists while Driving , 2014, DESRIST.

[33]  Francesco Ricci,et al.  Contextual music information retrieval and recommendation: State of the art and challenges , 2012, Comput. Sci. Rev..

[34]  Markus Schedl,et al.  Iron Maiden While Jogging, Debussy for Dinner? - An Analysis of Music Listening Behavior in Context , 2015, MMM.

[35]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[36]  Federica Cena,et al.  Should I Stay or Should I Go? Improving Event Recommendation in the Social Web , 2014, Interact. Comput..

[37]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[38]  Brian P. Bailey,et al.  DJogger: a mobile dynamic music device , 2006, CHI Extended Abstracts.

[39]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[40]  Xiang Li,et al.  Next-song recommendation with temporal dynamics , 2015, Knowl. Based Syst..

[41]  Jun Hu,et al.  Heart rate controlled music recommendation for low stress air travel , 2015 .

[42]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[43]  Miguel A. Labrador,et al.  Centinela: A human activity recognition system based on acceleration and vital sign data , 2012, Pervasive Mob. Comput..

[44]  Hojung Cha,et al.  Crowdsensing-based Wi-Fi radio map management using a lightweight site survey , 2015, Comput. Commun..

[45]  Markus Schedl,et al.  Mobile Music Genius: Reggae at the Beach, Metal on a Friday Night? , 2014, ICMR.

[46]  Wei-Po Lee,et al.  Making smartphone service recommendations by predicting users' intentions: A context-aware approach , 2014, Inf. Sci..