Socialite: Social Activity Mining and Friend Auto-labeling

As people's friend lists grow longer, it becomes more and more difficult to manage a friend list by labeling or grouping friends manually. In this paper, we leverage on-board sensors of smart devices and propose a social activity mining framework Socialite, which is able to achieve social group discovering and friend auto-labeling by exploring users' interactions in physical word. Socialite considers different deployment strategies and mainly contains two stages: social activity recognition and social group detection. Together with several data analysis approaches, a voting based lightweight neural network is designed for high accuracy diverse activity recognition. Then we propose a novel algorithm for social interaction feature generation and measure correlation among features of even asynchronous social activities. For system evaluation, we conduct extensive real life experiments. Results demonstrate that Socialite can recognize diverse social activities with above 94% accuracy, and 100% accuracy with our voting scheme. Socialite can also detect social groups in different scenarios with high accuracy. For example in two people activities, our proposed method achieves 92.2% accuracy for walk and 92.6% accuracy for table tennis.

[1]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[2]  Leonid Sigal,et al.  Poselet Key-Framing: A Model for Human Activity Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[4]  Jian Zhang,et al.  Two-Stage Friend Recommendation Based on Network Alignment and Series Expansion of Probabilistic Topic Model , 2017, IEEE Transactions on Multimedia.

[5]  Dawud Gordon Group Activity Recognition Using Wearable Sensing Devices , 2014 .

[6]  Gary M. Weiss,et al.  Design considerations for the WISDM smart phone-based sensor mining architecture , 2011, SensorKDD '11.

[7]  Andreu Català,et al.  Basketball Activity Recognition using Wearable Inertial Measurement Units , 2015, Interacción.

[8]  Mikkel Baun Kjærgaard,et al.  Detecting pedestrian flocks by fusion of multi-modal sensors in mobile phones , 2012, UbiComp.

[9]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[10]  A. Yao,et al.  Fair exchange with a semi-trusted third party (extended abstract) , 1997, CCS '97.

[11]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[13]  Michael Beigl,et al.  Energy-Efficient Activity Recognition Using Prediction , 2012, 2012 16th International Symposium on Wearable Computers.

[14]  Sung-Bae Cho,et al.  Building Mobile Social Network with Semantic Relation Using Bayesian NeTwork-based Life-log Mining , 2010, 2010 IEEE Second International Conference on Social Computing.

[15]  Hamed Haddadi,et al.  Walking in Sync: Two is Company, Three's a Crowd , 2015, WPA@MobiSys.

[16]  Hanghang Tong,et al.  Activity recognition with smartphone sensors , 2014 .

[17]  Yunhao Liu,et al.  Privacy-friendly photo capturing and sharing system , 2016, UbiComp.

[18]  Christos Faloutsos,et al.  AutoPlait: automatic mining of co-evolving time sequences , 2014, SIGMOD Conference.

[19]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[20]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[21]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[22]  Yeng Chai Soh,et al.  Robust Human Activity Recognition Using Smartphone Sensors via CT-PCA and Online SVM , 2017, IEEE Transactions on Industrial Informatics.

[23]  Jing Xiao,et al.  Friend Recommendation by User Similarity Graph Based on Interest in Social Tagging Systems , 2015, ICIC.

[24]  Daling Wang,et al.  A Unified Microblog User Similarity Model for Online Friend Recommendation , 2014, NLPCC.

[25]  Daniel P. W. Ellis,et al.  Speech and Audio Signal Processing - Processing and Perception of Speech and Music, Second Edition , 1999 .

[26]  Roksana Boreli,et al.  The Where and When of Finding New Friends: Analysis of a Location-based Social Discovery Network , 2013, ICWSM.

[27]  Jian Zhang,et al.  Social Friend Recommendation Based on Multiple Network Correlation , 2016, IEEE Transactions on Multimedia.

[28]  Jae-Young Pyun,et al.  Deep Recurrent Neural Networks for Human Activity Recognition , 2017, Sensors.

[29]  Kanchana Thilakarathna,et al.  A deep dive into location-based communities in social discovery networks , 2017, Comput. Commun..

[30]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[31]  Peter L. Bartlett,et al.  Boosting Algorithms as Gradient Descent , 1999, NIPS.

[32]  Ahmad-Reza Sadeghi,et al.  Context-Based Zero-Interaction Pairing and Key Evolution for Advanced Personal Devices , 2014, CCS.

[33]  Daniel Vélez Día,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[34]  Hairong Qi,et al.  Friendbook: A Semantic-Based Friend Recommendation System for Social Networks , 2015, IEEE Transactions on Mobile Computing.

[35]  Yunhao Liu,et al.  Message in a Sealed Bottle: Privacy Preserving Friending in Mobile Social Networks , 2015, IEEE Transactions on Mobile Computing.

[36]  Xiang-Yang Li,et al.  Privacy.tag: privacy concern expressed and respected , 2014, SenSys.