GroupSense

Human activity recognition using embedded mobile and embedded sensors is becoming increasingly important. Scaling up from individuals to groups, that is, Group Activity Recognition (GAR), has attracted significant attention recently. This article proposes a model and modeling language for GAR called GroupSense-L and a novel distributed middleware called GroupSense for mobile GAR. We implemented and tested GroupSense using smartphone sensors, smartwatch sensors, and embedded sensors in things, where we have a protocol for these different devices to exchange information required for GAR. A range of continuous group activities (from simple to fairly complex) illustrates our approach and demonstrates the feasibility of our model and richness of the proposed specialization. We then conclude with lessons learned for GAR and future work.

[1]  Husnu S. Narman,et al.  A Survey of Mobile Crowdsensing Techniques , 2018, ACM Trans. Cyber Phys. Syst..

[2]  Giancarlo Fortino,et al.  Cloud-based Activity-aaService cyber-physical framework for human activity monitoring in mobility , 2017, Future Gener. Comput. Syst..

[3]  Paul J. M. Havinga,et al.  Towards detection of bad habits by fusing smartphone and smartwatch sensors , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[4]  Hejun Wu,et al.  Identification of Partitions in a Homogeneous Activity Group Using Mobile Devices , 2016, Mob. Inf. Syst..

[5]  Arkady B. Zaslavsky,et al.  Complex activity recognition using context-driven activity theory and activity signatures , 2013, ACM Trans. Comput. Hum. Interact..

[6]  Andrew Raij,et al.  A Survey of Incentive Techniques for Mobile Crowd Sensing , 2015, IEEE Internet of Things Journal.

[7]  Hwan-Seung Yong,et al.  Conceptual group activity recognition model for classroom environments , 2015, 2015 International Conference on Information and Communication Technology Convergence (ICTC).

[8]  Hai Jin,et al.  Speed-Density Model of Interrupted Traffic Flow Based on Coil Data , 2016, Mob. Inf. Syst..

[9]  Haiying Shen,et al.  A Survey of Mobile Crowdsensing Techniques: A Critical Component for the Internet of Things , 2016, ICCCN.

[10]  Byoungheon Shin,et al.  Temporal Dependency Rule Learning Based Group Activity Recognition in Smart Spaces , 2016, 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC).

[11]  Dirk Helbing,et al.  Recognition of crowd behavior from mobile sensors with pattern analysis and graph clustering methods , 2011, Networks Heterog. Media.

[12]  R. Scowen Extended BNF — A generic base standard , 1998 .

[13]  Zhuo Chen,et al.  Edge Analytics in the Internet of Things , 2015, IEEE Pervasive Computing.

[14]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[15]  Chris D. Nugent,et al.  Ontology-based activity recognition in intelligent pervasive environments , 2009, Int. J. Web Inf. Syst..

[16]  Adam Stroud,et al.  Professional Android Sensor Programming , 2012 .

[17]  Cem Ersoy,et al.  A Review and Taxonomy of Activity Recognition on Mobile Phones , 2013 .

[18]  Guang-Zhong Yang,et al.  Sensor Positioning for Activity Recognition Using Wearable Accelerometers , 2011, IEEE Transactions on Biomedical Circuits and Systems.

[19]  Fan Ye,et al.  Mobile crowdsensing: current state and future challenges , 2011, IEEE Communications Magazine.

[20]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[21]  Vigneshwaran Subbaraju,et al.  The case for smartwatch-based diet monitoring , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[22]  Michael Beigl,et al.  Group affiliation detection using model divergence for wearable devices , 2014, SEMWEB.

[23]  Amir Shirkhodaie,et al.  Knowledge discovery in group activities through sequential observation analysis , 2014, Defense + Security Symposium.

[24]  Yi-Ting Chiang,et al.  Interaction‐Feature Enhanced Multiuser Model Learning for a Home Environment Using Ambient Sensors , 2014, Int. J. Intell. Syst..

[25]  Michael Beigl,et al.  Activity recognition for creatures of habit , 2014, Pers. Ubiquitous Comput..

[26]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection , 1998 .

[27]  John Nelson,et al.  Multi-Sensor Fusion for Enhanced Contextual Awareness of Everyday Activities with Ubiquitous Devices , 2014, Sensors.

[28]  Michael Beigl,et al.  Towards Collaborative Group Activity Recognition Using Mobile Devices , 2013, Mob. Networks Appl..

[29]  Haleh Amintoosi,et al.  A survey on participant recruitment in crowdsensing systems , 2016, 2016 6th International Conference on Computer and Knowledge Engineering (ICCKE).

[30]  Gary M. Weiss,et al.  The Impact of Personalization on Smartphone-Based Activity Recognition , 2012, AAAI 2012.

[31]  Takuya Maekawa,et al.  A hybrid unsupervised/supervised model for group activity recognition , 2013, ISWC '13.

[32]  R. Mautz Indoor Positioning Technologies , 2012 .

[33]  Amin Bakhshandehabkenar,et al.  MyActivity: Cloud-Hosted Continuous Activity Recognition Using Ontology-Based Stream Reasoning , 2014, 2014 2nd IEEE International Conference on Mobile Cloud Computing, Services, and Engineering.

[34]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[35]  J. Wenny Rahayu,et al.  Energy Considerations for Continuous Group Activity Recognition Using Mobile Devices: The Case of GroupSense , 2016, 2016 IEEE 30th International Conference on Advanced Information Networking and Applications (AINA).

[36]  S. Marchand-Maillet,et al.  Bluetooth Indoor Positioning , 2012 .

[37]  Yu Sun,et al.  Mobile Crowd Sensing for Internet of Things: A Credible Crowdsourcing Model in Mobile-Sense Service , 2015, 2015 IEEE International Conference on Multimedia Big Data.

[38]  James Llinas,et al.  Handbook of Multisensor Data Fusion : Theory and Practice, Second Edition , 2008 .

[39]  Yunhao Liu,et al.  Incentives for Mobile Crowd Sensing: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[40]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection: A Data Mining Perspective , 1998 .

[41]  Arkady B. Zaslavsky,et al.  Context Aware Computing for The Internet of Things: A Survey , 2013, IEEE Communications Surveys & Tutorials.