Ontology-driven semantic unified modelling for concurrent activity recognition (OSCAR)

Activity recognition has a vital role in smart home operations. One of the major challenges in object-sensor-based activity recognition is to learn the complete activity model derived from a generic activity model for sequential and parallel activities. Such challenge exists due to erratic degrees of dissimilar activities in which inhabitants perform activities in sequential and interleaved fashion while interacting with different objects. The proposed work focuses on recognizing a complete set of actions (of activity) by exploiting different knowledge engineering techniques, ontology-based temporal formalisms and data driven techniques. Semantic Segmentation has been employed to establish the generic activity model. The spurious semantic segmentation produced by sensor noise or erratic behaviour is removed by Allen’s temporal formalism. Moreover, Tversky’s feature-based similarity has been used to remove the highly similar spurious activities produced as a result of mistaken interactions with wrong home objects. The duration to perform activities varies among inhabitants; such duration intervals are identified dynamically using the proposed model in order to have a complete activity model. A comprehensive set of experiments has been carried out for evaluating the proposed model where the results based upon different metrics assert its effectiveness especially when compared with other contemporary techniques.

[1]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Uzay Kaymak,et al.  Knowledge Engineering in a Temporal Semantic Web Context , 2008, 2008 Eighth International Conference on Web Engineering.

[3]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[4]  Sharifullah Khan,et al.  Semantic matching in hierarchical ontologies , 2014, J. King Saud Univ. Comput. Inf. Sci..

[5]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[6]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Chris D. Nugent,et al.  An Ontology-Based Hybrid Approach to Activity Modeling for Smart Homes , 2014, IEEE Transactions on Human-Machine Systems.

[8]  Hongbin Zha,et al.  Visual analysis of child-adult interactive behaviors in video sequences , 2010, 2010 16th International Conference on Virtual Systems and Multimedia.

[9]  Aitor Almeida,et al.  Extending knowledge-driven activity models through data-driven learning techniques , 2015, Expert Syst. Appl..

[10]  Mubarak Shah,et al.  Ontology and taxonomy collaborated framework for meeting classification , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Veena Gulhane,et al.  Real time composite user activity modelling using hybrid approach for recognition , 2015, 2015 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT).

[12]  Federica Cena,et al.  Property-based Semantic Similarity: What Counts? , 2015, AIC.

[13]  Jian Lu,et al.  A Pattern Mining Approach to Sensor-Based Human Activity Recognition , 2011, IEEE Transactions on Knowledge and Data Engineering.

[14]  Georgios Meditskos,et al.  ReDef: Context-aware Recognition of Interleaved Activities using OWL 2 and Defeasible Reasoning , 2015, SSN-TC/OrdRing@ISWC.

[15]  Luming Zhang,et al.  Fortune Teller: Predicting Your Career Path , 2016, AAAI.

[16]  Simon A. Dobson,et al.  KCAR: A knowledge-driven approach for concurrent activity recognition , 2015, Pervasive Mob. Comput..

[17]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[18]  Chris D. Nugent,et al.  Ontology-based activity recognition in intelligent pervasive environments , 2009, Int. J. Web Inf. Syst..

[19]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[20]  Cem Ersoy,et al.  Effective Performance Metrics for Evaluating Activity Recognition Methods , 2011, ARCS.

[21]  Hongbin Zha,et al.  Tracking Generic Human Motion via Fusion of Low- and High-Dimensional Approaches , 2013, IEEE Trans. Syst. Man Cybern. Syst..

[22]  James F. Allen,et al.  Actions and Events in Interval Temporal Logic , 1994 .

[23]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[24]  Hongbin Zha,et al.  Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[25]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[26]  Claudio Bettini,et al.  COSAR: hybrid reasoning for context-aware activity recognition , 2011, Personal and Ubiquitous Computing.

[27]  Jun Zhong,et al.  Towards unsupervised physical activity recognition using smartphone accelerometers , 2016, Multimedia Tools and Applications.

[28]  Li Liu,et al.  Recognizing Complex Activities by a Probabilistic Interval-Based Model , 2016, AAAI.

[29]  Ramakant Nevatia,et al.  An Ontology for Video Event Representation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[30]  Heiner Stuckenschmidt,et al.  Recognizing interleaved and concurrent activities: A statistical-relational approach , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[31]  P. Nijkamp,et al.  Smart Cities in Europe , 2011 .

[32]  Monique Thonnat,et al.  A video interpretation platform applied to bank agency monitoring , 2004 .

[33]  Susan Elias,et al.  Composite Activity Recognition in Smart Homes Using Markov Logic Network , 2014, 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops.

[34]  Claudio Bettini,et al.  Is ontology-based activity recognition really effective? , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[35]  M. Hemalatha.  Time ontology with Reference Event based Temporal Relations (RETR) , 2012 .

[36]  Diane J Cook,et al.  Tracking Activities in Complex Settings Using Smart Environment Technologies. , 2009, International journal of biosciences, psychiatry, and technology.

[37]  Liming Chen,et al.  A Knowledge-Driven Approach to Composite Activity Recognition in Smart Environments , 2012, UCAmI.

[38]  Richard Fikes,et al.  A Reusable Ontology for Fluents in OWL , 2006, FOIS.

[39]  Heiner Stuckenschmidt,et al.  Recognizing interleaved and concurrent activities using qualitative and quantitative temporal relationships , 2011, Pervasive Mob. Comput..

[40]  M. P. Cuéllar,et al.  Handling Real-World Context Awareness, Uncertainty and Vagueness in Real-Time Human Activity Tracking and Recognition with a Fuzzy Ontology-Based Hybrid Method , 2014, Sensors.

[41]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[42]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[43]  Timo Sztyler,et al.  Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning , 2016, UbiComp.

[44]  Simon A. Dobson,et al.  Activity recognition using temporal evidence theory , 2010, J. Ambient Intell. Smart Environ..

[45]  Yu Zheng,et al.  Urban Water Quality Prediction Based on Multi-Task Multi-View Learning , 2016, IJCAI.