MSSN-Onto: An ontology-based approach for flexible event processing in Multimedia Sensor Networks

Abstract Multimedia Sensor Networks (MSNs) have gained much attention in recent years from the emerging trends of Internet of Things (IoT). They can be found in different scenarios in our everyday life (e.g., smart homes, smart buildings). Sensors in MSNs can have different capacities, produce multiple kinds of outputs, and have different output encoding formats. Thus, detecting complex events, which requires the aggregation of several sensor readings, can be difficult due to the lack of a generic model that can describe: (i) sensor networks infrastructure, (ii) individual sensor specificities, as well as (iii) multimedia data, while allowing the alignment with the application domain knowledge. In this study, we propose Multimedia Semantic Sensor Network Ontology (MSSN-Onto) to ensure MSNs modeling and provide both syntactic and semantic data interoperability for defining and detecting events in various domains. To show the readiness of MSSN-Onto, we used it as the core ontology of a dedicated framework (briefly defined here). We also adopted MSSN-Onto in HIT2GAP European Project. A prototype has been implemented to conduct a set of tests. Experimental results show that MSSN-Onto can be used to: (i) effectively model MSNs and multimedia data; (ii) define complex events; and (iii) allow to build an efficient event querying engine for MSNs.

[1]  C. Tsinaraki,et al.  Interoperability Support for Ontology-Based Video Retrieval Applications , 2004, CIVR.

[2]  Qin Ni,et al.  A foundational ontology-based model for human activity representation in smart homes , 2016, J. Ambient Intell. Smart Environ..

[3]  Craig MacDonald,et al.  Multimedia search over integrated social and sensor networks , 2012, WWW.

[4]  Mike Flynn,et al.  Browsing Recorded Meetings with Ferret , 2004, MLMI.

[5]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[6]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[7]  Jane Hunter,et al.  Enhancing the semantic interoperability of multimedia through a core ontology , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Srinivasan Seshan,et al.  IrisNet: An Architecture for a Worldwide Sensor Web , 2003, IEEE Pervasive Comput..

[9]  John Davidson,et al.  Ogc® sensor web enablement:overview and high level achhitecture. , 2007, 2007 IEEE Autotestcon.

[10]  Thanos G. Stavropoulos,et al.  BOnSAI: a smart building ontology for ambient intelligence , 2012, WIMS '12.

[11]  Carlos Rueda,et al.  The MMI Ontology Registry and Repository: A portal for Marine Metadata Interoperability , 2009, OCEANS 2009.

[12]  J. Caleb Goodwin,et al.  Ontology integration within a service‐oriented architecture for expert system applications using sensor networks , 2009, Expert Syst. J. Knowl. Eng..

[13]  Steffen Staab,et al.  COMM: Designing a Well-Founded Multimedia Ontology for the Web , 2007, ISWC/ASWC.