Pervasive and Mobile Computing ( ) – Pervasive and Mobile Computing Semantic Web Technologies in Pervasive Computing: a Survey and Research Roadmap

Pervasive and sensor-driven systems are by nature open and extensible, both in terms of input and tasks they are required to perform. Data streams coming from sensors are inherently noisy, imprecise and inaccurate, with differing sampling rates and complex correlations with each other. These characteristics pose a significant challenge for traditional approaches to storing, representing, exchanging, manipulating and programming with sensor data. Semantic Web technologies provide a uniform framework for capturing these properties. Offering powerful representation facilities and reasoning techniques, these technologies are rapidly gaining attention towards facing a range of issues such as data and knowledge modelling, querying, reasoning, service discovery, privacy and provenance. This article reviews the application of the Semantic Web to pervasive and sensor-driven systems with a focus on information modelling and reasoning along with streaming data and uncertainty handling. The strengths and weaknesses of current and projected approaches are analysed and a roadmap is derived for using the Semantic Web as a platform, on which open, standard-based, pervasive, adaptive and sensor-driven systems can be deployed.

[1]  Marek J. Sergot,et al.  A logic-based calculus of events , 1989, New Generation Computing.

[2]  Boris Motik,et al.  Query Answering for OWL-DL with Rules , 2004, SEMWEB.

[3]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[4]  Amit P. Sheth,et al.  The SSN ontology of the W3C semantic sensor network incubator group , 2012, J. Web Semant..

[5]  Max Völkel,et al.  RDFReactor – From Ontologies to Programatic Data Access , 2006 .

[6]  Amit P. Sheth,et al.  Semantic Sensor Web , 2008, IEEE Internet Computing.

[7]  Andre Bolles,et al.  Streaming SPARQL - Extending SPARQL to Process Data Streams , 2008, ESWC.

[8]  Anni-Yasmin Turhan,et al.  Employing description logics in Ambient Intelligence for modeling and reasoning about complex situations , 2009, J. Ambient Intell. Smart Environ..

[9]  Simon A. Dobson,et al.  LOC8: A Location Model and Extensible Framework for Programming with Location , 2010, IEEE Pervasive Computing.

[10]  Alexander Schatten,et al.  Event Cloud - Searching for Correlated Business Events , 2007, The 9th IEEE International Conference on E-Commerce Technology and The 4th IEEE International Conference on Enterprise Computing, E-Commerce and E-Services (CEC-EEE 2007).

[11]  Vassilis Christophides,et al.  On Provenance of Queries on Semantic Web Data , 2011, IEEE Internet Computing.

[12]  Ian Horrocks,et al.  Description logic programs: combining logic programs with description logic , 2003, WWW '03.

[13]  Orri Erling,et al.  Virtuoso, a Hybrid RDBMS/Graph Column Store , 2012, IEEE Data Eng. Bull..

[14]  D.J. Russomanno,et al.  Sensor ontologies: from shallow to deep models , 2005, Proceedings of the Thirty-Seventh Southeastern Symposium on System Theory, 2005. SSST '05..

[15]  Claudio Gutiérrez,et al.  Introducing Time into RDF , 2007, IEEE Transactions on Knowledge and Data Engineering.

[16]  Paulo Cesar G. da Costa,et al.  PR-OWL 2.0 - Bridging the gap to OWL semantics , 2010, URSW.

[17]  Sebastian Rudolph,et al.  Stream reasoning and complex event processing in ETALIS , 2012, Semantic Web.

[18]  Simon A. Dobson,et al.  Situation identification techniques in pervasive computing: A review , 2012, Pervasive Mob. Comput..

[19]  Paulo Cesar G. da Costa,et al.  PR-OWL: A Bayesian Ontology Language for the Semantic Web , 2005, ISWC-URSW.

[20]  Giulia Biamino,et al.  Modeling social contexts for pervasive computing environments , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[21]  Grigoris Antoniou,et al.  Contextual Argumentation in Ambient Intelligence , 2009, LPNMR.

[22]  Simon A. Dobson,et al.  Ontology-based models in pervasive computing systems , 2007, The Knowledge Engineering Review.

[23]  Diane J. Cook,et al.  Author's Personal Copy Pervasive and Mobile Computing Ambient Intelligence: Technologies, Applications, and Opportunities , 2022 .

[24]  Brian McBride,et al.  Jena: A Semantic Web Toolkit , 2002, IEEE Internet Comput..

[25]  Xing Xie,et al.  Mining interesting locations and travel sequences from GPS trajectories , 2009, WWW '09.

[26]  Daniel Nüst,et al.  Semantically-Enabled Sensor Plug & Play for the Sensor Web , 2011, Sensors.

[27]  Steffen Staab,et al.  Querying for provenance, trust, uncertainty and other meta knowledge in RDF , 2009, J. Web Semant..

[28]  Véronique Malaisé,et al.  Design and use of the Simple Event Model (SEM) , 2011, J. Web Semant..

[29]  Simon A. Dobson,et al.  PI: Perceiver and interpreter of smart home datasets , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[30]  Federica Paganelli,et al.  An Ontology-Based System for Context-Aware and Configurable Services to Support Home-Based Continuous Care , 2011, IEEE Transactions on Information Technology in Biomedicine.

[31]  Shoji Kurakake,et al.  Situational reasoning for task-oriented mobile service recommendation , 2008, The Knowledge Engineering Review.

[32]  Umberto Straccia,et al.  Combining Fuzzy Logic and Semantic Web to Enable Situation-Awareness in Service Recommendation , 2010, DEXA.

[33]  Sean Bechhofer,et al.  The OWL API: A Java API for OWL ontologies , 2011, Semantic Web.

[34]  Herve Martin,et al.  An Ontology-Based Approach to Represent Trajectory Characteristics , 2014, 2014 Fifth International Conference on Computing for Geospatial Research and Application.

[35]  Yarden Katz,et al.  Pellet: A practical OWL-DL reasoner , 2007, J. Web Semant..

[36]  Chris D. Nugent,et al.  Semantic Smart Homes: Towards Knowledge Rich Assisted Living Environments , 2009 .

[37]  Roy H. Campbell,et al.  Reasoning about Uncertain Contexts in Pervasive Computing Environments , 2004, IEEE Pervasive Comput..

[38]  Peter Steenkiste,et al.  A Hybrid Location Model with a Computable Location Identifier for Ubiquitous Computing , 2002, UbiComp.

[39]  Donovan S. Conley.  Virtuoso , 2008 .

[40]  Ramez Elmasri,et al.  The Time Index: An Access Structure for Temporal Data , 1990, VLDB.

[41]  Jin Song Dong,et al.  Semantic Space: an infrastructure for smart spaces , 2004, IEEE Pervasive Computing.

[42]  Frank van Harmelen,et al.  Towards Expressive Stream Reasoning , 2010, Semantic Challenges in Sensor Networks.

[43]  Jerry R. Hobbs,et al.  An ontology of time for the semantic web , 2004, TALIP.

[44]  Jadwiga Indulska,et al.  A survey of context modelling and reasoning techniques , 2010, Pervasive Mob. Comput..

[45]  Aldo Gangemi,et al.  Understanding the Semantic Web through Descriptions and Situations , 2003, OTM.

[46]  Nicola Guarino,et al.  A Pointless Theory of Space Based on Strong Connection and Congruence , 1996, KR.

[47]  Jian Yu,et al.  SCIMS: A Social Context Information Management System for Socially-Aware Applications , 2012, CAiSE.

[48]  Boris Motik,et al.  OWL 2: The next step for OWL , 2008, J. Web Semant..

[49]  Claudio Bettini,et al.  Context-Aware Activity Recognition through a Combination of Ontological and Statistical Reasoning , 2009, UIC.

[50]  Frank Dürr,et al.  Pervasive and Mobile Computing , 2012 .

[51]  Yun Peng,et al.  BayesOWL: Uncertainty Modeling in Semantic Web Ontologies , 2006 .

[52]  Timothy W. Finin,et al.  A Policy Based Approach to Security for the Semantic Web , 2003, SEMWEB.

[53]  Claudia Linnhoff-Popien,et al.  Applications of a Context Ontology Language , 2003 .

[54]  Graeme Stevenson,et al.  On the Impact of the Temporal Features of Sensed Data on the Development of Pervasive Systems , 2010 .

[55]  Roy H. Campbell,et al.  MiddleWhere: A Middleware for Location Awareness in Ubiquitous Computing Applications , 2004, Middleware.

[56]  Fabio Porto,et al.  A conceptual view on trajectories , 2008, Data Knowl. Eng..

[57]  Alexandre Passant,et al.  Modelling provenance of DBpedia resources using Wikipedia contributions , 2011, J. Web Semant..

[58]  Thomas Lukasiewicz.  Uncertainty Reasoning for the Semantic Web , 2009, RR.

[59]  Boris Motik,et al.  Reconciling description logics and rules , 2010, JACM.

[60]  Euripides G. M. Petrakis,et al.  Temporal Reasoning for Supporting Temporal Queries in OWL 2.0 , 2011, KES.

[61]  Vojtech Svátek,et al.  A Pattern-Based Framework for Uncertainty Representation in Ontologies , 2008, TSD.

[62]  Tomasz Wiktor Wlodarczyk,et al.  SWRL-F: a fuzzy logic extension of the semantic web rule language , 2011, WIMS '11.

[63]  Yiannis Kompatsiaris,et al.  Trends and Issues in Description Logics Frameworks for Image Interpretation , 2010, SETN.

[64]  Jae-Gil Lee,et al.  Mining Massive RFID, Trajectory, and Traffic Data Sets , 2008, Knowledge Discovery and Data Mining.

[65]  Jianhua Ma,et al.  iMuseum: A scalable context-aware intelligent museum system , 2008, Comput. Commun..

[66]  Klara Nahrstedt,et al.  A Middleware Infrastructure for Active Spaces , 2002, IEEE Pervasive Comput..

[67]  Max Völkel,et al.  RDFReactor – From Ontologies to Programmatic Data Access , 2006 .

[68]  Heiner Stuckenschmidt,et al.  A probabilistic ontological framework for the recognition of multilevel human activities , 2013, UbiComp.

[69]  Claudio Bettini,et al.  OWL 2 modeling and reasoning with complex human activities , 2011, Pervasive Mob. Comput..

[70]  Franco Zambonelli,et al.  Social sensors and pervasive services: Approaches and perspectives , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[71]  Claudio Bettini,et al.  Context provenance to enhance the dependability of ambient intelligence systems , 2011, Personal and Ubiquitous Computing.

[72]  Daniele Braga,et al.  Research chapters in the area of stream reasoning , 2009 .

[73]  Huajun Chen,et al.  The Semantic Web , 2011, Lecture Notes in Computer Science.

[74]  Franz Baader,et al.  An Overview of Tableau Algorithms for Description Logics , 2001, Stud Logica.

[75]  Claudio Bettini,et al.  COSAR: hybrid reasoning for context-aware activity recognition , 2011, Personal and Ubiquitous Computing.

[76]  Daniele Braga,et al.  Stream Reasoning : Where We Got So Far , 2010 .

[77]  Peter Baumgartner,et al.  A Novel Architecture for Situation Awareness Systems , 2009, TABLEAUX.

[78]  Dieter Fensel,et al.  Towards a Scalable, Pragmatic Knowledge Representation Language for the Web , 2009, Ershov Memorial Conference.

[79]  Brian McBride,et al.  Representing and Querying Historical Information in RDF with Application to E-Discovery , 2009 .

[80]  Umberto Straccia,et al.  Managing uncertainty and vagueness in description logics for the Semantic Web , 2008, J. Web Semant..

[81]  Kerry L. Taylor,et al.  Ontology-Driven Complex Event Processing in Heterogeneous Sensor Networks , 2011, ESWC.

[82]  V. S. Subrahmanian,et al.  Scaling RDF with Time , 2008, WWW.

[83]  Angelika Mueller.  Formal Modeling And Analysis Of Timed Systems , 2016 .

[84]  Mark A. Musen,et al.  The Knowledge Model of Protégé-2000: Combining Interoperability and Flexibility , 2000, EKAW.

[85]  Timothy W. Finin,et al.  On data management in pervasive computing environments , 2004, IEEE Transactions on Knowledge and Data Engineering.

[86]  Miguel A. Patricio,et al.  Ontology-based context representation and reasoning for object tracking and scene interpretation in video , 2011, Expert Syst. Appl..

[87]  Amit P. Sheth,et al.  SPARQL-ST: Extending SPARQL to Support Spatiotemporal Queries , 2011, Geospatial Semantics and the Semantic Web.

[88]  Lalana Kagal,et al.  A Semantic Context-Aware Access Control Framework for Secure Collaborations in Pervasive Computing Environments , 2006, SEMWEB.

[89]  Franco Zambonelli,et al.  Extracting urban patterns from location-based social networks , 2011, LBSN '11.

[90]  G Stix,et al.  The mice that warred. , 2001, Scientific American.

[91]  Barry Bishop,et al.  OWLIM: A family of scalable semantic repositories , 2011, Semantic Web.

[92]  Ramanathan V. Guha,et al.  Building large knowledge-based systems , 1989 .

[93]  Alessandro Campi,et al.  A First Step Towards Stream Reasoning , 2009, FIS.

[94]  Murray Shanahan,et al.  Perception as Abduction: Turning Sensor Data Into Meaningful Representation , 2005, Cogn. Sci..

[95]  Herman J. ter Horst,et al.  Extending the RDFS Entailment Lemma , 2004, SEMWEB.

[96]  Abraham Bernstein,et al.  Applied Temporal RDF: Efficient Temporal Querying of RDF Data with SPARQL , 2009, ESWC.

[97]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[98]  Klara Nahrstedt,et al.  Gaia: A Middleware Infrastructure to Enable Active Spaces1 , 2002 .

[99]  James F. Allen.  Towards a General Theory of Action and Time , 1984, Artif. Intell..

[100]  Grigoris Antoniou,et al.  A Reasoning Framework for Ambient Intelligence , 2010, SETN.

[101]  Joël Ouaknine,et al.  Some Recent Results in Metric Temporal Logic , 2008, FORMATS.

[102]  Anind K. Dey,et al.  TherML: occupancy prediction for thermostat control , 2013, UbiComp.

[103]  Weishan Zhang,et al.  Enhancing intelligence and dependability of a product line enabled pervasive middleware , 2010, Pervasive Mob. Comput..

[104]  Dieter Fensel,et al.  Towards LarKC: A Platform for Web-Scale Reasoning , 2008, 2008 IEEE International Conference on Semantic Computing.

[105]  Michael Mendler,et al.  Towards a Type System for Semantic Streams ? , 2009 .

[106]  Eva Blomqvist,et al.  Semantic Complex Event Processing for Social Media Monitoring-A Survey , 2013 .

[107]  PANTELIS LILIS.  A METADATA MODEL FOR REPRESENTING TIME-DEPENDENT INFORMATION IN CULTURAL COLLECTIONS , 2005 .

[108]  Archan Misra,et al.  MediAlly: A provenance-aware remote health monitoring middleware , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[109]  Ralf Möller,et al.  Formalizing Multimedia Interpretation based on Abduction over Description Logic Aboxes , 2009, Description Logics.

[110]  Paddy Nixon,et al.  Ontonym: a collection of upper ontologies for developing pervasive systems , 2009, CIAO '09.

[111]  Konstantinos Sagonas,et al.  XSB as an efficient deductive database engine , 1994, SIGMOD '94.

[112]  Adrian Paschke,et al.  Semantic Rule-Based Complex Event Processing , 2009, RuleML.

[113]  Martin Doerr,et al.  The CIDOC Conceptual Reference Module: An Ontological Approach to Semantic Interoperability of Metadata , 2003, AI Mag..

[114]  Yaron Kanza,et al.  D2RQ/update: updating relational data via virtual RDF , 2012, WWW.

[115]  Carsten Lutz,et al.  Temporal Description Logics: A Survey , 2008, 2008 15th International Symposium on Temporal Representation and Reasoning.

[116]  Christoph Stasch,et al.  A RESTful proxy and data model for linked sensor data , 2013, Int. J. Digit. Earth.

[117]  G. Stamou,et al.  Reasoning with Very Expressive Fuzzy Description Logics , 2007, J. Artif. Intell. Res..

[118]  Justin Schwartz.  Engineering , 1929, Nature.

[119]  WangHui,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012 .

[120]  Óscar Corcho,et al.  Five challenges for the Semantic Sensor Web , 2010, Semantic Web.

[121]  Enrico Motta,et al.  How Much Semantic Data on Small Devices? , 2010, EKAW.

[122]  Stathes Hadjiefthymiades,et al.  Context management in pervasive computing environments , 2005, ICPS '05. Proceedings. International Conference on Pervasive Services, 2005..

[123]  Volker Haarslev,et al.  Racer: A Core Inference Engine for the Semantic Web , 2003, EON.

[124]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[125]  Daniele Braga,et al.  C-SPARQL: a Continuous Query Language for RDF Data Streams , 2010, Int. J. Semantic Comput..

[126]  Yogesh L. Simmhan,et al.  The Open Provenance Model core specification (v1.1) , 2011, Future Gener. Comput. Syst..

[127]  Amit P. Sheth,et al.  A Survey of the Semantic Specification of Sensors , 2009, SSN.

[128]  Martin Hepp,et al.  GoodRelations: An Ontology for Describing Products and Services Offers on the Web , 2008, EKAW.

[129]  Riccardo Rosati,et al.  DL+log: Tight Integration of Description Logics and Disjunctive Datalog , 2006, KR.

[130]  Martin J. O'Connor,et al.  SQWRL: A Query Language for OWL , 2009, OWLED.

[131]  N. Andrienko,et al.  Basic Concepts of Movement Data , 2008, Mobility, Data Mining and Privacy.

[132]  Ramakant Nevatia,et al.  An Ontology for Video Event Representation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[133]  Michael Fisher,et al.  Temporal Representation and Reasoning , 2008, Handbook of Knowledge Representation.

[134]  Umberto Straccia,et al.  Fuzzy Ontology Representation using OWL 2 , 2010, Int. J. Approx. Reason..

[135]  Simon A. Dobson,et al.  Sapphire: Generating Java Runtime Artefacts from OWL Ontologies , 2011, CAiSE Workshops.

[136]  Stefano Spaccapietra,et al.  Semantic trajectories: Mobility data computation and annotation , 2013, TIST.

[137]  Christoph Stasch,et al.  Semantic Challenges for Sensor Plug and Play , 2009, W2GIS.

[138]  Sebastian Rudolph,et al.  EP-SPARQL: a unified language for event processing and stream reasoning , 2011, WWW.

[139]  Harry Chen,et al.  SOUPA: standard ontology for ubiquitous and pervasive applications , 2004, The First Annual International Conference on Mobile and Ubiquitous Systems: Networking and Services, 2004. MOBIQUITOUS 2004..

[140]  Diego Calvanese,et al.  The Description Logic Handbook: Theory, Implementation, and Applications , 2003, Description Logic Handbook.

[141]  Manuel P. Cuéllar,et al.  A fuzzy ontology for semantic modelling and recognition of human behaviour , 2014, Knowl. Based Syst..

[142]  Danh Le Phuoc,et al.  A Native and Adaptive Approach for Unified Processing of Linked Streams and Linked Data , 2011, SEMWEB.

[143]  Ramanathan V. Guha,et al.  Building Large Knowledge-Based Systems: Representation and Inference in the Cyc Project , 1990 .

[144]  York Sure-Vetter,et al.  Evaluation of Ontology-based Tools (EON 2003) : Proceedings of the 2nd International Workshop on Evaluation of Ontology-based Tools, held at the 2nd International Semantic Web Conference ISWC 2003, 20th October 2003 (Workshop day), Sundial Resort, Sanibel Island, Florida, USA , 2003 .

[145]  Karl Aberer,et al.  Semantic Sensor Data Search in a Large-Scale Federated Sensor Network , 2011, SSN.

[146]  Patrick Doherty,et al.  Stream Reasoning in DyKnow: A Knowledge Processing Middleware System , 2009 .

[147]  Payam M. Barnaghi,et al.  Semantic Annotation and Reasoning for Sensor Data , 2009, EuroSSC.

[148]  Boris Motik,et al.  Hypertableau Reasoning for Description Logics , 2009, J. Artif. Intell. Res..

[149]  Christos Goumopoulos,et al.  An ontology-driven system architecture for precision agriculture applications , 2009, Int. J. Metadata Semant. Ontologies.

[150]  Boris Motik,et al.  Structured objects in owl: representation and reasoning , 2008, WWW.

[151]  Simon Dobson,et al.  Leveraging the subtleties of location , 2005, sOc-EUSAI '05.

[152]  Konstantinos Sagonas,et al.  Xsb as an Eecient Deductive Database Engine , 1994 .

[153]  Ian Horrocks,et al.  FaCT++ Description Logic Reasoner: System Description , 2006, IJCAR.

[154]  Andrea Vitaletti,et al.  First experiences using wireless sensor networks for noise pollution monitoring , 2008, REALWSN '08.

[155]  Stefan Biffl,et al.  Semantic Event Correlation Using Ontologies , 2009, OTM Conferences.

[156]  Simon A. Dobson,et al.  USMART , 2014, ACM Trans. Interact. Intell. Syst..

[157]  Karl Rehrl,et al.  An Approach to Semantic Processing of GPS Traces , 2010 .

[158]  Abdenour Bouzouane,et al.  A KEYHOLE PLAN RECOGNITION MODEL FOR ALZHEIMER'S PATIENTS: FIRST RESULTS , 2007, Appl. Artif. Intell..

[159]  Valérie Issarny,et al.  Yarta: A Middleware for Managing Mobile Social Ecosystems , 2011, GPC.

[160]  Paul Anderson,et al.  Prometheus: User-Controlled P2P Social Data Management for Socially-Aware Applications , 2010, Middleware.

[161]  Dieter Fensel,et al.  It's a Streaming World! Reasoning upon Rapidly Changing Information , 2009, IEEE Intelligent Systems.

[162]  H. Lan,et al.  SWRL : A semantic Web rule language combining OWL and ruleML , 2004 .

[163]  Martin J. O'Connor,et al.  A Lightweight Model for Representing and Reasoning with Temporal Information in Biomedical Ontologies , 2010, HEALTHINF.