A survey on data fusion in internet of things: Towards secure and privacy-preserving fusion

Abstract Internet of Things (IoT) aims to create a world that enables the interconnection and integration of things in physical world and cyber space. With the involvement of a great number of wireless sensor devices, IoT generates a diversity of datasets that are massive, multi-sourcing, heterogeneous, and sparse. By taking advantage of these data to further improve IoT services and offer intelligent services, data fusion is always employed first to reduce the size and dimension of data, optimize the amount of data traffic and extract useful information from raw data. Although there exist some surveys on IoT data fusion, the literature still lacks comprehensive insight and discussion on it with regard to different IoT application domains by paying special attention to security and privacy. In this paper, we investigate the properties of IoT data, propose a number of IoT data fusion requirements including the ones about security and privacy, classify the IoT applications into several domains and then provide a thorough review on the state-of-the-art of data fusion in main IoT application domains. In particular, we employ the requirements of IoT data fusion as a measure to evaluate and compare the performance of existing data fusion methods. Based on the thorough survey, we summarize open research issues, highlight promising future research directions and specify research challenges.

[1]  Tom White,et al.  Hadoop: The Definitive Guide , 2009 .

[2]  Kostia Robert Bringing Richer Information with Reliability to Automated Traffic Monitoring from the Fusion of Multiple Cameras, Inductive Loops and Road Maps , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[3]  Xiaohui Liang,et al.  EPPDR: An Efficient Privacy-Preserving Demand Response Scheme with Adaptive Key Evolution in Smart Grid , 2014, IEEE Transactions on Parallel and Distributed Systems.

[4]  Robert H. Deng,et al.  Encrypted data processing with Homomorphic Re-Encryption , 2017, Inf. Sci..

[5]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  H. Vincent Poor,et al.  Machine Learning Methods for Attack Detection in the Smart Grid , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Victor C. M. Leung,et al.  A Novel Sensory Data Processing Framework to Integrate Sensor Networks With Mobile Cloud , 2016, IEEE Systems Journal.

[8]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[9]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[10]  Irfan Essa,et al.  Towards reliable multimodal sensing in aware environments , 2001, PUI '01.

[11]  Yang Liu,et al.  Abnormal traffic-indexed state estimation: A cyber-physical fusion approach for Smart Grid attack detection , 2015, Future Gener. Comput. Syst..

[12]  Mark Sullivan,et al.  Sensor Fusion-Based Middleware for Smart Homes , 2007 .

[13]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[14]  Xiuwen Yi,et al.  DNN-based prediction model for spatio-temporal data , 2016, SIGSPATIAL/GIS.

[15]  Robert Weigel,et al.  Fusion of Nonintrusive Environmental Sensors for Occupancy Detection in Smart Homes , 2018, IEEE Internet of Things Journal.

[16]  Donghyok Suh,et al.  Multi-sensor Data Fusion with Dynamic Component for Context Awareness , 2012 .

[17]  Chun-I Fan,et al.  Privacy-Enhanced Data Aggregation Scheme Against Internal Attackers in Smart Grid , 2014, IEEE Transactions on Industrial Informatics.

[18]  Tom Ziemke,et al.  On the Definition of Information Fusion as a Field of Research , 2007 .

[19]  Ramez Elmasri,et al.  Fusion Techniques for Reliable Information: A Survey , 2010, J. Digit. Content Technol. its Appl..

[20]  Athanasios V. Vasilakos,et al.  A Survey of Verifiable Computation , 2017, Mob. Networks Appl..

[21]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[22]  Shusen Yang,et al.  Detection of false data injection attacks in smart-grid systems , 2015, IEEE Communications Magazine.

[23]  Bernadette Dorizzi,et al.  A Multimodal Platform for Database Recording and Elderly People Monitoring , 2008, BIOSIGNALS.

[24]  Malini Ghosal,et al.  Fusion of Multirate Measurements for Nonlinear Dynamic State Estimation of the Power Systems , 2019, IEEE Transactions on Smart Grid.

[25]  Kwang-Cheng Chen,et al.  Smart attacks in smart grid communication networks , 2012, IEEE Communications Magazine.

[26]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[27]  Jennifer Seplow,et al.  Data fusion for delivering advanced traveler information services , 2003 .

[28]  Mehrdad Saif,et al.  Data fusion for fault diagnosis in smart grid power systems , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[29]  Ming Li,et al.  Forecasting Fine-Grained Air Quality Based on Big Data , 2015, KDD.

[30]  Yanchi Liu,et al.  Diagnosing New York city's noises with ubiquitous data , 2014, UbiComp.

[31]  Mohamed Atri,et al.  Naive Bayesian Fusion for Action Recognition from Kinect , 2017 .

[32]  Ivan Stojmenovic,et al.  The Fog computing paradigm: Scenarios and security issues , 2014, 2014 Federated Conference on Computer Science and Information Systems.

[33]  Xavier Sevillano,et al.  Towards smart traffic management systems: Vacant on-street parking spot detection based on video analytics , 2014, 17th International Conference on Information Fusion (FUSION).

[34]  Ahmed Tamtaoui,et al.  An Improved Robust Low Cost Approach for Real Time Vehicle Positioning in a Smart City , 2016, INISCOM.

[35]  Laurence T. Yang,et al.  Aggregated-Proofs Based Privacy-Preserving Authentication for V2G Networks in the Smart Grid , 2012, IEEE Transactions on Smart Grid.

[36]  Meng Sun,et al.  Toward Information Privacy for the Internet of Things: A Nonparametric Learning Approach , 2018, IEEE Transactions on Signal Processing.

[37]  Robert H. Deng,et al.  Privacy-Preserving Data Processing with Flexible Access Control , 2020, IEEE Transactions on Dependable and Secure Computing.

[38]  Jinping Ou,et al.  Wireless sensor information fusion for structural health monitoring , 2003, SPIE Defense + Commercial Sensing.

[39]  Bo Tang,et al.  Incorporating Intelligence in Fog Computing for Big Data Analysis in Smart Cities , 2017, IEEE Transactions on Industrial Informatics.

[40]  Vigneshwaran Subbaraju,et al.  Discovering anomalous events from urban informatics data , 2017, Defense + Security.

[41]  Norbert Noury,et al.  Computer simulation of the activity of the elderly person living independently in a Health Smart Home , 2012, Comput. Methods Programs Biomed..

[42]  Nitesh V. Chawla,et al.  Big data fusion in Internet of Things , 2018, Inf. Fusion.

[43]  Paul Lukowicz,et al.  Sensing muscle activities with body-worn sensors , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[44]  Friedemann Mattern,et al.  From the Internet of Computers to the Internet of Things , 2010, From Active Data Management to Event-Based Systems and More.

[45]  Cheng Xiaorong,et al.  The Application of Data Fusion Technology Based on Neural Network in the Dynamic Risk Assessment , 2012 .

[46]  Ibrar Yaqoob,et al.  Big IoT Data Analytics: Architecture, Opportunities, and Open Research Challenges , 2017, IEEE Access.

[47]  Peng Liu,et al.  Secure Information Aggregation for Smart Grids Using Homomorphic Encryption , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[48]  Heng Zhang,et al.  A Novel Data Fusion Algorithm to Combat False Data Injection Attacks in Networked Radar Systems , 2018, IEEE Transactions on Signal and Information Processing over Networks.

[49]  Guang-Zhong Yang,et al.  Pervasive body sensor network: an approach to monitoring the post-operative surgical patient , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[50]  Zheng Yan,et al.  Context-Aware Verifiable Cloud Computing , 2017, IEEE Access.

[51]  Rongxing Lu,et al.  From Cloud to Fog Computing: A Review and a Conceptual Live VM Migration Framework , 2017, IEEE Access.

[52]  Thomas Schneider,et al.  Notes on non-interactive secure comparison in "image feature extraction in the encrypted domain with privacy-preserving SIFT" , 2014, IH&MMSec '14.

[53]  Wei Li,et al.  Motion games improve balance control in stroke survivors: A preliminary study based on the principle of constraint-induced movement therapy , 2013, Displays.

[54]  A. G. Expósito,et al.  Power system state estimation : theory and implementation , 2004 .

[55]  Sushmita Ruj,et al.  A Decentralized Security Framework for Data Aggregation and Access Control in Smart Grids , 2013, IEEE Transactions on Smart Grid.

[56]  Henrik Malchau,et al.  Biomotion community-wearable human activity monitor: total knee replacement and healthy control subjects , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[57]  Soo-Chang Pei,et al.  Image Feature Extraction in Encrypted Domain With Privacy-Preserving SIFT , 2012, IEEE Transactions on Image Processing.

[58]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[59]  Cyrus Shahabi,et al.  Crowd sensing of traffic anomalies based on human mobility and social media , 2013, SIGSPATIAL/GIS.

[60]  Hossam S. Hassanein,et al.  IoT in the Fog: A Roadmap for Data-Centric IoT Development , 2018, IEEE Communications Magazine.

[61]  Yu Zheng,et al.  p-Causality: Identifying Spatiotemporal Causal Pathways for Air Pollutants with Urban Big Data , 2016, ArXiv.

[62]  Arthur C. Sanderson,et al.  Multisensor Fusion - A Minimal Representation Framework , 1999, Series in Intelligent Control and Intelligent Automation.

[63]  A. Monticelli,et al.  Electric power system state estimation , 2000, Proceedings of the IEEE.

[64]  Stathes Hadjiefthymiades,et al.  Multisensor data fusion for fire detection , 2011, Inf. Fusion.

[65]  Mohsen Guizani,et al.  Privacy in the Internet of Things for Smart Healthcare , 2018, IEEE Communications Magazine.

[66]  Henry Leung,et al.  Information fusion based smart home control system and its application , 2008, IEEE Transactions on Consumer Electronics.

[67]  Nasser Kehtarnavaz,et al.  UTD-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[68]  Albert Y. Zomaya,et al.  Multisensor data fusion in Shared Sensor and Actuator Networks , 2014, 17th International Conference on Information Fusion (FUSION).

[69]  H. B. Mitchell,et al.  Multi-Sensor Data Fusion: An Introduction , 2007 .

[70]  Bernadette Dorizzi,et al.  A pervasive multi-sensor data fusion for smart home healthcare monitoring , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[71]  Malini Ghosal,et al.  Fusion of PMU and SCADA Data for dynamic state estimation of power system , 2015, 2015 North American Power Symposium (NAPS).

[72]  Nuno M. Garcia,et al.  From Data Acquisition to Data Fusion: A Comprehensive Review and a Roadmap for the Identification of Activities of Daily Living Using Mobile Devices , 2016, Sensors.

[73]  Rashid Mehmood,et al.  Data Fusion and IoT for Smart Ubiquitous Environments: A Survey , 2017, IEEE Access.

[74]  Danail Stoyanov,et al.  Ambient and Wearable Sensor Fusion for Activity Recognition in Healthcare Monitoring Systems , 2007, BSN.

[75]  Damien Brulin,et al.  Multi-sensors data fusion system for fall detection , 2010, Proceedings of the 10th IEEE International Conference on Information Technology and Applications in Biomedicine.

[76]  Fengjun Li,et al.  Preserving data integrity for smart grid data aggregation , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[77]  S. Das,et al.  Precision: Privacy Enhanced Context-Aware Information Fusion in Ubiquitous Healthcare , 2007, First International Workshop on Software Engineering for Pervasive Computing Applications, Systems, and Environments (SEPCASE '07).

[78]  Mahesh Sooriyabandara,et al.  ParkUs: A Novel Vehicle Parking Detection System , 2017, AAAI.

[79]  E. Huang,et al.  Real-time multi-sensor multi-source network data fusion using dynamic traffic assignment models , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[80]  Federico Viani,et al.  Wireless Architectures for Heterogeneous Sensing in Smart Home Applications: Concepts and Real Implementation , 2013, Proceedings of the IEEE.

[81]  Yun Gu,et al.  A novel method to detect bad data injection attack in smart grid , 2013, INFOCOM Workshops.

[82]  Yu Zheng,et al.  U-Air: when urban air quality inference meets big data , 2013, KDD.

[83]  Jenq-Neng Hwang,et al.  A Review on Video-Based Human Activity Recognition , 2013, Comput..

[84]  Xiong Luo,et al.  A kernel machine-based secure data sensing and fusion scheme in wireless sensor networks for the cyber-physical systems , 2016, Future Gener. Comput. Syst..

[85]  Chris D. Nugent,et al.  Evidential fusion of sensor data for activity recognition in smart homes , 2009, Pervasive Mob. Comput..

[86]  Lawrence A. Klein,et al.  Sensor and Data Fusion Concepts and Applications , 1993 .

[87]  Franklin E White,et al.  Data Fusion Lexicon , 1991 .

[88]  Henry Leung,et al.  Data fusion in intelligent transportation systems: Progress and challenges - A survey , 2011, Inf. Fusion.

[89]  Xiaojiang Du,et al.  VDAS: Verifiable data aggregation scheme for Internet of Things , 2017, 2017 IEEE International Conference on Communications (ICC).

[90]  Michel Vacher,et al.  Data Fusion in Health Smart Home: Preliminary Individual Evaluation of Two Families of Sensors , 2008 .

[91]  Michel Vacher,et al.  Making Context Aware Decision from Uncertain Information in a Smart Home: A Markov Logic Network Approach , 2013, AmI.

[92]  Peter Friess,et al.  Internet of Things: Converging Technologies for Smart Environments and Integrated Ecosystems , 2013 .

[93]  Majid Mirmehdi,et al.  Online quality assessment of human motion from skeleton data , 2014, BMVC.

[94]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[95]  L. Li,et al.  Deep data fusion model for risk perception and coordinated control of smart grid , 2015, 2015 International Conference on Estimation, Detection and Information Fusion (ICEDIF).

[96]  Hossein Ragheb,et al.  MuHAVi: A Multicamera Human Action Video Dataset for the Evaluation of Action Recognition Methods , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[97]  P. Hespanha,et al.  An Efficient MATLAB Algorithm for Graph Partitioning , 2006 .

[98]  Xiaohui Liang,et al.  EPPA: An Efficient and Privacy-Preserving Aggregation Scheme for Secure Smart Grid Communications , 2012, IEEE Transactions on Parallel and Distributed Systems.

[99]  Ahmad-Reza Sadeghi,et al.  Privacy-Preserving ECG Classification With Branching Programs and Neural Networks , 2011, IEEE Transactions on Information Forensics and Security.

[100]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[101]  Xiaoming Fu,et al.  Cloud-Assisted Data Fusion and Sensor Selection for Internet of Things , 2016, IEEE Internet of Things Journal.

[102]  Laurence T. Yang,et al.  Role-Dependent Privacy Preservation for Secure V2G Networks in the Smart Grid , 2014, IEEE Transactions on Information Forensics and Security.

[103]  Rodrigo Roman,et al.  Mobile Edge Computing, Fog et al.: A Survey and Analysis of Security Threats and Challenges , 2016, Future Gener. Comput. Syst..

[104]  Yikai Chen,et al.  A fusion-based system for road-network traffic state surveillance: a case study of Shanghai , 2009, IEEE Intelligent Transportation Systems Magazine.

[105]  Andre Albuquerque,et al.  An estimation fusion method for including phasor measurements into power system real-time modeling , 2013, IEEE Transactions on Power Systems.

[106]  Athanasios V. Vasilakos,et al.  A survey on trust management for Internet of Things , 2014, J. Netw. Comput. Appl..

[107]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[108]  Norbert Noury,et al.  A Predictive Analysis of the Night-Day Activities Level of Older Patient in a Health Smart Home , 2009, ICOST.

[109]  Luis M. Candanedo,et al.  Accurate occupancy detection of an office room from light, temperature, humidity and CO2 measurements using statistical learning models , 2016 .

[110]  Ahmed Tamtaoui,et al.  Improving Vehicle Localization in a Smart City with Low Cost Sensor Networks and Support Vector Machines , 2017, Mobile Networks and Applications.

[111]  Laurence T. Yang,et al.  Deep Computation Model for Unsupervised Feature Learning on Big Data , 2016, IEEE Transactions on Services Computing.

[112]  Sajal K. Das,et al.  An Adaptive Bayesian System for Context-Aware Data Fusion in Smart Environments , 2017, IEEE Transactions on Mobile Computing.

[113]  Huayu Wu,et al.  Next Generation of Journey Planner in a Smart City , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[114]  Francisco Javier Ferrández Pastor,et al.  A Vision-Based System for Intelligent Monitoring: Human Behaviour Analysis and Privacy by Context , 2014, Sensors.

[115]  Hengrun Zhang,et al.  A Survey on Security, Privacy, and Trust in Mobile Crowdsourcing , 2018, IEEE Internet of Things Journal.

[116]  Yu Zheng,et al.  Methodologies for Cross-Domain Data Fusion: An Overview , 2015, IEEE Transactions on Big Data.

[117]  Mingzhe Jiang,et al.  Leveraging Fog Computing for Healthcare IoT , 2018 .

[118]  Indrajit Banerjee,et al.  IoT-Based Sensor Data Fusion for Occupancy Sensing Using Dempster–Shafer Evidence Theory for Smart Buildings , 2017, IEEE Internet of Things Journal.

[119]  Weihua Xu,et al.  A novel approach to information fusion in multi-source datasets: A granular computing viewpoint , 2017, Inf. Sci..

[120]  Yu Bai,et al.  Surf feature extraction in encrypted domain , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[121]  Yaxin Bi,et al.  Evidence fusion for activity recognition using the Dempster-Shafer theory of evidence , 2009, 2009 9th International Conference on Information Technology and Applications in Biomedicine.

[122]  Gerhard P. Hancke,et al.  Opportunities and Challenges of Wireless Sensor Networks in Smart Grid , 2010, IEEE Transactions on Industrial Electronics.

[123]  Guang-Zhong Yang,et al.  Real-Time Pervasive Monitoring for Postoperative Care , 2007, BSN.

[124]  Kristof Van Laerhoven,et al.  Long term activity monitoring with a wearable sensor node , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).