An Adaptive Bayesian System for Context-Aware Data Fusion in Smart Environments

The adoption of multi-sensor data fusion techniques is essential to effectively merge and analyze heterogeneous data collected by multiple sensors, pervasively deployed in a smart environment. Existing literature leverages contextual information in the fusion process, to increase the accuracy of inference and hence decision making in a dynamically changing environment. In this paper, we propose a context-aware, self-optimizing, adaptive system for sensor data fusion, based on a three-tier architecture. Heterogeneous data collected by sensors at the lowest tier are combined by a dynamic Bayesian network at the intermediate tier, which also integrates contextual information to refine the inference process. At the highest tier, a self-optimization process dynamically reconfigures the sensory infrastructure, by sampling a subset of sensors in order to minimize energy consumption and maximize inference accuracy. A Bayesian approach allows to deal with the imprecision of sensory measurements, due to environmental noise and possible hardware malfunctions. The effectiveness of our approach is demonstrated with the application scenario of the user activity recognition in an Ambient Intelligence system managing a smart home environment. Experimental results show that the proposed solution outperforms static approaches for context-aware multi-sensor fusion, achieving substantial energy savings whilst maintaining a high degree of inference accuracy.

[1]  Bernard Burg,et al.  An Approach to Data Fusion for Context Awareness , 2005, CONTEXT.

[2]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[3]  Nirvana Meratnia,et al.  Outlier Detection Techniques for Wireless Sensor Networks: A Survey , 2008, IEEE Communications Surveys & Tutorials.

[4]  Sang Jeong Lee,et al.  HiCon: a hierarchical context monitoring and composition framework for next-generation context-aware services , 2008, IEEE Network.

[5]  Gregory D. Abowd,et al.  A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications , 2001, Hum. Comput. Interact..

[6]  Christine Julien,et al.  Resolving and mediating ambiguous contexts in pervasive environments , 2013 .

[7]  Clayton Shepard,et al.  Practical Context Awareness: Measuring and Utilizing the Context Dependency of Mobile Usage , 2012, IEEE Transactions on Mobile Computing.

[8]  Giuseppe Lo Re,et al.  A Hybrid Framework for Soft Real-Time WSN Simulation , 2009, 2009 13th IEEE/ACM International Symposium on Distributed Simulation and Real Time Applications.

[9]  Diane J. Cook,et al.  Activity recognition on streaming sensor data , 2014, Pervasive Mob. Comput..

[10]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[11]  Diane J. Cook,et al.  Smart environments - technology, protocols and applications , 2004 .

[12]  Giuseppe Lo Re,et al.  Multi-sensor Fusion through Adaptive Bayesian Networks , 2011, AI*IA.

[13]  Lei Gao,et al.  Evaluation of accelerometer based multi-sensor versus single-sensor activity recognition systems. , 2014, Medical engineering & physics.

[14]  Y. Zhang,et al.  Active and dynamic information fusion for multisensor systems with dynamic bayesian networks , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Pradeep K. Atrey,et al.  Learning Multisensor Confidence Using a Reward-and-Punishment Mechanism , 2009, IEEE Transactions on Instrumentation and Measurement.

[16]  Nozer D. Singpurwalla,et al.  Understanding the Kalman Filter , 1983 .

[17]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[18]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[19]  Youngki Lee,et al.  A Scalable and Energy-Efficient Context Monitoring Framework for Mobile Personal Sensor Networks , 2010, IEEE Transactions on Mobile Computing.

[20]  Ramesh Govindan,et al.  CARLOG: a platform for flexible and efficient automotive sensing , 2014, SenSys.

[21]  Suman Nath ACE: Exploiting Correlation for Energy-Efficient and Continuous Context Sensing , 2013, IEEE Trans. Mob. Comput..

[22]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[23]  Jesús Favela,et al.  Hidden Markov Models for Activity Recognition in Ambient Intelligence Environments , 2007, Eighth Mexican International Conference on Current Trends in Computer Science (ENC 2007).

[24]  Tarek F. Abdelzaher,et al.  Maximum likelihood analysis of conflicting observations in social sensing , 2014, TOSN.

[25]  Ross D. Shachter,et al.  Dynamic programming and influence diagrams , 1990, IEEE Trans. Syst. Man Cybern..

[26]  Sajal K. Das,et al.  A Middleware Framework for Ambiguous Context Mediation in Smart Healthcare Application , 2007 .

[27]  Alessandra De Paola,et al.  Design of an Adaptive Bayesian System for Sensor Data Fusion , 2014, Advances onto the Internet of Things.

[28]  James A. Stover,et al.  A fuzzy-logic architecture for autonomous multisensor data fusion , 1996, IEEE Trans. Ind. Electron..

[29]  Giuseppe Lo Re,et al.  Adaptive Distributed Outlier Detection for WSNs , 2015, IEEE Transactions on Cybernetics.

[30]  Rudolf Mathar,et al.  Kernel-based learning of decision fusion in wireless sensor networks , 2008, 2008 11th International Conference on Information Fusion.

[31]  Ahmad Rahmati,et al.  Context-Based Network Estimation for Energy-Efficient Ubiquitous Wireless Connectivity , 2011, IEEE Transactions on Mobile Computing.

[32]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[33]  Marco Morana,et al.  Nds Lab -networking and Distributed Systems Mimicking Biological Mechanisms for Sensory Information Fusion Mimicking Biological Mechanisms for Sensory Information Fusion , 2022 .

[34]  Yacov Y. Haimes,et al.  Influence diagrams with multiple objectives and tradeoff analysis , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[35]  Marco Morana,et al.  User detection through multi-sensor fusion in an AmI scenario , 2012, 2012 15th International Conference on Information Fusion.

[36]  Biswanath Mukherjee,et al.  Wireless sensor network survey , 2008, Comput. Networks.

[37]  Ozgur Yurur,et al.  Adaptive and Energy Efficient Context Representation Framework in Mobile Sensing , 2014, IEEE Transactions on Mobile Computing.

[38]  Diane J. Cook,et al.  Author's Personal Copy Pervasive and Mobile Computing Ambient Intelligence: Technologies, Applications, and Opportunities , 2022 .

[39]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[40]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[41]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[42]  Christine Julien,et al.  Resource-Optimized Quality-Assured Ambiguous Context Mediation Framework in Pervasive Environments , 2012, IEEE Transactions on Mobile Computing.

[43]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[44]  Julie A. McCann,et al.  Adaptive middleware for context-aware applications in smart-homes , 2004, MPAC '04.

[45]  B. Kröse,et al.  Bayesian Activity Recognition in Residence for Elders , 2007 .

[46]  Yi Zheng,et al.  Multisensor image fusion using fuzzy logic for surveillance systems , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.