Efficient active rule processing in wireless multimedia sensor networks

Due to limited energy resources in wireless multimedia sensor networks WMSNs, there is a need to perform data reduction and elimination over raw video data at the camera sensors before transmission. Nonetheless, this data reduction and elimination may create imprecision and uncertainty in the data, reducing the quality of decision making. In this paper, we propose a reactive mechanism for not only fusing uncertain data at the sink but also for automated processing of data using active rules, extending the classical event-condition-action structure. In this mechanism, data fusion is performed using fuzzy logic to handle uncertainty in the received data. The fused data is then processed to infer certain predefined actions. These actions are triggered based on both the predefined event definitions and temporal and spatial data about the detected objects. Through experimentation, the proposed mechanism is shown to provide good accuracies while making significant energy savings at the cameras.

[1]  Adnan Yazici,et al.  Lightweight Object Localization with a Single Camera in Wireless Multimedia Sensor Networks , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.

[2]  Murat Demirbas,et al.  The impact of data aggregation on the performance of wireless sensor networks , 2008 .

[3]  Ian F. Akyildiz,et al.  Wireless sensor and actor networks: research challenges , 2004, Ad Hoc Networks.

[4]  Deborah Estrin,et al.  Cyclops: in situ image sensing and interpretation in wireless sensor networks , 2005, SenSys '05.

[5]  Athanasios V. Vasilakos,et al.  Real-time data report and task execution in wireless sensor and actuator networks using self-aware mobile actuators , 2013, Comput. Commun..

[6]  Ramakant Nevatia,et al.  Event Detection and Analysis from Video Streams , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Stan Sclaroff,et al.  Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements , 2006, Comput. Vis. Image Underst..

[8]  Ramakant Nevatia,et al.  Video-based event recognition: activity representation and probabilistic recognition methods , 2004, Comput. Vis. Image Underst..

[9]  Adnan Yazici,et al.  A New Approach for Information Processing in Wireless Sensor Network Database Applications , 2006 .

[10]  Nicole Fruehauf Wireless Sensor And Actuator Networks Technologies Analysis And Design , 2016 .

[11]  Wendi B. Heinzelman,et al.  A Survey of Visual Sensor Networks , 2009, Adv. Multim..

[12]  Carlo Zaniolo,et al.  On the Unification of Active Databases and Deductive databases , 1993, BNCOD.

[13]  Sebnem Baydere,et al.  Perceptual quality-based image communication service framework for wireless sensor networks , 2014, Wirel. Commun. Mob. Comput..

[14]  Anthony Rowe,et al.  CMUcam3: An Open Programmable Embedded Vision Sensor , 2007 .

[15]  Adnan Yazici,et al.  Efficient Tracking of Multiple Objects in Wireless Multimedia Sensor Networks , 2013, Ad Hoc Sens. Wirel. Networks.

[16]  Jennifer Widom,et al.  Static analysis techniques for predicting the behavior of active database rules , 1995, TODS.

[17]  Mubarak Shah,et al.  Multiple Agent Event Detection and Representation in Videos , 2005, AAAI.

[18]  Ernest Friedman Jess in action: rule-based systems in java , 2003 .

[19]  Mohan S. Kankanhalli,et al.  Multimodal fusion for multimedia analysis: a survey , 2010, Multimedia Systems.

[20]  Kemal Akkaya,et al.  Self-Actuation of Camera Sensors for Redundant Data Elimination in Wireless Multimedia Sensor Networks , 2009, 2009 IEEE International Conference on Communications.

[21]  Johannes Gehrke,et al.  Query Processing in Sensor Networks , 2003, CIDR.

[22]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[23]  A. E. Harmanci,et al.  Robust Image Transmission Over Wireless Sensor Networks , 2011, Mob. Networks Appl..

[24]  Kay Römer,et al.  A Decade of Wireless Sensing Applications: Survey and Taxonomy , 2014 .

[25]  T. Ross Fuzzy Logic with Engineering Applications , 1994 .

[26]  Larry S. Davis,et al.  Representation and Recognition of Events in Surveillance Video Using Petri Nets , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[27]  R.L. Moses,et al.  Locating the nodes: cooperative localization in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[28]  Jennifer Widom,et al.  Deriving Incremental Production Rules for Deductive Data , 1994, Inf. Syst..

[29]  Adnan Yazici,et al.  Providing Automated Actions in Wireless Multimedia Sensor Networks via Active Rules , 2011, ISCIS.

[30]  Hossein Pedram,et al.  Survey of mobile object tracking protocols in wireless sensor networks: a network-centric perspective , 2012, Int. J. Ad Hoc Ubiquitous Comput..

[31]  Ehud Rivlin,et al.  Understanding Video Events: A Survey of Methods for Automatic Interpretation of Semantic Occurrences in Video , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[32]  Alexandra Poulovassilis,et al.  Active rules for sensor databases , 2004, DMSN '04.

[33]  Ian F. Akyildiz,et al.  Wireless multimedia sensor networks: A survey , 2007, IEEE Wireless Communications.

[34]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[35]  Alberto Del Bimbo,et al.  Event detection and recognition for semantic annotation of video , 2010, Multimedia Tools and Applications.

[36]  Hongke Zhang,et al.  Wireless-Sensor-Networks-based healthcare system: a survey on the view of communication paradigms , 2011, Int. J. Ad Hoc Ubiquitous Comput..