Multimodal monitoring of cultural heritage sites and the FIRESENSE project

The FIRESENSE FP7 project aims to implement an automatic early warning system to remotely monitor areas of archaeological and cultural interest from the risk of fire and extreme weather conditions. This challenging task requires the operation of a multimodal wireless sensor network, the setting up of an infrastructure to publish and access sensor data and the fusion of multiple modalities in a real-time fashion. This paper discusses the multimodal sensor data access and fusion aspects of the project.

[1]  Keiichi Uchimura,et al.  Fusion of vision, 3D gyro and GPS for camera dynamic registration , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[2]  Jong Beom Ra,et al.  Multi-sensor image registration based on intensity and edge orientation information , 2008, Pattern Recognit..

[3]  A. Cetin,et al.  Fire Detection And 3d Fire Propagation Estimation For The Protection Of Cultural Heritage Areas , 2010 .

[4]  Ronald Azuma,et al.  Orientation Tracking for Outdoor Augmented Reality Registration , 1999, IEEE Computer Graphics and Applications.

[5]  Denis Simakov,et al.  Feature-Based Sequence-to-Sequence Matching , 2006, International Journal of Computer Vision.

[6]  Ronald Azuma,et al.  Hybrid inertial and vision tracking for augmented reality registration , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[7]  Jungong Han,et al.  Visible and Infrared Image Registration Employing Line-Based Geometric Analysis , 2011, MUSCLE.

[8]  Zhencheng Hu,et al.  Real-time data fusion on tracking camera pose for direct visual guidance , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[9]  Mike Smith.  Sensor Model Language (SensorML) for In-situ and Remote Sensors , 2002 .

[10]  Jiebo Luo,et al.  Recognizing realistic actions from videos “in the wild” , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  David Elliott,et al.  In the Wild , 2010 .

[12]  Turkish Navy,et al.  FLAME DETECTION METHOD IN VIDEO USING COVARIANCE DESCRIPTORS , 2011 .

[13]  Huang Xi-shan,et al.  A wavelet-based multisensor image registration algorithm , 2002, 6th International Conference on Signal Processing, 2002..

[14]  E. Coiras,et al.  Segment-based registration technique for visual-infrared images , 2000 .

[15]  Bir Bhanu,et al.  Fusion of color and infrared video for moving human detection , 2007, Pattern Recognit..

[16]  Simone Calderara,et al.  Vision based smoke detection system using image energy and color information , 2011, Machine Vision and Applications.

[17]  Sung-Hee Lee,et al.  Digital Image Stabilizing Algorithms Based On Bit-plane Matching , 1998, International 1998 Conference on Consumer Electronics.

[18]  Philip Bogden,et al.  Web feature service (WFS) and sensor observation service (SOS) comparison to publish time series data , 2009, 2009 International Symposium on Collaborative Technologies and Systems.

[19]  Nikolaos Grammalidis,et al.  A multi-sensor network for the protection of cultural heritage , 2011, 2011 19th European Signal Processing Conference.

[20]  Krystian Mikolajczyk,et al.  Action recognition with motion-appearance vocabulary forest , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  A. Ollero,et al.  Smoke monitoring and measurement using image processing: application to forest fires , 2003, SPIE Defense + Commercial Sensing.

[22]  Tom Drummond,et al.  A Single-frame Visual Gyroscope , 2005, BMVC.