Tracking in Urban Environments Using Sensor Networks Based on Audio-Video Fusion

Heterogeneous sensor networks (HSNs) are gaining popularity in diverse fields, such as military surveillance, equipment monitoring, and target tracking yarvis:2005:infocom. They are natural steps in the evolution of wireless sensor networks wireless sensor network (WSNs) driven by several factors. Increasingly, WSNs will need to support multiple, although not necessarily concurrent, applications. Different applications may require different resources. Some applications can make use of nodes with different capabilities. As the technology matures, new types of nodes will become available and existing deployments will be refreshed. Diverse nodes will need to coexist and support old and new applications.

[1]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Mingyan Liu,et al.  Analysis of energy consumption and lifetime of heterogeneous wireless sensor networks , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[3]  Deborah Estrin,et al.  Collaborative Sensor Networking Towards Real-Time Acoustical Beamforming in Free-Space and Limited Reverberance , 2004, IEEE Trans. Mob. Comput..

[4]  Jitendra Malik,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[5]  Andreas M. Ali,et al.  An Empirical Study of Collaborative Acoustic Source Localization , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[6]  David E. Culler,et al.  The Emergence of Networking Abstractions and Techniques in TinyOS , 2004, NSDI.

[7]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[8]  Gyula Simon,et al.  The flooding time synchronization protocol , 2004, SenSys '04.

[9]  Larry S. Davis,et al.  Multimodal tracking for smart videoconferencing , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[10]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[11]  Sascha Spors,et al.  Joint audio-video object localization and tracking , 2001 .

[12]  Feng Zhao,et al.  Collaborative In-Network Processing for Target Tracking , 2003, EURASIP J. Adv. Signal Process..

[13]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[14]  Gopal Sarma Pingali,et al.  A multimodal speaker detection and tracking system for teleconferencing , 2002, MULTIMEDIA '02.

[15]  Mani B. Srivastava,et al.  Computation Hierarchy for In-Network Processing , 2003, WSNA '03.

[16]  D. Koller,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[17]  Rangasami L. Kashyap,et al.  On the robustness of Dempster's rule of combination , 1989, [Proceedings 1989] IEEE International Workshop on Tools for Artificial Intelligence.

[18]  Xenofon D. Koutsoukos,et al.  Time Synchronization in Heterogeneous Sensor Networks , 2008, DCOSS.

[19]  Deborah Estrin,et al.  The design and implementation of a self-calibrating distributed acoustic sensing platform , 2006, SenSys '06.

[20]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[21]  J. Crowley,et al.  Multi-Modal Tracking of Interacting Targets Using Gaussian Approximations , 2001 .

[22]  Pascal Vasseur,et al.  Introduction to Multisensor Data Fusion , 2005, The Industrial Information Technology Handbook.

[23]  Trevor Darrell,et al.  A Probabilistic Framework for Multi-modal Multi-Person Tracking , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[24]  Suresh Singh,et al.  Exploiting heterogeneity in sensor networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[25]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Aubrey B. Poore,et al.  Multidimensional Assignments and Multitarget Tracking , 1993, Partitioning Data Sets.

[27]  Saurabh Ganeriwal,et al.  Timing-sync protocol for sensor networks , 2003, SenSys '03.

[28]  David E. Culler,et al.  Elapsed time on arrival: a simple and versatile primitive for canonical time synchronisation services , 2006, Int. J. Ad Hoc Ubiquitous Comput..

[29]  Andreas Terzis,et al.  Multi-Modal Calibration of Surveillance Sensor Networks , 2006, MILCOM 2006 - 2006 IEEE Military Communications conference.

[30]  Sheng Liu,et al.  Techniques for minimizing power consumption in low data-rate wireless sensor networks , 2004, 2004 IEEE Wireless Communications and Networking Conference (IEEE Cat. No.04TH8733).

[31]  Ákos Lédeczi,et al.  On the Scalability of Routing Integrated Time Synchronization , 2006, EWSN.

[32]  Ákos Lédeczi,et al.  Shooter localization and weapon classification with soldier-wearable networked sensors , 2007, MobiSys '07.

[33]  Stanley T. Birchfield.  A unifying framework for acoustic localization , 2004, 2004 12th European Signal Processing Conference.

[34]  Kung Yao,et al.  Acoustic Source Localization and Beamforming: Theory and Practice , 2003, EURASIP J. Adv. Signal Process..

[35]  Trevor Darrell,et al.  Plan-view trajectory estimation with dense stereo background models , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[36]  Songhwai Oh,et al.  Markov chain Monte Carlo data association for general multiple-target tracking problems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[37]  Gyula Simon,et al.  Countersniper system for urban warfare , 2005, TOSN.

[38]  Deborah Estrin,et al.  Locating tiny sensors in time and space: a case study , 2002, Proceedings. IEEE International Conference on Computer Design: VLSI in Computers and Processors.

[39]  S. Shankar Sastry,et al.  Markov Chain Monte Carlo Data Association for Multi-Target Tracking , 2009, IEEE Transactions on Automatic Control.

[40]  S. Shankar Sastry,et al.  Fusion-based localization for a Heterogeneous camera network , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[41]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Nebojsa Jojic,et al.  A Graphical Model for Audiovisual Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Ramakant Nevatia,et al.  Tracking multiple humans in crowded environment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[44]  Jean Rouat,et al.  Robust localization and tracking of simultaneous moving sound sources using beamforming and particle filtering , 2007, Robotics Auton. Syst..

[45]  Deborah Estrin,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Fine-grained Network Time Synchronization Using Reference Broadcasts , 2022 .