Static, Dynamic, and Adaptive Heterogeneity in Distributed Smart Camera Networks

We study heterogeneity among nodes in self-organizing smart camera networks, which use strategies based on social and economic knowledge to target communication activity efficiently. We compare homogeneous configurations, when cameras use the same strategy, with heterogeneous configurations, when cameras use different strategies. Our first contribution is to establish that static heterogeneity leads to new outcomes that are more efficient than those possible with homogeneity. Next, two forms of dynamic heterogeneity are investigated: nonadaptive mixed strategies and adaptive strategies, which learn online. Our second contribution is to show that mixed strategies offer Pareto efficiency consistently comparable with the most efficient static heterogeneous configurations. Since the particular configuration required for high Pareto efficiency in a scenario will not be known in advance, our third contribution is to show how decentralized online learning can lead to more efficient outcomes than the homogeneous case. In some cases, outcomes from online learning were more efficient than all other evaluated configuration types. Our fourth contribution is to show that online learning typically leads to outcomes more evenly spread over the objective space. Our results provide insight into the relationship between static, dynamic, and adaptive heterogeneity, suggesting that all have a key role in achieving efficient self-organization.

[1]  Gernot A. Fink,et al.  Calibration-free camera hand-over for fast and reliable person tracking in multi-camera setups , 2008, 2008 19th International Conference on Pattern Recognition.

[2]  Peter R. Lewis,et al.  A novel adaptive weight selection algorithm for multi-objective multi-agent reinforcement learning , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[3]  Zhaolin Cheng,et al.  Determining Vision Graphs for Distributed Camera Networks Using Feature Digests , 2007, EURASIP J. Adv. Signal Process..

[4]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[5]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[6]  Bernhard Rinner,et al.  Autonomous Multicamera Tracking on Embedded Smart Cameras , 2007, EURASIP J. Embed. Syst..

[7]  Xin Yao,et al.  Resource allocation in decentralised computational systems: an evolutionary market-based approach , 2009, Autonomous Agents and Multi-Agent Systems.

[8]  Carlos A. Coello Coello,et al.  Solving Multiobjective Optimization Problems Using an Artificial Immune System , 2005, Genetic Programming and Evolvable Machines.

[9]  R. Lyndon While,et al.  A faster algorithm for calculating hypervolume , 2006, IEEE Transactions on Evolutionary Computation.

[10]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[11]  Xin Yao,et al.  Improved adaptivity and robustness in decentralised multi-camera networks , 2012, 2012 Sixth International Conference on Distributed Smart Cameras (ICDSC).

[12]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[13]  YaoXin,et al.  Static, Dynamic, and Adaptive Heterogeneity in Distributed Smart Camera Networks , 2015 .

[14]  John Yearwood,et al.  On the Limitations of Scalarisation for Multi-objective Reinforcement Learning of Pareto Fronts , 2008, Australasian Conference on Artificial Intelligence.

[15]  Eduardo Freire Nakamura,et al.  A reactive role assignment for data routing in event-based wireless sensor networks , 2009, Comput. Networks.

[16]  Xin Yao,et al.  Socio-economic vision graph generation and handover in distributed smart camera networks , 2014, TOSN.

[17]  Xin Yao,et al.  Learning to be Different: Heterogeneity and Efficiency in Distributed Smart Camera Networks , 2013, 2013 IEEE 7th International Conference on Self-Adaptive and Self-Organizing Systems.

[18]  Evan Dekker,et al.  Empirical evaluation methods for multiobjective reinforcement learning algorithms , 2011, Machine Learning.

[19]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[20]  Jürgen Schmidhuber,et al.  Algorithm portfolio selection as a bandit problem with unbounded losses , 2011, Annals of Mathematics and Artificial Intelligence.

[21]  Ken Binmore,et al.  Game theory - a very short introduction , 2007 .

[22]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[23]  Ann Nowé,et al.  Scalarized multi-objective reinforcement learning: Novel design techniques , 2013, 2013 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL).

[24]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[25]  Xin Yao,et al.  Can Diversity amongst Learners Improve Online Object Tracking? , 2013, MCS.

[26]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[27]  Ali A. Minai,et al.  Self-Organization of Sensor Networks with Heterogeneous Connectivity , 2010 .

[28]  Ann Nowé,et al.  Hypervolume-Based Multi-Objective Reinforcement Learning , 2013, EMO.

[29]  Elizabeth Sklar,et al.  Auctions, Evolution, and Multi-agent Learning , 2007, Adaptive Agents and Multi-Agents Systems.

[30]  Daniel Keren,et al.  Multi-Camera Topology Recovery from Coherent Motion , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[31]  Demetri Terzopoulos,et al.  Multi-camera Control through Constraint Satisfaction for Persistent Surveillance , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[32]  David S. Munro,et al.  Topology Estimation for Thousand-Camera Surveillance Networks , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[33]  Bir Bhanu,et al.  A comparison of techniques for camera selection and handoff in a video network , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[34]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[35]  Michael Sonnenschein,et al.  On the Influence of Inter-Agent Variation on Multi-Agent Algorithms Solving a Dynamic Task Allocation Problem under Uncertainty , 2012, 2012 IEEE Sixth International Conference on Self-Adaptive and Self-Organizing Systems.

[36]  Juan A. Rodríguez-Aguilar,et al.  Self-Configuring Sensors for Uncharted Environments , 2010, 2010 Fourth IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[37]  Kazuyuki Morioka,et al.  A Cooperative Object Tracking System with Fuzzy-Based Adaptive Camera Selection , 2010 .

[38]  Stan Sclaroff,et al.  Look there! Predicting where to look for motion in an active camera network , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[39]  Pedro José Marrón,et al.  Generic role assignment for wireless sensor networks , 2004, EW 11.

[40]  Michael Wooldridge,et al.  Introduction to multiagent systems , 2001 .

[41]  Marie-Pierre Gleizes,et al.  Self-organising Software - From Natural to Artificial Adaptation , 2011, Natural Computing Series.

[42]  Yiming Li,et al.  Utility-Based Camera Assignment in a Video Network: A Game Theoretic Framework , 2011, IEEE Sensors Journal.

[43]  Bernhard Rinner,et al.  Resource-Aware Coverage and Task Assignment in Visual Sensor Networks , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[44]  Annie S. Wu,et al.  On the Impact of Variation on Self-Organizing Systems , 2011, 2011 IEEE Fifth International Conference on Self-Adaptive and Self-Organizing Systems.

[45]  Igor Cavrak,et al.  Agent-based topology control for wireless sensor network applications , 2012, 2012 Proceedings of the 35th International Convention MIPRO.