Market-Based Framework for Mobile Surveillance Systems

The active surveillance of public and private sites is increasingly becoming a very important and critical issue. It is therefore, imperative to develop mobile surveillance systems to protect these sites. Modern surveillance systems encompass spatially distributed mobile and static sensors in order to provide effective monitoring of persistent and transient objects. The realization of the potential of mobile surveillance requires the solution of different challenging problems such as task allocation, mobile sensor deployment, multisensor management, and cooperative object tracking. This paper proposes a market-based framework that can be used to handle different problems of mobile surveillance systems. Task allocation and cooperative target-tracking are studied using the proposed framework as two challenging problems of mobile surveillance systems. These challenges are addressed individually and collectively.

[1]  Ronald M. Harstad,et al.  Computationally Manageable Combinational Auctions , 1998 .

[2]  Anthony Stentz,et al.  Multi-robot exploration controlled by a market economy , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  Victor R. Lesser,et al.  Leveled-Commitment Contracting: A Backtracking Instrument for Multiagent Systems , 2002, AI Mag..

[4]  Jorge J. Gómez-Sanz,et al.  Development of intelligent multisensor surveillance systems with agents , 2007, Robotics Auton. Syst..

[5]  Miad Moarref,et al.  A Distributed Algorithm for Proportional Task Allocation in Networks of Mobile Agents , 2011, IEEE Transactions on Automatic Control.

[6]  Heinz Wörn,et al.  MULTI-GOAL PATH PLANNING FOR INDUSTRIAL ROBOTS , 1999 .

[7]  Abder Koukam,et al.  The coverage problem in wireless sensor networks by holonic multi-agent approach , 2009 .

[8]  A D R I A N A G I R E T,et al.  Holons and Agents , 2022 .

[9]  Barry Brumitt,et al.  GRAMMPS: a generalized mission planner for multiple mobile robots in unstructured environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[10]  Robert P. Goldman,et al.  Coordinated deployment of multiple, heterogeneous robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[11]  José M. Molina López,et al.  FUZZY REASONING IN A MULTIAGENT SYSTEM OF SURVEILLANCE SENSORS TO MANAGE COOPERATIVELY THE SENSOR-TO-TASK ASSIGNMENT PROBLEM , 2004, Appl. Artif. Intell..

[12]  Jiming Liu,et al.  Multiagent Optimization System for Solving the Traveling Salesman Problem (TSP) , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Z. Ding,et al.  Decoupling joint probabilistic data association algorithm for multiple target tracking , 1999 .

[14]  Mohamed Mohsen Gammoudi,et al.  Decentralized method for complex task allocation in massive MAS , 2008 .

[15]  Martin Reck.  Types of Electronic Auctions , 1994, ENTER.

[16]  Zixing Cai,et al.  Adaptive Evolutionary Particle Filter Based Object Tracking with Occlusion Handling , 2009, 2009 Fifth International Conference on Natural Computation.

[17]  Saiedeh N. Razavi,et al.  Multisensor data fusion: Antecedents and directions , 2009, 2009 3rd International Conference on Signals, Circuits and Systems (SCS).

[18]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[19]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[20]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  A Benaskeur,et al.  Holonic Approach for Control and Coordination of Distributed Sensors , 2008 .

[22]  R. Abielmona,et al.  Robotic sensor agents: a new generation of intelligent agents for complex environment monitoring , 2004, IEEE Instrumentation & Measurement Magazine.

[23]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[24]  Richard T. Vaughan,et al.  The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems , 2003 .

[25]  Robin R. Murphy,et al.  Human-robot interaction in rescue robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[26]  Victor R. Lesser,et al.  A survey of multi-agent organizational paradigms , 2004, The Knowledge Engineering Review.

[27]  Paul S. Schenker,et al.  CAMPOUT: a control architecture for tightly coupled coordination of multirobot systems for planetary surface exploration , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[28]  Tim J. Ellis,et al.  Learning semantic scene models from observing activity in visual surveillance , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Ahmed M. Elmogy,et al.  Market-based dynamic task allocation in mobile surveillance systems , 2009, 2009 IEEE International Workshop on Safety, Security & Rescue Robotics (SSRR 2009).

[30]  Pramod K. Varshney,et al.  Energy-efficient deployment of Intelligent Mobile sensor networks , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  D. Barnes.  A MULTI-ROBOT ARCHITECTURE FOR PLANETARY ROVERS , 1999 .

[32]  Anthony Stentz,et al.  Opportunistic optimization for market-based multirobot control , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Fakhri Karray,et al.  Auction-Based Consensus Mechanism for Cooperative Tracking in Multi-Sensor Surveillance Systems , 2010, Journal of Advanced Computational Intelligence and Intelligent Informatics.

[34]  Serafín Martínez-Jaramillo,et al.  An Heterogeneous, Endogenous and Coevolutionary GP-Based Financial Market , 2009, IEEE Transactions on Evolutionary Computation.

[35]  Nidhi Kalra,et al.  A MARKET APPROACH TO TIGHTLY-COUPLED MULTI-ROBOT COORDINATION: FIRST RESULTS , 2003 .

[36]  Tal Shima,et al.  Assigning Micro UAVs to Task Tours in an Urban Terrain , 2006, IEEE Transactions on Control Systems Technology.

[37]  Steven Vajda,et al.  The Theory of Linear Economic Models , 1960 .

[38]  Leonidas J. Guibas,et al.  Finding an unpredictable target in a workspace with obstacles , 1997, Proceedings of International Conference on Robotics and Automation.

[39]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[40]  D. Morrell,et al.  Target tracking and data fusion using multiple adaptive Foveal sensors , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[41]  Yun-Qian Miao,et al.  A Study of Mobility Models in Mobile Surveillance Systems , 2010 .

[42]  Luca Maria Gambardella,et al.  Learning the Visuomotor Coordination of a Mobile Robot by Using the Invertible Kohonen Map , 1995, IWANN.

[43]  Gee Wah Ng,et al.  Sensor management - what, why and how , 2000, Inf. Fusion.

[44]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Sergio A. Velastin,et al.  Intelligent distributed video surveillance systems , 2006 .

[46]  Gaurav S. Sukhatme,et al.  Mobile Sensor Network Deployment using Potential Fields : A Distributed , Scalable Solution to the Area Coverage Problem , 2002 .

[47]  Stefano Carpin,et al.  Multirobot cooperation for surveillance of multiple moving targets - a new behavioral approach , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[48]  Jean-Claude Latombe,et al.  Real-time target tracking in an indoor environment , 2002 .

[49]  Hugh F. Durrant-Whyte,et al.  Sensor Models and Multisensor Integration , 1988, Int. J. Robotics Res..

[50]  Hobart R. Everett,et al.  Coordinated control of multiple security robots , 1994, Other Conferences.

[51]  Lynne E. Parker,et al.  A Complete Methodology for Generating Multi-Robot Task Solutions using ASyMTRe-D and Market-Based Task Allocation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[52]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[53]  Beno Benhabib,et al.  A multi-sensor surveillance system for active-vision based object localization , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[54]  Jonathan D. H. Smith.  Some Observations on the Concepts of Information-Theoretic Entropy and Randomness , 2001, Entropy.

[55]  Sarit Kraus,et al.  Forming efficient agent groups for completing complex tasks , 2006, AAMAS '06.

[56]  Yan Ling Cui,et al.  A Lightweight Key Management Protocol for Hierarchical Sensor Networks , 2013 .

[57]  Alaa Khamis,et al.  Multisensor cooperation in military surveillance systems , 2009, 2009 3rd International Conference on Signals, Circuits and Systems (SCS).

[58]  Shashi Phoha,et al.  A high-fidelity ocean sampling mobile network (SAMON) simulator testbed for evaluating intelligent control of unmanned underwater vehicles , 2001 .

[59]  Gaurav S. Sukhatme,et al.  Cooperative target tracking using mobile robots , 2005 .

[60]  Gaurav S. Sukhatme,et al.  Most valuable player: a robot device server for distributed control , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[61]  P. Varshney,et al.  Multisensor surveillance systems : the fusion perspective , 2003 .

[62]  Ryosuke Shibasaki,et al.  A novel system for tracking pedestrians using multiple single-row laser-range scanners , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[63]  John Piggott,et al.  Situational awareness and safety , 2001 .

[64]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[65]  Wang Shu,et al.  Market-Based Adaptive Task Scheduling for Sensor Networks , 2006, 2006 International Conference on Wireless Communications, Networking and Mobile Computing.

[66]  Helge J. Ritter,et al.  Neural computation and self-organizing maps - an introduction , 1992, Computation and neural systems series.

[67]  Hui Ma,et al.  Distributive Target Tracking in Wireless Sensor Networks under Measurement Origin Uncertainty , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[68]  J. Banks,et al.  Allocating uncertain and unresponsive resources: an experimental approach. , 1989, The Rand journal of economics.

[69]  Erwin Prassler,et al.  Fast and robust tracking of multiple moving objects with a laser range finder , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[70]  Michel Gendreau,et al.  Combinatorial auctions , 2007, Ann. Oper. Res..

[71]  Marcelo Arenas,et al.  An information-theoretic approach to normal forms for relational and XML data , 2003, PODS.

[72]  Jason L. Williams,et al.  Information theoretic sensor management , 2007 .

[73]  Gaurav S. Sukhatme,et al.  A generalized region-based approach for multi-target tracking in outdoor environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[74]  Zhiyun Lin,et al.  A hybrid control approach to cooperative target tracking with multiple mobile robots , 2009, 2009 American Control Conference.

[75]  Stefano Carpin,et al.  Cooperative Observation of Multiple Moving Targets: an algorithm and its formalization , 2007, Int. J. Robotics Res..

[76]  Anthony Stentz,et al.  A Free Market Architecture for Distributed Control of a Multirobot System , 2000 .

[77]  Maja J. Matarić,et al.  A Framework for Studying Multi-Robot Task Allocation , 2003 .

[78]  Hugh F. Durrant-Whyte,et al.  A Fully Decentralized Multi-Sensor System For Tracking and Surveillance , 1993, Int. J. Robotics Res..

[79]  Sang-goo Lee,et al.  A Framework of Winner Determination Algorithms for Internet Auctions , 2003, Human.Society@Internet 2003.

[80]  Ryosuke Shibasaki,et al.  Monitoring an intersection using a network of laser scanners , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[81]  Anthony Stentz,et al.  An auction-based approach to complex task allocation for multirobot teams , 2006 .

[82]  Fang Tang,et al.  An Anytime Winner Determination Algorithm for Time-Extended Multi-Robot Task Allocation , 2008, ARCS.

[83]  Huajiang Ouyang,et al.  Shape optimization of coronary artery stent based on a parametric model , 2009 .

[84]  Mohamed S. Kamel,et al.  An agent-based approach to multisensor coordination , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[85]  Salah Sukkarieh,et al.  An Information Theoretic Approach to Modeling Voting and Elections , 2006 .

[86]  Dragana Carevic.  Kalman filter-based approach to target detection and target-background separtion in ground-penetrating radar data , 1999, Defense, Security, and Sensing.

[87]  Pedro U. Lima,et al.  A Decision-Theoretic Approach to Dynamic Sensor Selection in Camera Networks , 2009, ICAPS.

[88]  Kristina Lerman,et al.  Analysis of Dynamic Task Allocation in Multi-Robot Systems , 2006, Int. J. Robotics Res..

[89]  Kian Hsiang Low,et al.  Autonomic mobile sensor network with self-coordinated task allocation and execution , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[90]  Yaakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Applications and Advances , 1992 .

[91]  Judy G Chizek,et al.  Military Transformation: Intelligence, Surveillance and Reconnaissance , 2003 .

[92]  Camillo J. Taylor,et al.  Dynamic Sensor Planning and Control for Optimally Tracking Targets , 2003, Int. J. Robotics Res..

[93]  Gerhard Weiss,et al.  Computational Organization Theory , 2000 .

[94]  Srikanth Saripalli,et al.  Vision-based Autonomous Landing of an Helicopter on a Moving Target , 2009 .

[95]  S. Shankar Sastry,et al.  A Hierarchical Multiple-Target Tracking Algorithm for Sensor Networks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[96]  Richard Vaughan,et al.  Massively multi-robot simulation in stage , 2008, Swarm Intelligence.

[97]  S. Sitharama Iyengar,et al.  Distributed Sensor Networks — a Review of Recent Research , 2001, J. Frankl. Inst..

[98]  Xue Wang,et al.  Distributed Visual-Target-Surveillance System in Wireless Sensor Networks , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[99]  Erik Blasch,et al.  Multi-sensor management for data fusion in target tracking , 2009, Defense + Commercial Sensing.

[100]  Maaruf Ali,et al.  A novel local likelihood approach to data fusion in passive target tracking , 1999 .

[101]  Guohong Cao,et al.  Optimizing tree reconfiguration for mobile target tracking in sensor networks , 2004, IEEE INFOCOM 2004.

[102]  Maja J. Mataric,et al.  Sold!: auction methods for multirobot coordination , 2002, IEEE Trans. Robotics Autom..

[103]  K Dietmayer,et al.  OBJECT TRACKING IN TRAFFIC SCENES WITH MULTI-HYPOTHESIS APPROACH USING LASER RANGE IMAGES , 2001 .

[104]  Nicolas Gaud,et al.  Modeling Holonic Systems with an Organizational approach , 2006, EUMAS.

[105]  Anthony Stentz,et al.  Market-Based Complex Task Allocation for Multirobot Teams , 2006 .

[106]  K. S. Venkatesh,et al.  Intrusion Detection and Tracking with Pan-Tilt Cameras , 2006 .

[107]  Evangelos Markakis,et al.  Auction-Based Multi-Robot Routing , 2005, Robotics: Science and Systems.

[108]  Anthony Stentz,et al.  Robust multirobot coordination in dynamic environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[109]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[110]  Rachid Alami,et al.  M+: a scheme for multi-robot cooperation through negotiated task allocation and achievement , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[111]  Yong Yu,et al.  Ant Colony Optimization for Sensor Management , 2007, 2007 IEEE International Conference on Control and Automation.

[112]  Cheng-Yan Kao,et al.  An evolutionary algorithm for large traveling salesman problems , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[113]  David L. Hall,et al.  Customer-Driven Sensor Management , 2006, IEEE Intelligent Systems.

[114]  Isaac Cohen,et al.  Continuous multi-views tracking using tensor voting , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[115]  Régis Vincent,et al.  Task inference and distributed task management in the Centibots robotic system , 2005, AAMAS '05.

[116]  Lynne E. Parker,et al.  Cooperative Robotics for Multi-Target Observation , 1999, Intell. Autom. Soft Comput..

[117]  Robert W. Brennan.  Holonic and multi-agent systems in industry , 2001, Knowl. Eng. Rev..

[118]  Yaser M. A. Khalifa,et al.  A Centralized Evolutionary Target Tracking System , 2006 .

[119]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.

[120]  Mark Yim,et al.  Indoor automation with many mobile robots , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[121]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[122]  J. O'Rourke.  Art gallery theorems and algorithms , 1987 .

[123]  P. J. Shea,et al.  Group tracking using genetic algorithms , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[124]  Nidhi Kalra,et al.  Hoplites: A Market-Based Framework for Planned Tight Coordination in Multirobot Teams , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[125]  Héctor H. González-Baños,et al.  Motion strategies for maintaining visibility of a moving target , 1997, Proceedings of International Conference on Robotics and Automation.

[126]  Anthony Stentz,et al.  Traderbots: a new paradigm for robust and efficient multirobot coordination in dynamic environments , 2004 .

[127]  S. Sariel-Talay,et al.  Multiple Traveling Robot Problem: A Solution Based on Dynamic Task Selection and Robust Execution , 2009, IEEE/ASME Transactions on Mechatronics.

[128]  Farid Amoozegar.  Virtual target tracking (VTT) as applied to mobile satellite communication networks , 1999, Defense, Security, and Sensing.

[129]  Nishu Sharma,et al.  A Comparative Study Of Data Clustering Techniques , 2013 .

[130]  Raja Sengupta,et al.  A Resource Allocation Algorithm for Multivehicle Systems With Nonholonomic Constraints , 2007, IEEE Transactions on Automation Science and Engineering.

[131]  Mikko Lindholm,et al.  Multi-sensor Logical Decision Making in the Single Location Surveillance Point System , 2009, 2009 Fourth International Conference on Systems.

[132]  Gaurav S. Sukhatme,et al.  Tracking Targets Using Multiple Robots: The Effect of Environment Occlusion , 2002, Auton. Robots.

[133]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[134]  Michail G. Lagoudakis,et al.  The Generation of Bidding Rules for Auction-Based Robot Coordination , 2005 .

[135]  Anthony Stentz,et al.  A Free Market Architecture for Coordinating Multiple Robots , 1999 .

[136]  David Liu,et al.  Target tracking in an environment of nearly stationary and biased clutter , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[137]  Sven Koenig,et al.  Improving Sequential Single-Item Auctions , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[138]  Sven Koenig,et al.  Robot exploration with combinatorial auctions , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[139]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[140]  Stephen J. Maybank,et al.  Visual Surveillance for Moving Vehicles , 1998, International Journal of Computer Vision.

[141]  Daniele Nardi,et al.  Multi-objective multi-robot surveillance , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[142]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[143]  Tuomas Sandholm,et al.  Optimal Winner Determination Algorithms , 2005 .

[144]  Pablo O. Arambel,et al.  Multiple-hypothesis tracking of multiple ground targets from aerial video with dynamic sensor control , 2004, SPIE Defense + Commercial Sensing.

[145]  Anthony Stentz,et al.  Market-based Multirobot Coordination for Complex Tasks , 2006, Int. J. Robotics Res..

[146]  Victor Lesser,et al.  Negotiation among self-interested computationally limited agents , 1996 .

[147]  Daniele Nardi,et al.  Communication and Coordination Among Heterogeneous Mid-Size Players: ART99 , 2000, RoboCup.

[148]  Lynne E. Parker,et al.  Distributed Algorithms for Multi-Robot Observation of Multiple Moving Targets , 2002, Auton. Robots.

[149]  R. Brennan,et al.  A Distributed Intelligent Tactical Sensor Management System , 2007 .