Task Assignment in Camera Networks: A Reactive Approach for Manufacturing Environments

Camera networks have been increasingly adopted in manufacturing to enhance workplace safety and maintain production quality levels. Effective management of cameras is crucial for the network to achieve its designated monitoring goal and fulfil task-specific requirements. In this paper, we investigate the online multicamera task assignment problem and propose a reactive scheduling approach that is suitable for manufacturing environments. In our problem, tasks occur stochastically, based on detecting or receiving specific information of activities occurring in the workcell. Task-specific information such as location, priority, required resolution of detection, and number of cameras needed to monitor the task are revealed at its release time, while the task lifetime remains unknown until its actual completion time. A utility function is derived to quantify each camera’s ability to monitor a task occurrence. Estimation is based on the expected task quality, measured in terms of the resolution of detection, and each camera’s cost, measured in terms of its pose change and workload. We develop a framework for experimentally designing and testing camera networks in a visually and behaviorally realistic virtual simulation environment. In particular, we demonstrate our solution on a manufacturing workcell. Results show the efficiency of the presented framework, which can be applied for establishing practical camera networks.

[1]  Beno Benhabib,et al.  Coordinated dispatching of proximity sensors for the surveillance of manoeuvring targets , 2003 .

[2]  Jaime A. Camelio,et al.  Real-time fault detection in manufacturing environments using face recognition techniques , 2010, Journal of Intelligent Manufacturing.

[3]  Rajiv Shivpuri,et al.  On line prediction of surface defects in hot bar rolling based on Bayesian hierarchical modeling , 2015, J. Intell. Manuf..

[4]  T. Kanade,et al.  A master-slave system to acquire biometric imagery of humans at distance , 2003, IWVS '03.

[5]  Helder Araújo,et al.  A surveillance system combining peripheral and foveated motion tracking , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[6]  Alberto Del Bimbo,et al.  Exploiting distinctive visual landmark maps in pan-tilt-zoom camera networks , 2010, Comput. Vis. Image Underst..

[7]  Andrzej Czyzewski,et al.  Visual object tracking system employing fixed and PTZ cameras , 2011, Intell. Decis. Technol..

[8]  Larry S. Davis,et al.  Task Scheduling in Large Camera Networks , 2007, ACCV.

[9]  Hans-Hellmut Nagel,et al.  Cognitive visual tracking and camera control , 2012, Comput. Vis. Image Underst..

[10]  Der-Baau Perng,et al.  Automatic optical inspection system for IC molding surface , 2016, J. Intell. Manuf..

[11]  D. Terzopoulos,et al.  Surveillance camera scheduling: a virtual vision approach , 2005, VSSN@MM.

[12]  C. Diehl,et al.  Scheduling an active camera to observe people , 2004, VSSN '04.

[13]  B. Nickolay,et al.  Image based 3D surveillance for flexible man-robot-cooperation , 2005 .

[14]  Rajeev Motwani,et al.  Non-clairvoyant scheduling , 1994, SODA '93.

[15]  Y. Morsly,et al.  Particle Swarm Optimization Inspired Probability Algorithm for Optimal Camera Network Placement , 2012, IEEE Sensors Journal.

[16]  Saeid Nahavandi,et al.  Target coverage in camera networks for manufacturing workplaces , 2016, J. Intell. Manuf..

[17]  Alberto Del Bimbo,et al.  Non-myopic information theoretic sensor management of a single pan-tilt-zoom camera for multiple object detection and tracking , 2015, Comput. Vis. Image Underst..

[18]  R. Lienhart,et al.  On the optimal placement of multiple visual sensors , 2006, VSSN '06.

[19]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[20]  J. Fülöp Introduction to Decision Making Methods , 2005 .

[21]  T. Saaty How to Make a Decision: The Analytic Hierarchy Process , 1990 .

[22]  Ward Edwards,et al.  How to Use Multiattribute Utility Measurement for Social Decisionmaking , 1977, IEEE Transactions on Systems, Man, and Cybernetics.