Target coverage in camera networks for manufacturing workplaces

In this paper, we investigate the camera network placement problem for target coverage in manufacturing workplaces. The problem is formulated to find the minimum number of cameras of different types and their best configurations to maximise the coverage of the monitored workplace such that the given set of target points of interest are each k-covered with a predefined minimum spatial resolution. Since the problem is NP-complete, and even NP-hard to approximate, a novel method based on Simulated Annealing is presented to solve the optimisation problem. A new neighbourhood generation function is proposed to handle the discrete nature of the problem. The visual coverage is modelled using realistic and coherent assumptions of camera intrinsic and extrinsic parameters making it suitable for many real world camera based applications. Task-specific quality of coverage measure is proposed to assist selecting the best among the set of camera network placements with equal coverage. A 3D CAD of the monitored space is used to examine physical occlusions of target points. The results show the accuracy, efficiency and scalability of the presented solution method; which can be applied effectively in the design of practical camera networks.

[1]  Wendi B. Heinzelman,et al.  Camera selection in visual sensor networks , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[2]  Benoit Debaque,et al.  Optimal video camera network deployment to support security monitoring , 2009, 2009 12th International Conference on Information Fusion.

[3]  M. Saadatseresht,et al.  Automatic Camera Placement in Vision Metrology Based On A Fuzzy Inference System , 2005 .

[4]  Nikolaos Papanikolopoulos,et al.  Optimal Camera Placement for Automated Surveillance Tasks , 2007, J. Intell. Robotic Syst..

[5]  Stan Sclaroff,et al.  Automated Placement of Cameras in a Floorplan to Satisfy Task-Specific Constraints , 2003 .

[6]  Giordano Fusco,et al.  Selection and Orientation of Directional Sensors for Coverage Maximization , 2009, 2009 6th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[7]  Der-Baau Perng,et al.  Automatic optical inspection system for IC molding surface , 2016, J. Intell. Manuf..

[8]  Mostafa Zandieh,et al.  A simulated annealing algorithm approach to hybrid flow shop scheduling with sequence-dependent setup times , 2011, J. Intell. Manuf..

[9]  Hongyi Wu,et al.  Grid-based approach for working node selection in wireless sensor networks , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[10]  José-Joel González-Barbosa,et al.  Optimal camera placement for total coverage , 2009, 2009 IEEE International Conference on Robotics and Automation.

[11]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[12]  Stan Sclaroff,et al.  Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements , 2006, Comput. Vis. Image Underst..

[13]  Roger Mohr,et al.  Optimal camera placement to obtain accurate 3D point positions , 1997, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[14]  Rainer Lienhart,et al.  Approximating Optimal Visual Sensor Placement , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[15]  Mandava Rajeswari,et al.  Neural network-based robot visual positioning for intelligent assembly , 2004, J. Intell. Manuf..

[16]  Rudolf Fleischer,et al.  On the Camera Placement Problem , 2009, ISAAC.

[17]  Alhussein A. Abouzeid,et al.  Coverage by directional sensors in randomly deployed wireless sensor networks , 2006, J. Comb. Optim..

[18]  Santanu Chaudhury,et al.  Camera Placement for Surveillance Applications , 2011 .

[19]  Krishna M. Sivalingam,et al.  Proceedings of the 2nd ACM international conference on Wireless sensor networks and applications , 2003 .

[20]  Jörg Hähner,et al.  Spatial Partitioning in Self-Organizing Smart Camera Systems , 2008, IEEE Journal of Selected Topics in Signal Processing.

[21]  Jian Wang,et al.  Priority-based target coverage in directional sensor networks using a genetic algorithm , 2009, Comput. Math. Appl..

[22]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[23]  Jiandan Chen,et al.  Planning of a Multi Stereo Visual Sensor System - Depth Accuracy and Variable Baseline Approach , 2007, 2007 3DTV Conference.

[24]  Huadong Ma,et al.  Some problems of directional sensor networks , 2007, Int. J. Sens. Networks.

[25]  João Carlos Espíndola Ferreira,et al.  An integrated web-based CAD/CAPP/CAM system for the remote design and manufacture of feature-based cylindrical parts , 2008, J. Intell. Manuf..

[26]  B. Nickolay,et al.  Image based 3D surveillance for flexible man-robot-cooperation , 2005 .

[27]  Y. Morsly,et al.  Particle Swarm Optimization Inspired Probability Algorithm for Optimal Camera Network Placement , 2012, IEEE Sensors Journal.

[28]  Guangming Shi,et al.  Nodes Placement for Optimizing Coverage of Visual Sensor Networks , 2009, PCM.

[29]  Rajiv Shivpuri,et al.  On line prediction of surface defects in hot bar rolling based on Bayesian hierarchical modeling , 2015, J. Intell. Manuf..

[30]  B. Suman,et al.  A survey of simulated annealing as a tool for single and multiobjective optimization , 2006, J. Oper. Res. Soc..

[31]  Jaime A. Camelio,et al.  Real-time fault detection in manufacturing environments using face recognition techniques , 2010, Journal of Intelligent Manufacturing.

[32]  Konstantinos A. Tarabanis,et al.  The MVP sensor planning system for robotic vision tasks , 1995, IEEE Trans. Robotics Autom..

[33]  Jian Zhao,et al.  Approximate Techniques in Solving Optimal Camera Placement Problems , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[34]  Richard W. Eglese,et al.  Simulated annealing: A tool for operational research , 1990 .

[35]  Mehdi Dehghan,et al.  Optimal visual sensor placement for coverage based on target location profile , 2011, Ad Hoc Networks.

[36]  Sidney S. Fels,et al.  A Multi-Camera Surveillance System that Estimates Quality-of-View Measurement , 2007, 2007 IEEE International Conference on Image Processing.

[37]  Xavier Gandibleux,et al.  A survey and annotated bibliography of multiobjective combinatorial optimization , 2000, OR Spectr..

[38]  Shanshan Li,et al.  Maximal Coverage Scheduling in Randomly Deployed Directional Sensor Networks , 2007, 2007 International Conference on Parallel Processing Workshops (ICPPW 2007).

[39]  R. Lienhart,et al.  On the optimal placement of multiple visual sensors , 2006, VSSN '06.

[40]  Saeid Nahavandi,et al.  A greedy heuristic and simulated annealing approach for a bicriteria flowshop scheduling problem with precedence constraints—a practical manufacturing case , 2012 .

[41]  Roger Mohr,et al.  Optimal camera placement for accurate reconstruction , 2002, Pattern Recognit..

[42]  Giordano Fusco,et al.  Placement and Orientation of Rotating Directional Sensors , 2010, 2010 7th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON).

[43]  Rainer Lienhart,et al.  Calibrating and optimizing poses of visual sensors in distributed platforms , 2006, Multimedia Systems.

[44]  Bang Jun Lei,et al.  Camera Network Coverage Improving by Particle Swarm Optimization , 2011, EURASIP J. Image Video Process..

[45]  George Vosselman,et al.  OPTIMAL CAMERA NETWORK DESIGN FOR 3D MODELING OF CULTURAL HERITAGE , 2012 .

[46]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Paisarn Muneesawang,et al.  Advances in Multimedia Information Processing - PCM 2009, 10th Pacific Rim Conference on Multimedia, Bangkok, Thailand, December 15-18, 2009 Proceedings , 2009, PCM.

[48]  Jian Zhao,et al.  Optimal Camera Network Configurations for Visual Tagging , 2008, IEEE Journal of Selected Topics in Signal Processing.

[49]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[50]  Armin Grün,et al.  Automatic Sensor Placement for Accurate Dimensional Inspection , 1995, Comput. Vis. Image Underst..

[51]  Yu-Chee Tseng,et al.  The Coverage Problem in a Wireless Sensor Network , 2003, WSNA '03.

[52]  Woei Lin,et al.  An Adjustable Target Coverage Method in Directional Sensor Networks , 2008, 2008 IEEE Asia-Pacific Services Computing Conference.