A Measure of Vision Distance for Optimization of Camera Networks

is dissertation proposes a solution to the problem of multi-camera deployment for optimization of visual coverage and image quality. Image quality and coverage are, by nature, difficult to quantify objectively. However, the chief difficulty is that, in the most general case, image quality and coverage are functions of many parameters, thus making any model of the vision system inherently complex. Additionally, these parameters are members of metric spaces that are not compatible amongst themselves under any known operators. is dissertation borrows the idea of transforming the mathematical definitions that describe the vision system into geometric constraints, and sets out to construct a geometrical model of the vision system. e vision system can be divided into two different concepts: the camera and the task. Whereas the camera has a set of parameters that describe it, the task also has a set of task parameters that quantify the visual requirements. e definition of the proposed geometric model involves the construction of a tensor; a mathematical construct of high dimensionality which enables a representation of the camera or the task. e tensor-based representation of these concepts is a powerful tool because it brings a large tool set from various disciplines such as differential geometry. e contributions of this dissertation are twofold. Firstly, a new distance function that effectively measures the distance between two visual entities is presented based on the geometrical model of the vision system. A visual entity may be a camera or a task. is distance is termed the Vision Distance and it measures the closeness to the optimal state for the configuration between the camera and the task. Lastly, a deployment method for multi-camera networks based on convex optimization is presented. Using second-order cone programming, this work shows how to optimize the position and orientation of a camera for maximum coverage of a task. is dissertation substantiates all of these claims. e vision distance is validated and compared to an existing model of visual coverage. Additionally, simulations, experiments, and comparisons show the efficacy of the proposed deployment method.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Majid Ahmadi,et al.  Re-Configuration Strategy for PTZ Camera Networks , 2013 .

[3]  Nikolaos Papanikolopoulos,et al.  Optimal Camera Placement for Automated Surveillance Tasks , 2007, J. Intell. Robotic Syst..

[4]  Amit K. Roy-Chowdhury,et al.  Tracking and Activity Recognition Through Consensus in Distributed Camera Networks , 2010, IEEE Transactions on Image Processing.

[5]  Xiang Chen,et al.  Optimizing load distribution in camera networks with a hypergraph model of coverage topology , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[6]  Larry S. Davis,et al.  A General Method for Sensor Planning in Multi-Sensor Systems: Extension to Random Occlusion , 2007, International Journal of Computer Vision.

[7]  Yan Liu,et al.  Tensor Distance Based Multilinear Locality-Preserved Maximum Information Embedding , 2010, IEEE Transactions on Neural Networks.

[8]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[9]  Aaron Mavrinac,et al.  Modeling and Optimizing the Coverage of Multi-Camera Systems , 2012 .

[10]  Teng Yu,et al.  Image processing and vision techniques for smart vehicles , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[11]  Zhizhou Wang,et al.  DTI segmentation using an information theoretic tensor dissimilarity measure , 2005, IEEE Transactions on Medical Imaging.

[12]  Matthias Zwicker,et al.  Meshing Point Clouds Using Spherical Parameterization , 2004, PBG.

[13]  Andreas Terzis,et al.  Distributed pose averaging in camera networks via consensus on SE(3) , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[14]  Jing Liu,et al.  A multiagent genetic algorithm for global numerical optimization , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Fan Zhang,et al.  Flocking algorithm for multi-robots formation control with a target steering agent , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[16]  Xiang Chen,et al.  Modeling Coverage in Camera Networks: A Survey , 2012, International Journal of Computer Vision.

[17]  Glenn H. Tarbox,et al.  Planning for Complete Sensor Coverage in Inspection , 1995, Comput. Vis. Image Underst..

[18]  Héctor H. González-Baños,et al.  A randomized art-gallery algorithm for sensor placement , 2001, SCG '01.

[19]  Kai Hormann,et al.  Parameterization of Triangulations and Unorganized Points , 2002, Tutorials on Multiresolution in Geometric Modelling.

[20]  Xiang Chen,et al.  A fuzzy model for coverage evaluation of cameras and multi-camera networks , 2010, ICDSC '10.

[21]  Xiang Chen,et al.  Deployment of visual sensor networks using a graph-based approach , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[22]  Vassilios Morellas,et al.  Tensor Sparse Coding for Positive Definite Matrices , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Nikolaos Papanikolopoulos,et al.  Mobile camera positioning to optimize the observability of human activity recognition tasks , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Larry S. Davis,et al.  Visibility Analysis and Sensor Planning in Dynamic Environments , 2004, ECCV.

[25]  Xiang Chen,et al.  Viewpoint selection for vision systems in industrial inspection , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[26]  P. Basser,et al.  Microstructural and physiological features of tissues elucidated by quantitative-diffusion-tensor MRI. , 1996, Journal of magnetic resonance. Series B.

[27]  V. K. Singh,et al.  A design methodology for selection and placement of sensors in multimedia surveillance systems , 2006, VSSN '06.

[28]  李幼升,et al.  Ph , 1989 .

[29]  Konstantinos A. Tarabanis,et al.  Computing Occlusion-Free Viewpoints , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Roger Y. Tsai,et al.  Analytical characterization of the feature detectability constraints of resolution, focus, and field-of-view for vision sensor planning , 1994 .

[31]  Aníbal Ollero,et al.  Cooperative Fire Detection using Unmanned Aerial Vehicles , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[32]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[33]  Andrea Bottino,et al.  A practical iterative algorithm for sensor positioning , 2005, 2005 IEEE Conference on Emerging Technologies and Factory Automation.

[34]  Yibo Jiang,et al.  A Coverage Enhancement Method of Directional Sensor Network Based on Genetic Algorithm for Occlusion-Free Surveillance , 2010, 2010 International Conference on Computational Aspects of Social Networks.

[35]  Stan Sclaroff,et al.  Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements , 2006, Comput. Vis. Image Underst..

[36]  Zhaolin Cheng,et al.  Determining Vision Graphs for Distributed Camera Networks Using Feature Digests , 2007, EURASIP J. Adv. Signal Process..

[37]  Andreas Krause,et al.  Robust sensor placements at informative and communication-efficient locations , 2011, TOSN.

[38]  Gian Luca Foresti,et al.  PTZ camera network reconfiguration , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[39]  William R. Scott,et al.  Model-based view planning , 2007, Machine Vision and Applications.

[40]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Kai Hormann,et al.  Surface Parameterization: a Tutorial and Survey , 2005, Advances in Multiresolution for Geometric Modelling.

[42]  Rahul Malik,et al.  Automated Placement of Multiple Stereo Cameras , 2008 .

[43]  Roger Mohr,et al.  Optimal camera placement to obtain accurate 3D point positions , 1997, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[44]  Konstantinos A. Tarabanis,et al.  Computing viewpoints that satisfy optical constraints , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Demetri Terzopoulos,et al.  Planning ahead for PTZ camera assignment and handoff , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[46]  Nicola Conci,et al.  Camera positioning for global and local coverage optimization , 2012, 2012 Sixth International Conference on Distributed Smart Cameras (ICDSC).

[47]  Edmund Y. Lam,et al.  Maximizing Angle Coverage in Visual Sensor Networks , 2007, 2007 IEEE International Conference on Communications.

[48]  Nikolaos Papanikolopoulos,et al.  Optimal camera placement with adaptation to dynamic scenes , 2008, 2008 IEEE International Conference on Robotics and Automation.

[49]  J. O'Rourke Art gallery theorems and algorithms , 1987 .

[50]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[51]  Simone Formentin,et al.  A Parking Assistance System for Small-Scale Boats , 2013, IEEE/ASME Transactions on Mechatronics.

[52]  Jean-Yves Audibert Optimization for Machine Learning , 1995 .

[53]  Gian Luca Foresti,et al.  Automatic reconfiguration of video sensor networks for optimal 3D coverage , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[54]  M. Sarkis,et al.  Partitioned moving least-squares modeling of an automatic zoom lens camera , 2007, 2007 International Conference on Control, Automation and Systems.

[55]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[56]  Miguel A. Patricio,et al.  Multi-Agent Framework in Visual Sensor Networks , 2007, EURASIP J. Adv. Signal Process..

[57]  Xiang Chen,et al.  Consensus Algorithms in a Multi-agent Framework to Solve PTZ Camera Reconfiguration in UAVs , 2012, ICIRA.

[58]  Demetri Terzopoulos,et al.  Surveillance in Virtual Reality: System Design and Multi-Camera Control , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[59]  Xiang Chen,et al.  Sensor planning for range cameras via a coverage strength model , 2011, 2011 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[60]  Amit K. Roy-Chowdhury,et al.  Distributed multi-target tracking in a self-configuring camera network , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[61]  Rainer Lienhart,et al.  Calibrating and optimizing poses of visual sensors in distributed platforms , 2006, Multimedia Systems.

[62]  Yi-Ping Hung,et al.  Simple and efficient method of calibrating a motorized zoom lens , 2001, Image Vis. Comput..

[63]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[64]  Edmund Y. Lam,et al.  Achieving 360° Angle Coverage with Minimum Transmission Cost in Visual Sensor Networks , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[65]  S. Shankar Sastry,et al.  Optimization Criteria and Geometric Algorithms for Motion and Structure Estimation , 2001, International Journal of Computer Vision.

[66]  Miguel A. Patricio,et al.  Designing a Visual Sensor Network Using a Multi-agent Architecture , 2009, PAAMS.

[67]  Klaus Diepold,et al.  Modeling the Variation of the Intrinsic Parameters of an Automatic Zoom Camera System using Moving Least-Squares , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[68]  Magnus Jansson,et al.  Vision-Aided Inertial Navigation Based on Ground Plane Feature Detection , 2014, IEEE/ASME Transactions on Mechatronics.

[69]  G. Murphy C*-Algebras and Operator Theory , 1990 .

[70]  Richard Pito,et al.  A Solution to the Next Best View Problem for Automated Surface Acquisition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[71]  Gaurav S. Sukhatme,et al.  Reconfiguration methods for mobile sensor networks , 2007, TOSN.

[72]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[73]  Sai-Ming Li,et al.  Forest fire monitoring with multiple small UAVs , 2005, Proceedings of the 2005, American Control Conference, 2005..

[74]  Bruce A. Draper,et al.  A system to place observers on a polyhedral terrain in polynomial time , 2000, Image Vis. Comput..

[75]  Tomas Akenine-Möller,et al.  Fast, minimum storage ray/triangle intersection , 1997, J. Graphics, GPU, & Game Tools.

[76]  Gian Luca Foresti,et al.  Occlusion-aware multiple camera reconfiguration , 2010, ICDSC '10.

[77]  Faisal Z. Qureshi,et al.  Learning proactive control strategies for PTZ cameras , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[78]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[79]  Xiang Chen,et al.  Semiautomatic Model-Based View Planning for Active Triangulation 3-D Inspection Systems , 2015, IEEE/ASME Transactions on Mechatronics.

[80]  Beno Benhabib,et al.  Multi-camera active surveillance of an articulated human form - An implementation strategy , 2011, Comput. Vis. Image Underst..

[81]  Jian Zhao,et al.  Optimal Camera Network Configurations for Visual Tagging , 2008, IEEE Journal of Selected Topics in Signal Processing.

[82]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[83]  Longin Jan Latecki,et al.  Affinity Learning with Diffusion on Tensor Product Graph , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[84]  Livier Reithler,et al.  Optimal deployment of cameras for video surveillance systems , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[85]  Nathaniel E. Helwig,et al.  An Introduction to Linear Algebra , 2006 .

[86]  Demetri Terzopoulos,et al.  Surveillance camera scheduling: a virtual vision approach , 2005, Multimedia Systems.

[87]  Guangming Shi,et al.  Nodes Placement for Optimizing Coverage of Visual Sensor Networks , 2009, PCM.

[88]  Takashi Matsuyama,et al.  Geodesic Mapping for Dynamic Surface Alignment , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[89]  Z. Miao,et al.  3D point clouds parameterization alogrithm , 2008, 2008 9th International Conference on Signal Processing.

[90]  D. Le Bihan,et al.  Diffusion tensor imaging: Concepts and applications , 2001, Journal of magnetic resonance imaging : JMRI.

[91]  Xing Chen,et al.  An occlusion metric for selecting robust camera configurations , 2008, Machine Vision and Applications.