Design, analysis, and engineering of video monitoring systems: an approach and a case study

Rapid improvement in computing power, cheap sensing, and more flexible algorithms are facilitating increased development of real-time video surveillance and monitoring systems. The deployment of video understanding systems in certain critical applications in the real world can be done only if performance guarantees can be provided for these systems. This paper reviews past work on a systematic engineering methodology for vision systems performance characterization and illustrates how it can be adapted in practice to develop a real-time people detection and zooming system to meet given application requirements. A case study involving dual-camera real-time video surveillance is used to illustrate that by judiciously choosing the system modules and by performing a careful analysis of the influence of various tuning parameters on the system it is possible to perform proper statistical inference, to automatically set control parameters and to quantify performance limits.

[1]  Alok Gupta,et al.  Optimal polyline tracking for artery motion compensation in coronary angiography , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Yali Amit,et al.  A Computational Model for Visual Selection , 1999, Neural Computation.

[3]  D. Mumford.  Perception as Bayesian Inference: Pattern theory: A unifying perspective , 1996 .

[4]  Robert C. Vogt.  Automatic generation of simple morphological algorithms , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Kevin W. Bowyer,et al.  Empirical evaluation techniques in computer vision , 1998 .

[6]  Robert M. Haralick.  Propagating Covariance in Computer Vision , 1996, Int. J. Pattern Recognit. Artif. Intell..

[7]  D. Mumford.  Pattern theory: a unifying perspective , 1996 .

[8]  Yongmin Kim,et al.  Methodology for evaluation of image segmentation algorithms on medical images , 1996, Medical Imaging.

[9]  J. Canny.  Finding Edges and Lines in Images , 1983 .

[10]  Shree K. Nayar,et al.  Omnidirectional Vision Systems: 1998 PI Report , 1998 .

[11]  Heinrich Niemann,et al.  Statistical modeling and performance characterization of a real-time dual camera surveillance system , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[12]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[13]  V. Ramesh,et al.  Automatic selection of tuning parameters for feature extraction sequences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Shree K. Nayar,et al.  Global measures of coherence for edge detector evaluation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[15]  Kevin W. Bowyer,et al.  Comparison of Edge Detectors Using an Object Recognition Task , 1999, CVPR.

[16]  Robert M. Haralick,et al.  Random perturbation models for boundary extraction sequence , 1997, Machine Vision and Applications.

[17]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[18]  Neil A. Thacker,et al.  Algorithmic modelling for performance evaluation , 1997, Machine Vision and Applications.

[19]  W. Eric L. Grimson,et al.  On the Verification of Hypothesized Matches in Model-Based Recognition , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Takeo Kanade,et al.  Advances in Cooperative Multi-Sensor Video Surveillance , 1999 .

[21]  Keith Price,et al.  Anything you can do, I can do better (No you can't) , 1986, Comput. Vis. Graph. Image Process..

[22]  Peter Meer,et al.  Performance Assessment Through Bootstrap , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[24]  D. Stoyan,et al.  Stochastic Geometry and Its Applications , 1989 .

[25]  Firooz A. Sadjadi.  Selected papers on performance evaluation of signal and image processing systems , 1993 .

[26]  Sudeep Sarkar,et al.  Robust Visual Method for Assessing the Relative Performance of Edge-Detection Algorithms , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Chris Goad,et al.  Special purpose automatic programming for 3D model-based vision , 1987 .

[28]  Robert M. Haralick,et al.  Computer vision theory: The lack thereof , 1986, Comput. Vis. Graph. Image Process..

[29]  Rama Chellappa,et al.  Knowledge-based control of vision systems , 1999, Image Vis. Comput..

[30]  Kevin W. Bowyer,et al.  Introduction to the Special Section on Empirical Evaluation of Computer Vision Algorithms , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Yali Amit,et al.  Shape Quantization and Recognition with Randomized Trees , 1997, Neural Computation.

[32]  D. Petkovic.  The need for accuracy verification of machine vision algorithms and systems , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  W. Eric L. Grimson,et al.  On the sensitivity of geometric hashing , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[34]  Alan L. Yuille,et al.  Fundamental bounds on edge detection: an information theoretic evaluation of different edge cues , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[35]  Robert M. Haralick,et al.  Random perturbation models and performance characterization in computer vision , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[37]  Thomas M. Strat,et al.  Natural Object Recognition , 1992, Springer Series in Perception Engineering.

[38]  Xiang Gao,et al.  Error analysis of background adaption , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[39]  W. Eric L. Grimson,et al.  On the Verification of Hypthesized Matches in Model-Based Recognition , 1990, ECCV.

[40]  Bruce A. Draper,et al.  Learning 3D object recognition strategies , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[41]  Robert M. Haralick,et al.  Toward the automatic generation of mathematical morphology procedures using predicate logic , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[42]  Bir Bhanu,et al.  Predicting Performance of Object Recognition , 2000, IEEE Trans. Pattern Anal. Mach. Intell..