Autoconfiguration of a Dynamic Nonoverlapping Camera Network

In order to monitor sufficiently large areas of interest for surveillance or any event detection, we need to look beyond stationary cameras and employ an automatically configurable network of nonoverlapping cameras. These cameras need not have an overlapping field of view and should be allowed to move freely in space. Moreover, features like zooming in/out, readily available in security cameras these days, should be exploited in order to focus on any particular area of interest if needed. In this paper, a practical framework is proposed to self-calibrate dynamically moving and zooming cameras and determine their absolute and relative orientations, assuming that their relative position is known. A global linear solution is presented for self-calibrating each zooming/focusing camera in the network. After self-calibration, it is shown that only one automatically computed vanishing point and a line lying on any plane orthogonal to the vertical direction is sufficient to infer the dynamic network configuration. Our method generalizes previous work which considers restricted camera motions. Using minimal assumptions, we are able to successfully demonstrate promising results on synthetic, as well as on real data.

[1]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Christopher O. Jaynes Multi-view calibration from planar motion trajectories , 2004, Image Vis. Comput..

[3]  William H. Press,et al.  Numerical recipes , 1990 .

[4]  Olivier D. Faugeras,et al.  Characterizing the Uncertainty of the Fundamental Matrix , 1997, Comput. Vis. Image Underst..

[5]  Tardi Tjahjadi,et al.  Efficient three-dimensional metric object modeling from uncalibrated image sequences , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Josef Kittler,et al.  On Accurate and Robust Estimation of Fundamental Matrix , 1998, Comput. Vis. Image Underst..

[7]  Hassan Foroosh,et al.  Robust Auto-Calibration from Pedestrians , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[8]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Ki-Sang Hong,et al.  Theory and practice on the self-calibration of a rotating and zooming camera from two views , 2001 .

[10]  Bill Triggs,et al.  Critical Motions for Auto-Calibration When Some Intrinsic Parameters Can Vary , 2000, Journal of Mathematical Imaging and Vision.

[11]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[12]  Jun Tani,et al.  Model-based learning for mobile robot navigation from the dynamical systems perspective , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[13]  Andrew Zisserman,et al.  Automatic reconstruction of piecewise planar models from multiple views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[15]  Guan-Yu Chen,et al.  An incremental-learning-by-navigation approach to vision-based autonomous land vehicle guidance in indoor environments using vertical line information and multiweighted generalized Hough transform technique , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[16]  Y. Motai,et al.  An interactive framework for acquiring vision models of 3-D objects from 2-D images , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[18]  Ramakant Nevatia,et al.  Self-calibration of a camera from video of a walking human , 2002, Object recognition supported by user interaction for service robots.

[19]  Sudeep Sarkar,et al.  Effect of silhouette quality on hard problems in gait recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[21]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[22]  Yongduek Seo,et al.  About the self-calibration of a rotating and zooming camera: Theory and practice , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[23]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Oswald Lanz Automatic Lens distortion estimation for an Active Camera , 2004, ICCVG.

[25]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[26]  Anders Heyden,et al.  Euclidean reconstruction from image sequences with varying and unknown focal length and principal point , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[28]  Kin Hong Wong,et al.  Pose estimation for augmented reality applications using genetic algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Xinhua Zhuang,et al.  Robust 3-D-3-D Pose Estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Warren E. Dixon,et al.  Adaptive tracking control of a wheeled mobile robot via an uncalibrated camera system , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[31]  Anup Basu,et al.  Active camera calibration using pan, tilt and roll , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[32]  Paulo R. S. Mendonça,et al.  Bayesian autocalibration for surveillance , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[33]  Harry Shum,et al.  Error analysis of pure rotation-based self-calibration , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Randall D. Beer,et al.  Spatial learning for navigation in dynamic environments , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[35]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[36]  Reinhard Koch,et al.  Camera calibration with known rotation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[37]  Gérard G. Medioni,et al.  Continuous tracking within and across camera streams , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[38]  Bill Triggs,et al.  Autocalibration from Planar Scenes , 1998, ECCV.

[39]  W. Eric L. Grimson,et al.  Using adaptive tracking to classify and monitor activities in a site , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[40]  Tim J. Ellis,et al.  Bridging the gaps between cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[41]  Harpreet S. Sawhney,et al.  Real-time wide area multi-camera stereo tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[42]  Tim J. Ellis,et al.  Learning semantic scene models from observing activity in visual surveillance , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[44]  Richard I. Hartley,et al.  Self-Calibration of Stationary Cameras , 1997, International Journal of Computer Vision.

[45]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Andrew Zisserman,et al.  Resolving ambiguities in auto–calibration , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[47]  Ian D. Reid,et al.  Self-Calibration of Rotating and Zooming Cameras , 2002, International Journal of Computer Vision.

[48]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[49]  Peter F. Sturm,et al.  Critical motion sequences for the self-calibration of cameras and stereo systems with variable focal length , 1999, Image Vis. Comput..

[50]  Ian D. Reid,et al.  A plane measuring device , 1999, Image Vis. Comput..