Snapshot: A Self-Calibration Protocol for Camera Sensor Networks

A camera sensor network is a wireless network of cameras designed for ad-hoc deployment. The camera sensors in such a network need to be properly calibrated by determining their location, orientation, and range. This paper presents Snapshot, an automated calibration protocol that is explicitly designed and optimized for camera sensor networks. Snapshot uses the inherent imaging abilities of the cameras themselves for calibration and can determine the location and orientation of a camera sensor using only four reference points. Our techniques draw upon principles from computer vision, optics, and geometry and are designed to work with low-fidelity, low-power camera sensors that are typical in sensor networks. An experimental evaluation of our prototype implementation shows that Snapshot yields an error of 1-2.5 degrees when determining the camera orientation and 5-10cm when determining the camera location. We show that this is a tolerable error in practice since a Snapshot-calibrated sensor network can track moving objects to within 11cm of their actual locations. Finally, our measurements indicate that Snapshot can calibrate a camera sensor within 20 seconds, enabling it to calibrate a sensor network containing tens of cameras within minutes.

[1]  Tarek F. Abdelzaher,et al.  Range-free localization schemes for large scale sensor networks , 2003, MobiCom '03.

[2]  Wu-chi Feng,et al.  Panoptes: scalable low-power video sensor networking technologies , 2003, MULTIMEDIA '03.

[3]  A. Harter,et al.  A distributed location system for the active office , 1994, IEEE Network.

[4]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[5]  Edward Y. Chang,et al.  Anatomy of a multicamera video surveillance system , 2004, Multim. Syst..

[6]  Jay L. Devore,et al.  Probability and statistics for engineering and the sciences , 1982 .

[7]  J. Reich,et al.  Distributed attention in large scale video sensor networks , 2004 .

[8]  Tian He,et al.  Range-free localization schemes in large scale sensor network , 2003, MobiCom 2003.

[9]  Andy Hopper,et al.  A new location technique for the active office , 1997, IEEE Wirel. Commun..

[10]  Dharma P. Agrawal,et al.  GPS: Location-Tracking Technology , 2002, Computer.

[11]  Mani B. Srivastava,et al.  Dynamic fine-grained localization in Ad-Hoc networks of sensors , 2001, MobiCom '01.

[12]  Joseph S.-C. Yuan A general photogrammetric method for determining object position and orientation , 1989, IEEE Trans. Robotics Autom..

[13]  Joseph O'Rourke,et al.  Computational Geometry in C. , 1995 .

[14]  Thomas F. Coleman,et al.  On the convergence of interior-reflective Newton methods for nonlinear minimization subject to bounds , 1994, Math. Program..

[15]  David E. Culler,et al.  Calibration as parameter estimation in sensor networks , 2002, WSNA '02.

[16]  Deborah Estrin,et al.  Cyclops, image sensing and interpretation in wireless networks , 2004, SenSys '04.

[17]  Wu-chi Feng,et al.  Panoptes: A Scalable Architecture for Video Sensor Networking Applications , 2004 .

[18]  Fei-Yue Wang A simple and analytical procedure for calibrating extrinsic camera parameters , 2004, IEEE Trans. Robotics Autom..

[19]  Frank Zhao,et al.  Distributed Attention for Large Video Sensor Networks , 2004 .

[20]  T. Coleman,et al.  On the Convergence of Reflective Newton Methods for Large-scale Nonlinear Minimization Subject to Bounds , 1992 .

[21]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Hari Balakrishnan,et al.  6th ACM/IEEE International Conference on on Mobile Computing and Networking (ACM MOBICOM ’00) The Cricket Location-Support System , 2022 .

[23]  Anthony Rowe,et al.  A low cost embedded color vision system , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Prashant J. Shenoy,et al.  SensEye: a multi-tier camera sensor network , 2005, ACM Multimedia.

[25]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[26]  Thomas F. Coleman,et al.  An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds , 1993, SIAM J. Optim..

[27]  Wu-chi Feng,et al.  Dissecting the video sensing landscape , 2005, NOSSDAV '05.

[28]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[29]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[30]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[31]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..