A Survey of Distributed Computer Vision Algorithms

Over the past twenty years, the computer vision community has made great strides in the automatic solution to such problems as camera localization and visual tracking. Many algorithms have been made tractable by the rapid increases in computational speed and memory size now available to a single computer. However, the world of visual sensor networks poses several challenges to the direct application of traditional computer vision algorithms. First, visual sensor networks are assumed to contain tens to hundreds of cameras- many more than are considered in many vision applications. Second, these cameras are likely to be spread over a wide geographical area- much larger than the typical computer lab. Third, the cameras are likely to have modest local processors with no ability to communicate beyond a short range.

[1]  A.S. Willsky,et al.  Nonparametric belief propagation for self-calibration in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[2]  Carlos Guestrin,et al.  A robust architecture for distributed inference in sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[3]  Richard J. Radke,et al.  Calibrating Distributed Camera Networks Using Belief Propagation , 2007, EURASIP J. Adv. Signal Process..

[4]  Bernhard Rinner,et al.  An Introduction to Distributed Smart Cameras , 2008, Proceedings of the IEEE.

[5]  Bernhard Rinner,et al.  Visual on-line learning in distributed camera networks , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[6]  Richard J. Radke,et al.  Distributed Metric Calibration of Large Camera Networks , 2004 .

[7]  S. Shankar Sastry,et al.  Automatic Camera Network Localization using Object Image Tracks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Dimitrios Lymberopoulos,et al.  Sensor Localization and Camera Calibration in Distributed Camera Sensor Networks , 2006, 2006 3rd International Conference on Broadband Communications, Networks and Systems.

[9]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[10]  Frank Dellaert,et al.  A Multifrontal QR Factorization Approach to Distributed Inference Applied to Multirobot Localization and Mapping , 2005, AAAI.

[11]  Pramod K. Varshney,et al.  Distributed Detection and Data Fusion , 1996 .

[12]  Gregory Dudek,et al.  Occam's Razor Applied to Network Topology Inference , 2008, IEEE Transactions on Robotics.

[13]  Ben J. A. Kröse,et al.  Distributed EM Learning for Appearance Based Multi-Camera Tracking , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[14]  Philipp Slusallek,et al.  Wide area camera calibration using virtual calibration objects , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Carlos Guestrin,et al.  Robust Probabilistic Inference in Distributed Systems , 2004, UAI.

[16]  J. Thorpe,et al.  Data Fusion Algorithms for Collaborative Robotic Exploration , 2002 .

[17]  Hyeokho Choi,et al.  Distributed camera network localization , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[18]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[19]  Srdjan Capkun,et al.  Secure positioning of wireless devices with application to sensor networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[20]  Peng Ning,et al.  LAD: localization anomaly detection for wireless sensor networks , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[21]  Bernhard Rinner,et al.  A Bright Future for Distributed Smart Cameras , 2008 .

[22]  Bernhard Rinner,et al.  Autonomous Multicamera Tracking on Embedded Smart Cameras , 2007, EURASIP J. Embed. Syst..

[23]  Hamid K. Aghajan,et al.  Introduction to the Issue on Distributed Processing in Vision Networks , 2008, IEEE J. Sel. Top. Signal Process..

[24]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[25]  Bing Wang,et al.  The Localized Consistency Principle for Image Matching under Non-uniform Illumination Variation and Affine Distortion , 2002, ECCV.

[26]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Jörg Hähner,et al.  ROCAS: A Robust Online Algorithm for Spatial Partitioning in Distributed Smart Camera Systems , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[28]  Dan Schonfeld,et al.  Distributed Bayesian Multiple-Target Tracking in Crowded Environments Using Multiple Collaborative Cameras , 2007, EURASIP J. Adv. Signal Process..

[29]  Henry Medeiros,et al.  Online distributed calibration of a large network of wireless cameras using dynamic clustering , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[30]  Hugh F. Durrant-Whyte,et al.  Simultaneous map building and localization for an autonomous mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[31]  Steve McLaughlin,et al.  Comparative study of textural analysis techniques to characterise tissue from intravascular ultrasound , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[32]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[33]  Nancy A. Lynch,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[34]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[35]  Larry S. Davis,et al.  Learning Higher-order Transition Models in Medium-scale Camera Networks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[36]  Prashant J. Shenoy,et al.  Snapshot: A Self-Calibration Protocol for Camera Sensor Networks , 2006, 2006 3rd International Conference on Broadband Communications, Networks and Systems.

[37]  Horst Bischof,et al.  OBJECTREACQUISITIONAND TRACKINGIN LARGE-SCALESMART CAMERA NETWORKS , 2007 .

[38]  Gregory Dudek,et al.  Topology inference for a vision-based sensor network , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[39]  Robert D. Nowak,et al.  Distributed EM algorithms for density estimation and clustering in sensor networks , 2003, IEEE Trans. Signal Process..

[40]  Richard I. Hartley.  Self-Calibration from Multiple Views with a Rotating Camera , 1994, ECCV.

[41]  Peter Desnoyers,et al.  Exact distributed Voronoi cell computation in sensor networks , 2007, IPSN.

[42]  Nikos A. Vlassis,et al.  Newscast EM , 2004, NIPS.

[43]  James C. Springett,et al.  Space Very Long Baseline Interferometry Ground-Station Segmented Architecture , 2002 .

[44]  Anton van den Hengel,et al.  Finding Camera Overlap in Large Surveillance Networks , 2007, ACCV.

[45]  Jing Deng,et al.  Wireless ad hoc networks , 2003 .

[46]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[47]  Gideon P. Stein.  Accurate internal camera calibration using rotation, with analysis of sources of error , 1995, Proceedings of IEEE International Conference on Computer Vision.

[48]  Yiannis Aloimonos,et al.  Calibration of a Multicamera Network , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[49]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, CVPR 2004.

[50]  Leonidas J. Guibas,et al.  Facenet: Tracking People and Acquiring Canonical Face Images in a Wireless Camera Sensor Network , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[51]  Hugh F. Durrant-Whyte,et al.  A decentralized Bayesian algorithm for identification of tracked targets , 1993, IEEE Trans. Syst. Man Cybern..

[52]  Hamid Aghajan,et al.  Collaborative Face Orientation Detection in Wireless Image Sensor Networks , 2006 .

[53]  Gregory Dudek,et al.  Automated calibration of a camera sensor network , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[54]  Yoram Moses,et al.  Centralized and Distributed Multi-view Correspondence , 2005, International Journal of Computer Vision.

[55]  Biplab Sikdar,et al.  Scalable and distributed GPS free positioning for sensor networks , 2003, IEEE International Conference on Communications, 2003. ICC '03..

[56]  No Author Given.  Approximate Initialization of Camera Sensor Networks , 2006 .

[57]  Hans-Gerd Maas.  Image sequence based automatic multi-camera system calibration techniques 1 Revised version of a pap , 1999 .

[58]  Kiyoharu Aizawa,et al.  Multi-Sensor Fusion Tracking Using Visual Information and WI-Fl Location Estimation , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[59]  Leonidas J. Guibas,et al.  Multi-person tracking from sparse 3D trajectories in a camera sensor network , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[60]  Avi Pfeffer,et al.  Loopy Belief Propagation as a Basis for Communication in Sensor Networks , 2002, UAI.

[61]  A. M. Tekalp,et al.  Multiple camera tracking of interacting and occluded human motion , 2001, Proc. IEEE.

[62]  Deepa Kundur,et al.  Visual Sensor Networks , 2007, EURASIP J. Adv. Signal Process..

[63]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[64]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[65]  Avinash C. Kak,et al.  A novel evidence accumulation framework for robust multi-camera person detection , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[66]  Huang Lee,et al.  Collaborative node localization in surveillance networks using opportunistic target observations , 2006, VSSN '06.

[67]  Rahul Sukthankar,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[68]  Seth J. Teller,et al.  Spectral Solution of Large-Scale Extrinsic Camera Calibration as a Graph Embedding Problem , 2004, ECCV.

[69]  Henry Medeiros,et al.  A Light-Weight Event-Driven Protocol for Sensor Clustering in Wireless Camera Networks , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[70]  Larry S. Davis,et al.  Decentralized discovery of camera network topology , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[71]  D. E. Holmgren.  An invitation to 3-d vision: from images to geometric models , 2004 .

[72]  Stephen P. Boyd,et al.  Gossip algorithms: design, analysis and applications , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[73]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[74]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[75]  Robert T. Collins,et al.  Calibration of an outdoor active camera system , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[76]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[77]  Yong Guan,et al.  Location Verification Algorithms forWireless Sensor Networks , 2007, 27th International Conference on Distributed Computing Systems (ICDCS '07).

[78]  M. Alanyali,et al.  Distributed Detection in Sensor Networks With Packet Losses and Finite Capacity Links , 2006, IEEE Transactions on Signal Processing.

[79]  Camillo J. Taylor,et al.  Self-localizing smart camera networks , 2012, TOSN.

[80]  Haeyong Chung,et al.  Distributed metric calibration of ad hoc camera networks , 2006, TOSN.

[81]  Alhussein A. Abouzeid,et al.  Coverage by directional sensors in randomly deployed wireless sensor networks , 2006, J. Comb. Optim..

[82]  Bernhard Rinner,et al.  Distributed embedded smart cameras for surveillance applications , 2006, Computer.

[83]  Bernhard Rinner,et al.  The evolution from single to pervasive smart cameras , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[84]  Koen Langendoen,et al.  Distributed localization in wireless sensor networks: a quantitative compariso , 2003, Comput. Networks.

[85]  A. Kak,et al.  A Look-up Table Based Approach for Solving the Camera Selection Problem in Large Camera Networks , 2006 .

[86]  S. Shankar Sastry,et al.  Fusion-based localization for a Heterogeneous camera network , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[87]  Y. Aloimonos,et al.  Complete calibration of a multi-camera network , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[88]  Kay Römer,et al.  Facet: towards a smart camera network of mobile phones , 2007, AUTONOMICS 2007.

[89]  Gregory Dudek,et al.  Probabilistic Self-Localization for Sensor Networks , 2006, AAAI.

[90]  Demetri Terzopoulos,et al.  Smart Camera Networks in Virtual Reality , 2008, Proc. IEEE.

[91]  Daniel Keren,et al.  Multi-Camera Topology Recovery from Coherent Motion , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[92]  C. Jaynes.  Multi-view calibration from planar motion for video surveillance , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[93]  David A. Wagner,et al.  Secure verification of location claims , 2003, WiSe '03.

[94]  Zhaolin Cheng,et al.  Determining Vision Graphs for Distributed Camera Networks Using Feature Digests , 2007, EURASIP J. Adv. Signal Process..

[95]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[96]  DevarajanDhanya,et al.  Calibrating distributed camera networks using belief propagation , 2007 .

[97]  Amit K. Roy-Chowdhury,et al.  Determining Topology in a Distributed Camera Network , 2007, 2007 IEEE International Conference on Image Processing.

[98]  Gregory Dudek,et al.  Simultaneous planning, localization, and mapping in a camera sensor network , 2006, Robotics Auton. Syst..

[99]  W. Eric L. Grimson,et al.  Recovering Non-overlapping Network Topology Using Far-field Vehicle Tracking Data , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[100]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.