A real-time occupancy map from multiple video streams

We describe an algorithm to fuse intensity data from multiple video cameras to create a spatial-temporal occupancy map. The camera layout is assumed to resemble a security video network. The occupancy map is a two-dimensional raster image, uniformly distributed in the floor-plane. Each map pixel contains a binary value, signifying whether the designated floorspace is empty or occupied. Our algorithm requires only one difference and one look-up table operation to determine each pixel's effect upon the map. This brevity of operations allows the spatial occupancy map to be temporally computed at real-time video rates. We demonstrate our algorithm operating in several dynamic scenarios.

[1]  Jake K. Aggarwal,et al.  Position estimation Techniques for an Autonomous Mobile robot - a Review , 1993, Handbook of Pattern Recognition and Computer Vision.

[2]  Narendra Ahuja,et al.  Gross motion planning—a survey , 1992, CSUR.

[3]  J. P. Jones Real-time construction and rendering of three-dimensional occupancy maps , 1993, Defense, Security, and Sensing.

[4]  Hiroshi Noborio,et al.  Construction of the Octree Approximating a Three-Dimensional Object by Using Multiple Views , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[6]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[7]  Adam W. Hoover,et al.  Calibrating a camera network using a domino grid , 2001, Pattern Recognit..

[8]  Dmitry B. Goldgof,et al.  The Space Envelope: A Representation for 3D Scenes , 1998, Comput. Vis. Image Underst..

[9]  Hiroshi Ishiguro Distributed Vision System: A Perceptual Information Infrastructure for Robot Navigation , 1997, IJCAI.

[10]  Ramesh C. Jain,et al.  Reality modeling and visualization from multiple video sequences , 1996, IEEE Computer Graphics and Applications.

[11]  Narendra Ahuja,et al.  Octree Generation from Object Silhouettes in Perspective Views , 1990, Comput. Vis. Graph. Image Process..

[12]  Hugh F. Durrant-Whyte,et al.  A Fully Decentralized Multi-Sensor System For Tracking and Surveillance , 1993, Int. J. Robotics Res..

[13]  Claus B. Madsen,et al.  Navigation using range images on a mobile robot , 1992, Robotics Auton. Syst..

[14]  An Li,et al.  Octree encoding of objects from range images , 1994, Pattern Recognit..