Mobile Sensors for Security and Surveillance

A stereo mosaic representation has been developed for fusing imaging data captured by sensors (cameras) in motion. In addition to providing a wide field of view, the multiperspective mosaics with various oblique views represent occlusion regions that cannot be achieved by using stationary sensors. One or multiple stereo pairs can be formed from mosaics with different oblique viewing angles and thus can be used for 3D viewing and 3D reconstruction. This approach has been applied to a number of important security and surveillance applications, including airborne surveillance, ground vehicle navigation, under-vehicle inspection, and 3D gamma-ray cargo inspection.

[1]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[2]  Harry Shum,et al.  Stereo reconstruction from multiperspective panoramas , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[4]  Tsuhan Chen,et al.  Compression with mosaic prediction for image-based rendering applications , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[5]  Hao Tang,et al.  3D and Moving Target Extraction from Dynamic Pushbroom Stereo Mosaics , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[6]  Li Zhao,et al.  3D Measurements in Cargo Inspection with a Gamma-Ray Linear Pushbroom Stereo System , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[7]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[8]  Shmuel Peleg,et al.  Fast panoramic stereo matching using cylindrical maximum surfaces , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  C. A. HART,et al.  Manual of Photogrammetry , 1947, Nature.

[10]  Allen R. Hanson,et al.  Mosaic generation for under vehicle inspection , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[11]  Allen R. Hanson,et al.  Mosaic-based 3D scene representation and rendering , 2005, IEEE International Conference on Image Processing 2005.

[12]  Harry Shum,et al.  Parallel projections for stereo reconstruction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  Stan Z. Li,et al.  FloatBoost learning and statistical face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Harry Shum,et al.  Stereo reconstruction from multiperspective panoramas , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Allen R. Hanson,et al.  Generalized parallel-perspective stereo mosaics from airborne video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  P. Anandan,et al.  Efficient representations of video sequences and their applications , 1996, Signal Process. Image Commun..

[18]  Hao Tang,et al.  Content-Based Dynamic 3D Mosaics , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[19]  Allen R. Hanson,et al.  Generation and Error Characterization of Pararell-Perspective Stereo Mosaics from Real Video , 2003 .

[20]  Hao Tang,et al.  Dynamic 3D Urban Scene Modeling Using Multiple Pushbroom Mosaics , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[21]  Allen R. Hanson,et al.  Mosaic-based 3D scene representation and rendering , 2005, ICIP.

[22]  Zhigang Zhu,et al.  Stereo Matching and 3D Visualization for Gamma-Ray Cargo Inspection , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[23]  Allen R. Hanson,et al.  An efficient method for geo-referenced video mosaicing for environmental monitoring , 2005, Machine Vision and Applications.

[24]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.