Generating Dynamic Projection Images for Scene Representation and Understanding

This paper explores an interesting image projection produced by scanning dynamic scenes with a slit camera. Based on the concept of Anorthoscopic Perception, we investigate how a two-dimensionalDynamic Projection Imageof three-dimensional scenes is generated from consecutive 1-D snapshots taken through a slit, when the relative motion is homogeneous between the viewer and scenes. By moving the camera in the 3-D environment or rotating an object, we can obtain various dynamic projection images. These dynamic projection images contain major spatial and temporal information about 3-D scenes in a small amount of data. Consequently, the projection is suited for the memorization, registration, and indexing of image sequences. The generated images also directly show some of the motion properties in dynamic scenes. If a relative motion between the camera and a subject is planned properly, the dynamic projection image can even provide a texture image of the subject along with some expected photometry characteristics. Therefore, the dynamic projection can facilitate dynamic object recognition, 3-D structure acquisition, and image compression, all for a stable motion between the objects and camera. We outline various applications in vision, robotics, and multimedia and summarize the motion types and the camera setting for generating such dynamic projection images.

[1]  Takeo Kanade,et al.  Stereo by Two-Level Dynamic Programming , 1985, IJCAI.

[2]  Saburo Tsuji,et al.  Panoramic representation of scenes for route understanding , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[3]  Hiroshi Ishiguro,et al.  Omni-directional stereo for making global map , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Saburo Tsuji,et al.  From anorthoscope perception to dynamic vision , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[5]  David J. Heeger,et al.  Optical flow from spatialtemporal filters , 1987 .

[6]  Jiang Yu Zheng,et al.  Acquiring 3-D Models from Sequences of Contours , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Matthew J. Barth,et al.  Qualitative route scene description using autonomous landmark detection , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[8]  Minoru Asada,et al.  Color-based panoramic representation of outdoor environment for a mobile robot , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[9]  Olivier D. Faugeras,et al.  Building, Registrating, and Fusing Noisy Visual Maps , 1988, Int. J. Robotics Res..

[10]  Tadashi Nakanishi,et al.  Automatic vehicle image extraction based on spatio-temporal image analysis , 1995, Systems and Computers in Japan.

[11]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[12]  Shigang Li,et al.  A navigation system based upon panoramic representation , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[13]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  鄭 絳字.  Dynamic Projection Panoramic Representation and Route Recognition , 1990 .

[15]  Daniel Raviv.  A quantitative approach to camera fixation , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Shigeki Ikebata,et al.  A method of motion analysis using spatiotemporal image-directional temporal plane transform , 1995, Systems and Computers in Japan.

[17]  P. Anandan,et al.  Mosaic based representations of video sequences and their applications , 1995, Proceedings of IEEE International Conference on Computer Vision.

[18]  Saburo Tsuji,et al.  Finding landmarks autonomously along a route , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[19]  Shigang Li,et al.  Making Cognitive Map of Outdoor Environment , 1993, IJCAI.

[20]  Harpreet S. Sawhney,et al.  Model-based 2D&3D dominant motion estimation for mosaicing and video representation , 1995, Proceedings of IEEE International Conference on Computer Vision.