Spatiotemporal spectral coding of stereo image sequences

This paper presents a new compression scheme for interlaced stereoscopic sequences which differentiates between a region of fixation and a peripheral area, and thereby compacts the stereoscopic information into the spectral space of a monocular video channel. Spectral compression is achieved by avoiding transmitting high-frequency information over the entire images, but only within and around the region where the observer acuity is the highest. The proposed approach consists of decomposing the left and right fields of the stereoscopic pairs into low-pass and high-pass components. High-frequency components are then limited to a fixation region, thus allowing a reduction of their spectral extent. A composite video signal is then formed by positioning the different components into the available spectral space through filtering and modulation. The approach is compatible with the NTSC standard in the sense that the same color subcarrier and the same spectral region are used for the chrominance components. Strategies are proposed for the estimation of the fixation region, based upon a psychophysical study on visual strategies during depth discrimination tasks.

[1]  Gregory K. Tharp,et al.  Visual search in virtual environments , 1992, Electronic Imaging.

[2]  Wa James Tam,et al.  Static and dynamic spatial resolution in image coding: an investigation of eye movements , 1991, Electronic Imaging.

[3]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[4]  Michitaka Hirose,et al.  Human behavior in virtual environments , 1992, Electronic Imaging.

[5]  Manfred Ziegler.  Region based analysis and coding of stereoscopic video , 1997 .

[6]  Yasuhiro Hirano,et al.  Extended Definition TV Fully Compatible with Existing Standards , 1984, IEEE Trans. Commun..

[7]  William F. Schreiber,et al.  Improvements to NTSC by Multidimensional Filtering , 1988 .

[8]  P. Pirsch,et al.  Advances in picture coding , 1985, Proceedings of the IEEE.

[9]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[10]  Michael Anthony Isnardi,et al.  Exploring and Exploiting Subchannels in the NTSC Spectrum , 1988 .

[11]  Jean-Luc Dugelay,et al.  MOTION AND DISPARITY ANALYSIS OF A STEREOSCOPIC SEQUENCE APPLICATION TO 3DTV CODING , 1992 .

[12]  Larry F. Hodges,et al.  Geometric Considerations for Stereoscopic Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[13]  A. Schertz.  Source coding of stereoscopic television pictures , 1992 .

[14]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[15]  Danielle Pelé,et al.  A stereoscopic television system (3D-TV) and compatible transmission on a MAC channel (3D-MAC) , 1991, Signal Process. Image Commun..

[16]  Avishai Henik,et al.  Compression of stereo images using subsampling and transform coding , 1991 .

[17]  Gregory K. Tharp,et al.  Depth cue interaction in telepresence and simulated telemanipulation , 1992, Electronic Imaging.

[18]  Nikolaos Grammalidis,et al.  Object-based coding of stereo image sequences using joint 3-D motion/disparity compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[19]  Robert Goutte,et al.  Stereo image compression by the combined use of the DCT and binocular fusion and rivalry , 1991 .

[20]  Hiroyuki Morikawa,et al.  3D structure extraction coding of image sequences , 1991, J. Vis. Commun. Image Represent..

[21]  Avishai Henik,et al.  On stereo image coding , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[22]  Michael G. Strintzis,et al.  Object-based coding of stereo image sequences using three-dimensional models , 1997, IEEE Trans. Circuits Syst. Video Technol..

[23]  H. Morikawa,et al.  3-D structure extraction coding of image sequences , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[24]  L D Silverstein,et al.  Spatial Judgments with Monoscopic and Stereoscopic Presentation of Perspective Displays , 1992, Human factors.

[25]  Ezzatollah Salari,et al.  Coding of stereoscopic images , 1993, Electronic Imaging.

[26]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[27]  Hiroyuki Yamaguchi,et al.  Stereoscopic images disparity for predictive coding , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[28]  Michael Waldowski.  A new segmentation algorithm for videophone applications based on stereo image pairs , 1991, IEEE Trans. Commun..