Advanced rate control technologies for 3D-HDTV digital coding based on MPEG-2 multi-view profile

This paper describes advanced rate control technologies suitable for the digital compression coding based on MPEG-2 multi-view profile for transmitting three dimensional stereo HDTV signals at bit-rates 45 Mbps for PDH networks or 52 Mbps for SDH networks. First of all, a common buffer control is introduced, which achieves statistical multiplexing effect while keeping the picture qualify of both the left and right pictures well balanced. Under the assumption of applying this common buffer control, we investigate the optimal setting of GOP structure which has a close relation with the rate control. And then, a discriminatory bit allocation is proposed which improves the left picture quality without any degradation of the right picture. From the results of coding experiment conducted to evaluate the coding picture achieved by this coding scheme, it is confined that our coding scheme gives satisfactory picture quality even at 45 Mbps including audio and FEC data.

[1]  King Ngi Ngan,et al.  Sequency, frequency, code or time , 2000 .

[2]  K. N. Ngan,et al.  Performance of chromatic barycenter with MPEG elements for low-level shot boundary detection and its improvements , 1998 .

[3]  King Ngi Ngan,et al.  Automatic video sequence segmentation using object tracking , 1999 .

[4]  K. N. Ngan,et al.  Very low bit-rate video coding using object-based motion estimation and hierarchical shape estimation , 1998 .

[5]  King Ngi Ngan,et al.  Video object plane segmentation using a morphological motion filter and Hausdorff object tracking , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[6]  King Ngi Ngan,et al.  Video coding for ISDN applications using predictive classified vector quantization , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[7]  K. N. Ngan,et al.  Region-Based Segmentation and Motion Estimation in Object-Oriented Analysis-Synthesis Coding , 1996 .

[8]  K. N. Ngan,et al.  Very Low Bit-Rate Video Coding With Wavelet Transform and Quadtree-Based Vector Quantization , 1997 .

[9]  King Ngi Ngan,et al.  Unequal error protection of images over Rayleigh fading channels , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[10]  K. N. Ngan,et al.  A flexible three layer frequency/SNR-scalable video coder , 1994 .

[11]  K. N. Ngan,et al.  Foreground/Background Image Coding Technique , 1997 .

[12]  T. Sikora,et al.  Frequency Scalability Experiments for MPEG-2 Standard , 1993 .

[13]  Antonio Ortega,et al.  Dependent quantization for stereo image coding , 1998, Electronic Imaging.

[14]  King Ngi Ngan,et al.  Cosine Transform Coding Incorporating Human Visual System Model , 1986, Other Conferences.

[15]  King Ngi Ngan,et al.  A flexible Bayesian framework for image segmentation , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[16]  King Ngi Ngan,et al.  Special Issue on segmentation, description, and retrieval of video content , 1998 .

[17]  King Ngi Ngan,et al.  Foreground/background bit allocation for region-of-interest coding , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[18]  Ranjith Liyanapathirana,et al.  Error Resilient Combined Source-Channel Coder for Mobile Video , 1997 .

[19]  King Ngi Ngan,et al.  Enhancement of PCM and DPCM Images Corrupted by Transmission Errors , 1982, IEEE Trans. Commun..

[20]  King Ngi Ngan,et al.  Automatic face location detection and tracking for model-based video coding , 1996, Proceedings of Third International Conference on Signal Processing (ICSP'96).

[21]  R Steele,et al.  Adaptive Partial Correction Scheme for PCM Encoding Monochrome Pictures , 1979 .

[22]  W. J. Heng,et al.  Transition Type-Independent Boundary Refinement Technique for Post Shot Boundary Detection , 1999 .

[23]  W. J. Heng,et al.  The implementation of object-based shot boundary detection using edge tracing and tracking , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[24]  King Ngi Ngan,et al.  Concatenated sequency majority multiplexing DS-SSMA for synchronous digital communication in indoor wireless narrowband channels , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[25]  King Ngi Ngan.  Two-dimensional transform domain decimation techniques , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[26]  King Ngi Ngan,et al.  Hadamard transform classifier for predictive classified vector quantization , 1989 .

[27]  K. N. Ngan,et al.  Error probability for sequency majority multiplexing in frequencly nonselective, slowly fading channels - Part 2: Numerical analysis , 1998 .

[28]  K. N. Ngan,et al.  Interworking video services with layered coding , 1992, TENCON'92 - Technology Enabling Tomorrow.

[29]  W. L. Chooi,et al.  Motion classified three-dimensional subband VQ coder , 1993 .

[30]  King Ngi Ngan,et al.  An energy function for facial feature extraction , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[31]  King Ngi Ngan,et al.  Improved single VO rate control for constant bit-rate applications using MPEG-4 , 2000, Visual Communications and Image Processing.

[32]  King Ngi Ngan,et al.  A robust Markovian segmentation based on highest confidence first (HCF) , 1997, Proceedings of International Conference on Image Processing.

[33]  K. N. Ngan,et al.  Error probability for sequency majority multiplexing in frequency nonselective, slowly fading channels - Part 1: Mathematical formulation , 1998 .

[34]  S. H. Tan,et al.  Video coding with perceptually classified adaptive quantization , 1994 .

[35]  King Ngi Ngan,et al.  A region-based algorithm for enhancement of images degraded by blocking effects , 1996, Proceedings of Digital Processing Applications (TENCON '96).

[36]  King Ngi Ngan,et al.  Reduction of coding artifacts at low bit rates , 1998, Electronic Imaging.

[37]  K. N. Ngan,et al.  A mesh-based disparity map coding for steroscopic video sequence , 1998 .

[38]  King Ngi Ngan,et al.  Fuzzy quaternion approach to object recognition incorporating Zernike moment invariants , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[39]  King Ngi Ngan,et al.  Long-transition analysis for post shot-boundary detection , 2000, IS&T/SPIE Electronic Imaging.

[40]  K. N. Ngan,et al.  Codeword Sets for Sequency Majority Multiplexing Communication Systems , 1999 .

[41]  K. N. Ngan,et al.  Cell-loss concealment for video transmission over ATM networks , 1994 .

[42]  King Ngi Ngan,et al.  OPTIMIZED SHAPE ADAPTIVE WAVELETS WITH REDUCED COMPUTATIONAL COST , 1998 .

[43]  King Ngi Ngan,et al.  Layered video coder with self-concealed capability using frequency scanning technique , 1993, Other Conferences.

[44]  K. N. Ngan,et al.  Analysis and performance of object-based detection using edge object tracking , 2000 .

[45]  King Ngi Ngan,et al.  A simple fast adaptive array based on a null steering beamformer , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[46]  King Ngi Ngan,et al.  Extraction of VOP from Videophone Scene , 1997 .

[47]  King Ngi Ngan,et al.  Enhancement of image quality for low bit rate video coding , 1991 .

[48]  King Ngi Ngan,et al.  Extraction of moving objects for content-based video coding , 1998, Electronic Imaging.

[49]  King Ngi Ngan,et al.  Priority encoding of video data over ATM , 1998, 1998 1st IEEE International Conference on ATM. ICATM'98.

[50]  S. H. Tan,et al.  Adaptive quantization using perceptual classification , 1994 .

[51]  King Ngi Ngan,et al.  IC wire bond inspection using elliptical model approximation , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[52]  King Ngi Ngan,et al.  Automated Inspection Of IC Bonding Wires Using Hough Transforf4 , 1988, Proceedings.14 Annual Conference of Industrial Electronics Society.

[53]  King Ngi Ngan,et al.  Soft transition analysis technique for video sequences , 2000, 2000 TENCON Proceedings. Intelligent Systems and Technologies for the New Millennium (Cat. No.00CH37119).

[54]  K. N. Ngan,et al.  Layered codec with an effective error concealment technique , 1993 .

[55]  R. J. Clarke,et al.  Lowpass filtering in the cosine transform domain , 1980 .

[56]  King Ngi Ngan,et al.  Foreground/background video coding using H.261 , 1998, Electronic Imaging.

[57]  King Ngi Ngan,et al.  Layered coder using subband approach , 1992, Other Conferences.

[58]  K. N. Ngan,et al.  Content-based bit allocation and rate control for classical MC-DCT video coding systems , 1998 .

[59]  R. Frederickson.  Technical Reports , 2000, Nature Biotechnology.

[60]  King Ngi Ngan,et al.  Examination of features used for reference indicator construction in shot boundary refinement , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[61]  K. N. Ngan,et al.  Validity of scene cut detection using bit rate information of VBR video , 1998 .

[62]  King Ngi Ngan,et al.  Special Issue On Representation And Coding Of Images And Video II , 1999, IEEE Trans. Circuits Syst. Video Technol..

[63]  King Ngi Ngan,et al.  Special Issue On Representation And Coding Of Images And Video I [Guest Editorial] , 1998, IEEE Trans. Circuits Syst. Video Technol..

[64]  King Ngi Ngan,et al.  3D subband coder for very low bit rates , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[65]  Wa James Tam,et al.  Perceived image quality of MPEG-2 stereoscopic sequences , 1997, Electronic Imaging.

[66]  King Ngi Ngan,et al.  A performance study on MPEG-4 coder , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[67]  King Ngi Ngan,et al.  Enhanced shot boundary refinement for post-shot boundary detection , 2001, Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology. TENCON 2001 (Cat. No.01CH37239).

[68]  King Ngi Ngan,et al.  Error-protection scheme for the transmission of H.263 coded video over mobile radio channels , 1997, Electronic Imaging.

[69]  Shuichi Matsumoto,et al.  34/45-Mbps 3D HDTV digital coding scheme using modified motion compensation with disparity vectors , 1998, Electronic Imaging.

[70]  King Ngi Ngan,et al.  Locating facial region of a head-and-shoulders color image , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[71]  King Ngi Ngan,et al.  Motion analysis in 3D subband coder , 1993, Other Conferences.

[72]  King Ngi Ngan,et al.  Hybrid 3D subband-predictive VQ coder for VLBR applications , 1994, Proceedings of ICCS '94.

[73]  King Ngi Ngan,et al.  2-dimensional motion-analysis in object-oriented coding , 1996, Proceedings of Digital Processing Applications (TENCON '96).

[74]  King Ngi Ngan,et al.  Special issue: 3D video technology , 1998 .

[75]  K. N. Ngan,et al.  Automatic 3D WFM Model Fitting to Frontal Facial Image in Model-Based Video Coding , 1996 .

[76]  King Ngi Ngan,et al.  3D subband VLBR video coding scheme , 1994, Proceedings of ICCS '94.

[77]  King Ngi Ngan,et al.  A HVS-Weighted Cosine Transform Coding Scheme With Adaptive Quantization , 1988, Other Conferences.

[78]  King Ngi Ngan,et al.  Shot classification for hard transition , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[79]  K. N. Ngan,et al.  Priority protection of wavelet encoded video over ATM , 1998 .

[80]  King Ngi Ngan,et al.  Integrated shot boundary detection using object-based technique , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[81]  King Ngi Ngan,et al.  Rate-distortion analysis for vector quantization based on a variable block-size classification model , 1997, Electronic Imaging.

[82]  King Ngi Ngan,et al.  Special Issue on 3-D Video Technology , 2000 .

[83]  King Ngi Ngan,et al.  Automatic face location for videophone images , 1996, Proceedings of Digital Processing Applications (TENCON '96).

[84]  K. N. Ngan,et al.  Coding of Area of Interest with Better Quality , 1997 .

[85]  King Ngi Ngan,et al.  Error-Resilient Wavelet Video over ATM , 1998 .

[86]  King Ngi Ngan,et al.  Adaptive Quantization Based on Perceptual Criteria , 1993 .

[87]  King Ngan,et al.  Picture Transmission for Videotex , 1985, IEEE Transactions on Consumer Electronics.

[88]  King Ngi Ngan,et al.  A hybrid image coding scheme using CVQ and DCT , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.