Fast and robust object-extraction framework for object-based streaming system

Video streaming poses significant technical challenges in the quality of service guarantee and efficient resource management. In this paper, we propose an efficient moving object-extraction algorithm suitable for real-time content-based multimedia streaming systems. A motion vector based object extraction is used to dynamically detect the objects. To utilise the bandwidth efficiently, the video objects can be detected in real time, encoded, and transmitted with higher quality and a higher frame rate than those in the background. To meet the real-time requirement, no computationally intensive operation is included in this framework. Moreover, to guarantee the highest speed, the entire implementation is operating in the compressed domain without any need for decompression.

[1]  Maurizio Pilu.  Using raw MPEG motion vectors to determine global camera motion , 1998, Electronic Imaging.

[2]  Jae Chung,et al.  BETTER-BEHAVED, BETTER-PERFORMING MULTIMEDIA NETWORKING , 2000 .

[3]  Mark Claypool,et al.  The effects of jitter on the peceptual quality of video , 1999, MULTIMEDIA '99.

[4]  M. Ibrahim Sezan,et al.  A semantic event-detection approach and its application to detecting hunts in wildlife vide , 2000, IEEE Trans. Circuits Syst. Video Technol..

[5]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[6]  Calton Pu,et al.  Player for adaptive MPEG video streaming over the Internet , 1998, Other Conferences.

[7]  Joan L. Mitchell,et al.  MPEG Video Compression Standard , 1996, Springer US.

[8]  Carla Schlatter Ellis,et al.  JPEG Compression Metric as a Quality-Aware Image Transcoding , 1999, USENIX Symposium on Internet Technologies and Systems.

[9]  Ya-Qin Zhang,et al.  A confidence measure based moving object extraction system built for compressed domain , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[10]  Suh-Yin Lee,et al.  Object-based video streaming technique with application to intelligent transportation systems , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[11]  Mark Handley,et al.  Equation-based congestion control for unicast applications , 2000, SIGCOMM.

[12]  JongWon Kim,et al.  Content-Based Packet Video Forwarding Mechanism in Differentiated Service Networks , 2000 .

[13]  Helmut Hlavacs,et al.  Subjective Quality of Mobile MPEG-4 Videos with Different Frame Rates , 2006, J. Mobile Multimedia.

[14]  Simon So.  Efficient Image Indexing and Retrieval over Mobile Devices , 2005, J. Mobile Multimedia.

[15]  Kai-Kuang Ma,et al.  Bidirectional motion tracking for video indexing , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[16]  David Hutchison,et al.  Filters: QoS Support Mechanisms for Multipeer Communications , 1996, IEEE J. Sel. Areas Commun..

[17]  Anil K. Jain,et al.  Automatic caption localization in compressed video , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[18]  Deborah Estrin,et al.  RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[19]  Youn-Sik Hong,et al.  An Improvement of Multimedia Data Downstream with PDA in an Infrastructure Network , 2006, J. Mobile Multimedia.

[20]  Antonio Ortega,et al.  Rate control for video coding over variable bit rate channels with applications to wireless transmission , 1995, Proceedings., International Conference on Image Processing.

[21]  Rangasami L. Kashyap,et al.  Video scene change detection method using unsupervised segmentation and object tracking , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[22]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[23]  Steven McCanne,et al.  Receiver-driven layered multicast , 2001 .

[24]  Antonio Ortega,et al.  Soft caching: web cache management techniques for images , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[25]  Suh-Yin Lee,et al.  Robust object detection using cascade filter in MPEG videos , 2003, Fifth International Symposium on Multimedia Software Engineering, 2003. Proceedings..

[26]  Robert Tappan Morris,et al.  Dynamics of random early detection , 1997, SIGCOMM '97.

[27]  R. Venkatesh Babu,et al.  Compressed domain motion segmentation for video object extraction , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[28]  Javed I. Khan,et al.  Motion based object tracking in MPEG-2 stream for perceptual region discriminating rate transcoding , 2001, MULTIMEDIA '01.

[29]  Hiroshi Murase,et al.  Video shot analysis using efficient multiple object tracking , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[30]  Alexandros Eleftheriadis,et al.  Streaming Video Using Dynamic Rate Shaping and TCP Congestion Control , 1998, J. Vis. Commun. Image Represent..

[31]  Naoki Wakamiya,et al.  Implementation of Video Transfer with TCP-friendly Rate Control Protocol , 2000 .

[32]  Yasuhiro Takishima,et al.  Video Data Transmission Protocol "SVFTP" Using Multiple TCP Connections and Its Application , 2005, IEICE Trans. Inf. Syst..

[33]  M. Hemy.  MPEG System Streams in Best-Effort Networks , 1999 .

[34]  Hua-Tsung Chen,et al.  Motion Activity Based Semantic Video Similarity Retrieval , 2002, IEEE Pacific Rim Conference on Multimedia.

[35]  Sy Lee,et al.  Defeating the blocking effect in the filter steered robust compressed domain object detection in MPEG videos , 2004 .

[36]  Youn-Sik Hong,et al.  Improving performance of multimedia data downstream with PDA in an infrastructure network , 2006 .

[37]  Lorenzo Favalli,et al.  Object tracking for retrieval applications in MPEG-2 , 2000, IEEE Trans. Circuits Syst. Video Technol..

[38]  Steven McCanne,et al.  Low-Complexity Video Coding for Receiver-Driven Layered Multicast , 1997, IEEE J. Sel. Areas Commun..

[39]  David S. Doermann,et al.  Building mosaics from video using MPEG motion vectors , 1999, MULTIMEDIA '99.

[40]  Andrew T. Campbell,et al.  Utility-based Network Adaptation for MPEG-4 Systems , 1999 .

[41]  Mark Claypool,et al.  Improving Multimedia Streaming with Content-Aware Video Scaling , 2002, JCIS.

[42]  Christos Faloutsos,et al.  Efficient and effective Querying by Image Content , 1994, Journal of Intelligent Information Systems.

[43]  Paul W. Fieguth,et al.  Color-based tracking of heads and other mobile objects at video frame rates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.