Efficient support for application-specific video adaptation

As video applications become more diverse, video must be adapted in different ways to meet the requirements of different applications when there are insufficient resources. In this dissertation, we address two sorts of requirements that cannot be addressed by existing video adaptation technologies: (i) accommodating large variations in resolution and (ii) collecting video effectively in a multi-hop sensor network. In addition, we also address requirements for implementing video adaptation in a sensor network. Accommodating large variation in resolution is required by the existence of display devices with widely disparate screen sizes. Existing resolution adaptation technologies usually aim at adapting video between two resolutions. We examine the limitations of these technologies that prevent them from supporting a large number of resolutions efficiently. We propose several hybrid schemes and study their performance. Among these hybrid schemes, Bonneville, a framework that combines Multiple encodings with limited scalability, can make good trade-offs when organizing compressed video to support a wide range of resolutions. Video collection in a sensor network requires adapting video in a multi-hop store-and-forward network and with multiple video sources. This task cannot be supported effectively by existing adaptation technologies, which are designed for real-time streaming applications from a single source over IP-style end-to-end connections. We propose to adapt video in the network instead of at the network edge. We also propose a framework, Steens, to compose adaptation mechanisms on multiple nodes. We design two signaling protocols in Steens to coordinate multiple nodes. Our simulations show that in-network adaptation can use buffer space on intermediate nodes for adaptation and achieve better video quality than conventional network-edge adaptation. Our simulations also show that explicit collaboration among multiple nodes through signaling can improve video quality, waste less bandwidth, and maintain bandwidth-sharing fairness. The implementation of video adaptation in a sensor network requires system support for programmability, retaskability, and high performance. We propose Cascades, a component-based framework, to provide the required support. A prototype implementation of Steens in this framework shows that the performance overhead is less than 5% compared to a hard-coded C implementation.

[1]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[2]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[3]  Wu-chi Feng,et al.  Quality-adaptive media streaming by priority drop , 2003, NOSSDAV '03.

[4]  Mike Horton,et al.  The platforms enabling wireless sensor networks , 2004, CACM.

[5]  Min Wu,et al.  Video transcoding by reducing spatial resolution , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[6]  Prashant J. Shenoy,et al.  The case for multi--tier camera sensor networks , 2005, NOSSDAV '05.

[7]  David W. Lin,et al.  Optimal Bit Allocation for Coding of Video Signals over ATM Networks , 1997, IEEE J. Sel. Areas Commun..

[8]  Calton Pu,et al.  Moving Towards Massively Scalable Video-Based Sensor Networks , 2001 .

[9]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[10]  Ramesh Govindan,et al.  An Overview of Embedded Sensor Networks ISI TR-2004-594 ? , .

[11]  Chia-Wen Lin,et al.  A DCT-Domain Video Transcoder for Spatial Resolution Downconversion , 2002, VISUAL.

[12]  Nicolas D. Georganas,et al.  H.263 video transcoding for spatial resolution downscaling , 2002, Proceedings. International Conference on Information Technology: Coding and Computing.

[13]  Alan F. Lippman,et al.  Video coding for streaming media delivery on the Internet , 2001, IEEE Trans. Circuits Syst. Video Technol..

[14]  Gregory J. Pottie,et al.  Instrumenting the world with wireless sensor networks , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[15]  Tihao Chiang,et al.  A zerotree wavelet video coder , 1997, IEEE Trans. Circuits Syst. Video Technol..

[16]  Nirupama Bulusu,et al.  Wireless Sensor Networks A Systems Perspective , 2005 .

[17]  Waylon Brunette,et al.  Data MULEs: modeling a three-tier architecture for sparse sensor networks , 2003, Proceedings of the First IEEE International Workshop on Sensor Network Protocols and Applications, 2003..

[18]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[19]  Konstantinos Konstantinides,et al.  Image and Video Compression Standards: Algorithms and Architectures , 1997 .

[20]  Alexandros Eleftheriadis,et al.  Streaming Video Using Dynamic Rate Shaping and TCP Congestion Control , 1998, J. Vis. Commun. Image Represent..

[21]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[22]  Kang G. Shin,et al.  The BLUE active queue management algorithms , 2002, TNET.

[23]  Chien-Chung Shen,et al.  Sensor information networking architecture and applications , 2001, IEEE Wirel. Commun..

[24]  Wen Gao,et al.  Seamless switching of scalable video bitstreams for efficient streaming , 2004, IEEE Transactions on Multimedia.

[25]  Jie Huang,et al.  An experimental analysis of DCT-based approaches for fine-grained multiresolution video , 2006, Multimedia Systems.

[26]  Antonio Ortega,et al.  Expected Run-time Distortion Based Scheduling for Delivery of Sealable Media , 2002 .

[27]  awomir Ma,et al.  AVC VIDEO CODERS WITH SPATIAL AND TEMPORAL SCALABILITY , 2003 .

[28]  Steven McCanne,et al.  Low-Complexity Video Coding for Receiver-Driven Layered Multicast , 1997, IEEE J. Sel. Areas Commun..

[29]  Mohammed Ghanbari,et al.  A drift compensation architecture for DCT-pyramid video coding , 2002, International Symposium on VIPromCom Video/Image Processing and Multimedia Communications.

[30]  Frank Zhao,et al.  Distributed Attention for Large Video Sensor Networks , 2004 .

[31]  Narendra Ahuja,et al.  A fast scheme for image size change in the compressed domain , 2001, IEEE Trans. Circuits Syst. Video Technol..

[32]  Srinivasan Seshan,et al.  Enabling conferencing applications on the internet using an overlay muilticast architecture , 2001, SIGCOMM '01.

[33]  Sohail Zafar,et al.  Motion-compensated wavelet transform coding for color video compression , 1992, IEEE Trans. Circuits Syst. Video Technol..

[34]  Deborah Estrin,et al.  Geography-informed energy conservation for Ad Hoc routing , 2001, MobiCom '01.

[35]  Srinivasan Seshan,et al.  Enabling conferencing applications on the internet using an overlay muilticast architecture , 2001, SIGCOMM 2001.

[36]  Wu-chi Feng,et al.  SenseTK: a multimodal, multimedia sensor networking toolkit , 2007, Electronic Imaging.

[37]  Sang H. Kang,et al.  Packet Scheduling Algorithm for Wireless Video Streaming , 2002 .

[38]  Chieh-Yih Wan,et al.  CODA: congestion detection and avoidance in sensor networks , 2003, SenSys '03.

[39]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[40]  J. Lubin A human vision system model for objective picture quality measurements , 1997 .

[41]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[42]  Nick Feamster,et al.  On the Interactions Between Layered Quality Adaptation and Congestion Control for Streaming Video , 2002 .

[43]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[44]  Ming-Ting Sun,et al.  An all-ASIC implementation of a low bit-rate video codec , 1992, IEEE Trans. Circuits Syst. Video Technol..

[45]  Antonio Ortega Optimal bit allocation under multiple rate constraints , 1996, Proceedings of Data Compression Conference - DCC '96.

[46]  Robert Szewczyk,et al.  System architecture directions for networked sensors , 2000, ASPLOS IX.

[47]  Chieh-Yih Wan,et al.  PSFQ: a reliable transport protocol for wireless sensor networks , 2002, WSNA '02.

[48]  Mohammed Ghanbari,et al.  Layered image coding using the DCT pyramid , 1995, IEEE Trans. Image Process..

[49]  Wu-chi Feng,et al.  Priority-based technique for the best-effort delivery of stored video , 1998, Electronic Imaging.

[50]  Don Kimber,et al.  FlyCam: practical panoramic video , 2000, ACM Multimedia.

[51]  David E. Culler,et al.  Taming the underlying challenges of reliable multihop routing in sensor networks , 2003, SenSys '03.

[52]  Yong Yao,et al.  The cougar approach to in-network query processing in sensor networks , 2002, SGMD.

[53]  Narendra Ahuja,et al.  A scheme for spatial scalability using nonscalable encoders , 2003, IEEE Trans. Circuits Syst. Video Technol..

[54]  Gregory J. Pottie,et al.  Wireless integrated network sensors , 2000, Commun. ACM.

[55]  Deborah Estrin,et al.  An energy-efficient MAC protocol for wireless sensor networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[56]  Marshall L. Fisher,et al.  The Lagrangian Relaxation Method for Solving Integer Programming Problems , 2004, Manag. Sci..

[57]  Antonio Ortega,et al.  PALS: peer-to-peer adaptive layered streaming , 2003, NOSSDAV '03.

[58]  Miska Hannuksela,et al.  Error-Robust Inter/Intra Mode Selection Using Isolated Regions , 2003 .

[59]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[60]  Robert Tappan Morris,et al.  Span: An Energy-Efficient Coordination Algorithm for Topology Maintenance in Ad Hoc Wireless Networks , 2001, MobiCom '01.

[61]  Feng Wu,et al.  Optimal rate allocation for progressive fine granularity scalable video coding , 2002 .

[62]  Chen-Hsiu Huang Video Transcoding Architectures and Techniques : An Overview , 2003 .

[63]  Wu-chi Feng,et al.  Panoptes: A Scalable Architecture for Video Sensor Networking Applications , 2004 .

[64]  Özgür B. Akan,et al.  ESRT: event-to-sink reliable transport in wireless sensor networks , 2003, MobiHoc '03.

[65]  Deborah Estrin,et al.  Directed diffusion: a scalable and robust communication paradigm for sensor networks , 2000, MobiCom '00.

[66]  Stefan Winkler,et al.  Video Quality Experts Group: current results and future directions , 2000, Visual Communications and Image Processing.

[67]  Wu-chi Feng,et al.  Cascades: scalable, flexible and composable middleware for multi-modal sensor networking applications , 2006, Electronic Imaging.

[68]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[69]  John Stanley,et al.  Applying Video Sensor Networks to Nearshore Environment Monitoring , 2003, IEEE Pervasive Comput..

[70]  Wei Hong,et al.  The design of an acquisitional query processor for sensor networks , 2003, SIGMOD '03.

[71]  An experimental analysis of DCT-based approaches for fine-grain multiresolution video , 2005, IS&T/SPIE Electronic Imaging.

[72]  Deborah Estrin,et al.  RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[73]  Feng Wu,et al.  A framework for efficient progressive fine granularity scalable video coding , 2001, IEEE Trans. Circuits Syst. Video Technol..

[74]  Lawrence A. Rowe,et al.  Design and performance of the Berkeley Continuous Media Toolkit , 1997, Electronic Imaging.

[75]  Wen Gao,et al.  The improved SP frame coding technique for the JVT standard , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[76]  K. K. Ramakrishnan,et al.  A Proposal to add Explicit Congestion Notification (ECN) to IP , 1999, RFC.

[77]  Deborah Estrin,et al.  Recommendations on Queue Management and Congestion Avoidance in the Internet , 1998, RFC.

[78]  Deborah Estrin,et al.  Highly-resilient, energy-efficient multipath routing in wireless sensor networks , 2001, MOCO.