Real-time media processing in embedded consumer electronic devices

In this paper we propose real-time methods for flexible processing of multimedia streaming in resource constrained systems. Video streams are dynamically adapted to match available system resources in small, embedded devices, such as as mobile phones and PDAs. Real-time admission control and resource reservation mechanisms ensure that media processing fully utilize the available system resources, while keeping the best possible video quality. First, we apply our methods on a single device, and then we extend it to handle distributed, heterogeneous systems where several devices share same resources. Results of simulation study show the effectiveness of our methods.

[1]  Damir Isovic,et al.  Flexible Scheduling for Media Processing in Resource Constrained Real-Time Systems , 2004 .

[2]  Jane W.-S. Liu,et al.  An end-to-end QoS management architecture , 1999, Proceedings of the Fifth IEEE Real-Time Technology and Applications Symposium.

[3]  Giorgio C. Buttazzo,et al.  Integrating multimedia applications in hard real-time systems , 1998, Proceedings 19th IEEE Real-Time Systems Symposium (Cat. No.98CB36279).

[4]  Reinder J. Bril,et al.  QoS Control Strategies for High-Quality Video Processing , 2004, Proceedings. 16th Euromicro Conference on Real-Time Systems, 2004. ECRTS 2004..

[5]  Michael Ditze,et al.  A Method for Real-Time Scheduling and Admission Control of MPEG-2 Streams , 2000 .

[6]  Andrew T. Campbell,et al.  A quality of service architecture , 1994, CCRV.

[7]  Gene Cheung,et al.  SP-frame selection for video streaming over burst-loss networks , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[8]  Klara Nahrstedt,et al.  Design, Implementation, and Experiences of the OMEGA End-Point Architecture , 1996, IEEE J. Sel. Areas Commun..

[9]  John Watkinson,et al.  MPEG Handbook , 2012 .

[10]  Mahadev Satyanarayanan,et al.  Agile application-aware adaptation for mobility , 1997, SOSP.

[11]  Tomas Lennvall.  Adapting to Varying Demands in Resource Constrained Real-Time Devices , 2005 .

[12]  Wen Gao,et al.  The improved SP frame coding technique for the JVT standard , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[13]  Ketan Mayer-Patel,et al.  Performance of a software MPEG video decoder , 1993, MULTIMEDIA '93.

[14]  Marta Karczewicz,et al.  The SP- and SI-frames design for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[15]  Bernd Girod,et al.  Video streaming with SP and SI frames , 2005, Visual Communications and Image Processing.

[16]  Klara Nahrstedt,et al.  A control-based middleware framework for quality-of-service adaptations , 1999, IEEE J. Sel. Areas Commun..

[17]  Gerhard Fohler,et al.  The MATRIX: A QoS Framework for Streaming in Heterogeneous Systems , 2001 .

[18]  Joseph Kee-Yin Ng,et al.  Quality of service for MPEG video in human perspective , 2007 .