Towards User Experience-Driven Adaptive Uplink Video Transmission for Automotive Applications

The focus of this thesis is to enable user experience-driven uplink video streaming from mobile video sources with limited computational capacity and to apply these to resource-constraint automotive environments. The first part investigates perceptual quality-aware encoding of videos, the second part proposes camera context-based estimators of temporal and spatial activities for videos captured by a front-facing camera of a vehicle, and the last part studies the upstreaming of videos from a mobile video source using adaptive HTTP streaming.

[1]  Joachim Wietzke,et al.  Automotive Embedded Systeme: Effizfientes Framework - Vom Design zur Implementierung (Xpert.press) , 2007 .

[2]  Nicole Propst.  Video Coding An Introduction To Standard Codecs , 2016 .

[3]  Falko Dressler,et al.  Vehicular Networking , 2014 .

[4]  Ali C. Begen,et al.  Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale , 2013, IEEE Journal on Selected Areas in Communications.

[5]  Erik Dahlman,et al.  4G: LTE/LTE-Advanced for Mobile Broadband , 2011 .

[6]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Xiapu Luo,et al.  QDASH: a QoE-aware DASH system , 2012, MMSys '12.

[8]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. I. Fundamental theory , 1997, IEEE Trans. Circuits Syst. Video Technol..

[9]  Christian Wietfeld,et al.  Potential of cooperative information for vertical handover decision algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[10]  Cesson Sévigné.  NEW QUALITY EVALUATION METHOD SUITED TO MULTIMEDIA CONTEXT SAMVIQ , 2006 .

[11]  P. Groves.  Principles of GNSS, Inertial, and Multisensor Integrated Navigation Systems, Second Edition , 2013 .

[12]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[13]  Antti Toskala,et al.  LTE for UMTS: Evolution to LTE-Advanced , 2011 .

[14]  Alberto Blanc,et al.  Optimal set of video representations in adaptive streaming , 2014, MMSys '14.

[15]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[16]  Antti Toskala,et al.  LTE for UMTS - OFDMA and SC-FDMA Based Radio Access , 2009 .

[17]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[18]  Stefan Winkler,et al.  Perceptual Video Quality Metrics — A Review , 2005 .

[19]  Chia-Wen Lin,et al.  A Control-Theoretic Approach to Rate Adaption for DASH Over Multiple Content Distribution Servers , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Pål Halvorsen,et al.  Improved Multi-Rate Video Encoding , 2011, 2011 IEEE International Symposium on Multimedia.

[21]  Yao Wang,et al.  Modeling rate and perceptual quality of scalable video as functions of quantization and frame rate and its application in scalable video adaptation , 2009, 2009 17th International Packet Video Workshop.

[22]  Wolfgang Kellerer,et al.  MOS-Based Multiuser Multiapplication Cross-Layer Optimization for Mobile Multimedia Communication , 2007, Adv. Multim..

[23]  Luca De Cicco,et al.  Feedback control for adaptive live video streaming , 2011, MMSys.

[24]  Ulrich Kramer.  Kraftfahrzeugführung: Modelle – Simulation – Regelung , 2008 .

[25]  L. Ekiz,et al.  MIMO performance evaluation of automotive qualified LTE antennas , 2013, 2013 7th European Conference on Antennas and Propagation (EuCAP).

[26]  Antti Toskala,et al.  Wcdma for Umts , 2002 .

[27]  Shan Liu,et al.  Joint temporal-spatial bit allocation for video coding with dependency , 2005 .

[28]  Ming-Ting Sun,et al.  Compressed Video Over Networks , 2000 .

[29]  Johan Bergman,et al.  Multi-Carrier HSPA Evolution , 2009, VTC Spring 2009 - IEEE 69th Vehicular Technology Conference.

[30]  Thomas Schaller.  Stauassistenz - Längs- und Querführung im Bereich niedriger Geschwindigkeit , 2009 .

[31]  Miska M. Hannuksela,et al.  Rate adaptation for dynamic adaptive streaming over HTTP in content distribution network , 2012, Signal Process. Image Commun..

[32]  Zhan Ma.  Modeling of Power, Rate and Perceptual Quality of Scalable Video and Its Applications , 2011 .

[33]  Henning Schulzrinne,et al.  Real Time Streaming Protocol (RTSP) , 1998, RFC.

[34]  Eckehard Steinbach,et al.  A flexible in-vehicle HMI architecture based on web technologies , 2010, MIAA '10.

[35]  Tihao Chiang,et al.  Scalable rate control for MPEG-4 video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[36]  Michael Yuen,et al.  A survey of hybrid MC/DPCM/DCT video coding distortions , 1998, Signal Process..

[37]  Margaret H. Pinson,et al.  Comparing subjective video quality testing methodologies , 2003, Visual Communications and Image Processing.

[38]  Scott Daly,et al.  Digital Images and Human Vision , 1993 .

[39]  Nick McKeown,et al.  Downton abbey without the hiccups: buffer-based rate adaptation for HTTP video streaming , 2013, FhMN@SIGCOMM.

[40]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[42]  W. J. Fleming,et al.  Overview of automotive sensors , 2001 .

[43]  Ralph Helmar Rasshofer,et al.  Automotive Radar and Lidar Systems for Next Generation Driver Assistance Functions , 2005 .

[44]  Xin Li,et al.  Digital Video Processing and Communications , 2011 .

[45]  Liang-Gee Chen,et al.  Survey on Block Matching Motion Estimation Algorithms and Architectures with New Results , 2006, J. VLSI Signal Process..

[46]  Frank H. P. Fitzek,et al.  Video Traces for Network Performance Evaluation: A Comprehensive Overview and Guide on Video Traces and Their Utilization in Networking Research , 2006 .

[47]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[48]  Sanjit K. Mitra,et al.  A novel linear source model and a unified rate control algorithm for H.263/MPEG-2/MPEG-4 , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[49]  Thomas Stockhammer,et al.  Dynamic adaptive streaming over HTTP --: standards and design principles , 2011, MMSys.

[50]  Rosario El-Feghali,et al.  Video Quality Metric for Bit Rate Control via Joint Adjustment of Quantization and Frame Rate , 2007, IEEE Transactions on Broadcasting.

[51]  Eckehard G. Steinbach,et al.  A novel full-reference video quality metric and its application to wireless video transmission , 2011, 2011 18th IEEE International Conference on Image Processing.

[52]  Arpad L. Scholtz,et al.  Automotive multi-standard RF front-end for GSM, WCDMA and Mobile WiMAX , 2009, 2009 Wireless Telecommunications Symposium.

[53]  Torsten Bertram,et al.  Track-to-Track Fusion With Asynchronous Sensors Using Information Matrix Fusion for Surround Environment Perception , 2012, IEEE Transactions on Intelligent Transportation Systems.

[54]  Michael Elad,et al.  Down-Scaling for Better Transform Compression , 2001, Scale-Space.

[55]  Pamela C. Cosman,et al.  Modeling packet-loss visibility in MPEG-2 video , 2006, IEEE Transactions on Multimedia.

[56]  Jeffrey Scott Vitter,et al.  Analysis of arithmetic coding for data compression , 1991, [1991] Proceedings. Data Compression Conference.

[57]  Dirk Staehle,et al.  Low-Complexity No-Reference PSNR Estimation for H.264/AVC Encoded Video , 2013, 2013 20th International Packet Video Workshop.

[58]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Mark Claypool,et al.  Guidelines for Selecting Practical MPEG Group of Pictures , 2006, EuroIMSA.

[60]  Zhan Ma,et al.  Modeling of Rate and Perceptual Quality of Compressed Video as Functions of Frame Rate and Quantization Stepsize and Its Applications , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[61]  Ragnhild Eg,et al.  Adaptive Media Streaming to Mobile Devices: Challenges, Enhancements, and Recommendations , 2014, Adv. Multim..

[62]  Martin Schneider,et al.  Automotive Radar – Status and Trends , 2005 .

[63]  Eckehard G. Steinbach,et al.  Network-aware video level encoding for uplink adaptive HTTP streaming , 2015, 2015 IEEE International Conference on Communications (ICC).

[64]  Yang Peng.  Quality of experience-driven low-delay error-resilient video communication , 2012 .

[65]  Ragnhild Eg,et al.  Spatial flicker effect in video scaling , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[66]  Fan Zhang,et al.  Quality of experience-driven multi-dimensional video adaptation , 2014 .

[67]  Sanjiv Singh,et al.  Optimal motion estimation from visual and inertial measurements , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[68]  Yong Liu,et al.  On Adaptive HTTP Streaming to Mobile Devices , 2013, 2013 20th International Packet Video Workshop.

[69]  Robert Bosch,et al.  Comparison of Event-Triggered and Time-Triggered Concepts with Regard to Distributed Control Systems , 2004 .

[70]  Christian Lottermann,et al.  Performance evaluation of automotive off-board applications in LTE deployments , 2012, 2012 IEEE Vehicular Networking Conference (VNC).

[71]  Mehrnoush Rahmani.  A Resource-Efficient IP-based Network Architecture for In-Vehicle Communication , 2009 .

[72]  Yeqiong Song,et al.  Trends in Automotive Communication Systems , 2005, Proc. IEEE.

[73]  Wolfgang Hintermaier.  An IP-based system architecture for camera-based driver assistance services , 2011 .

[74]  Ali C. Begen,et al.  An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP , 2011, MMSys.

[75]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[76]  Shangguang Wang,et al.  An overview of Internet of Vehicles , 2014, China Communications.

[77]  Iain E. Garden Richardson,et al.  A new perceptual quality metric for compressed video , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[78]  Hermann Winner,et al.  Adaptive Cruise Control , 2015, Handbuch Fahrerassistenzsysteme.

[79]  Lars Völker,et al.  Challenges in a future IP/Ethernet-based in-car network for real-time applications , 2011, 2011 48th ACM/EDAC/IEEE Design Automation Conference (DAC).

[80]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[81]  Eckehard G. Steinbach,et al.  Bit rate estimation for H.264/AVC video encoding based on temporal and spatial activities , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[82]  Moncef Gabbouj,et al.  Rate adaptation for adaptive HTTP streaming , 2011, MMSys.

[83]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[84]  Alexey V. Vinel,et al.  Live video streaming in IEEE 802.11p vehicular networks: Demonstration of an automotive surveillance application , 2014, 2014 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[85]  A. Bovik,et al.  OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[86]  Ahmad Rahmati,et al.  Sensor-Assisted Video Encoding for Mobile Devices in Real-World Environments , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[87]  Lucia Lo Bello,et al.  Automotive communications-past, current and future , 2005, 2005 IEEE Conference on Emerging Technologies and Factory Automation.

[88]  S. Gary,et al.  Joint Model Reference Encoding Methods and Decoding Concealment Methods , 2003 .

[89]  Tobias Oelbaum,et al.  A generic method to increase the prediction accuracy of visual quality metrics , 2007, PCS 2007.

[90]  Nick McKeown,et al.  Confused, timid, and unstable: picking a video streaming rate is hard , 2012, Internet Measurement Conference.

[91]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[92]  Ali C. Begen,et al.  Watching Video over the Web: Part 1: Streaming Protocols , 2011, IEEE Internet Computing.

[93]  Eckehard G. Steinbach,et al.  Block structure reuse for multi-rate high efficiency video coding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[94]  King Ngi Ngan,et al.  Recent advances in rate control for video coding , 2007, Signal Process. Image Commun..

[95]  Klaus Dietmayer,et al.  MULTILAYER LASERSCANNER FOR ROBUST OBJECT TRACKING AND CLASSIFICATION IN URBAN TRAFFIC SCENES , 2002 .

[96]  Ajay Luthra,et al.  The H.264/AVC Advanced Video Coding standard: overview and introduction to the fidelity range extensions , 2004, SPIE Optics + Photonics.

[97]  Adam Wolisz,et al.  Adaptation algorithm for adaptive streaming over HTTP , 2012, 2012 19th International Packet Video Workshop (PV).

[98]  Patrick Le Callet,et al.  Tradeoffs in subjective testing methods for image and video quality assessment , 2010, Electronic Imaging.

[99]  Eckehard G. Steinbach,et al.  Camera context based estimation of spatial and temporal activity parameters for video quality metrics in automotive applications , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[100]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[101]  Zhan Ma,et al.  Analytical rate model for compressed video considering impacts of spatial, temporal and amplitude resolutions , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[102]  Liang-Gee Chen,et al.  Analysis and complexity reduction of multiple reference frames motion estimation in H.264/AVC , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[103]  Eckehard G. Steinbach,et al.  Modeling the bit rate of H.264/AVC video encoding as a function of quantization parameter, frame rate and GoP characteristics , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[104]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[105]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[106]  Sabine Sories,et al.  CoCar Feasibility Study , 2009 .

[107]  Iain E. G. Richardson,et al.  Digital Video Communications , 1997 .