Perceiving QUIC: do users notice or even care?

QUIC, as the foundation for HTTP/3, is becoming an Internet reality. A plethora of studies already show that QUIC excels beyond TCP+ TLS+HTTP/2. Yet, these studies compare a highly optimized QUIC Web stack against an unoptimized TCP-based stack. In this paper, we bring TCP up to speed to perform an eye-level comparison. Instead of relying on technical metrics, we perform two extensive user studies to investigate QUIC's impact on the quality of experience. First, we investigate if users can distinguish two protocol versions in a direct comparison, and we find that QUIC is indeed rated faster than TCP and even a tuned TCP. Yet, our second study shows that this perceived performance increase does mostly not matter to the users, and they rate QUIC and TCP indistinguishable.

[1]  Andra Lutu,et al.  Web Experience in Mobile Networks: Lessons from Two Million Page Visits , 2019, WWW.

[2]  Sándor Molnár,et al.  How quick is QUIC? , 2016, 2016 IEEE International Conference on Communications (ICC).

[3]  Dario Rossi,et al.  The Web, the Users, and the MOS: Influence of HTTP/2 on User Experience , 2017, PAM.

[4]  Oliver Hohlfeld,et al.  TheFragebogen: A Web Browser-based Questionnaire Framework for Scientific Research , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[5]  Omprakash Gnawali,et al.  Does QUIC Make the Web Faster? , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[6]  James Newman,et al.  Mile High WiFi: A First Look At In-Flight Internet Connectivity , 2018, WWW.

[7]  Jan Rüth,et al.  A First Look at QUIC in the Wild , 2018, PAM.

[8]  Bertrand Mathieu,et al.  QUIC: Better for what and for whom? , 2017, 2017 IEEE International Conference on Communications (ICC).

[9]  Phuoc Tran-Gia,et al.  Best Practices for QoE Crowdtesting: QoE Assessment With Crowdsourcing , 2014, IEEE Transactions on Multimedia.

[10]  Oliver Hohlfeld,et al.  A QoE Perspective on HTTP/2 Server Push , 2017, Internet-QoE@SIGCOMM.

[11]  Aruna Balasubramanian,et al.  Improving User Perceived Page Load Times Using Gaze , 2017, NSDI.

[12]  Marc Fischlin,et al.  Replay Attacks on Zero Round-Trip Time: The Case of the TLS 1.3 Handshake Candidates , 2017, 2017 IEEE European Symposium on Security and Privacy (EuroS&P).

[13]  Jan Rüth,et al.  A performance perspective on web optimized protocol stacks: TCP+TLS+HTTP/2 vs. QUIC , 2019, ANRW.

[14]  Michael Seufert,et al.  Is QUIC becoming the New TCP? On the Potential Impact of a New Protocol on Networked Multimedia QoE , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[15]  Sebastian Möller A New ITU-T Recommendation on the Evaluation of Telephone-Based Spoken Dialogue Systems , 2004, LREC.

[16]  Cristina Nita-Rotaru,et al.  Taking a long look at QUIC: an approach for rigorous evaluation of rapidly evolving transport protocols , 2017, Internet Measurement Conference.

[17]  Djamel Fawzi Hadj Sadok,et al.  QUIC and TCP: A Performance Evaluation , 2018, 2018 IEEE Symposium on Computers and Communications (ISCC).

[18]  Michael Seufert,et al.  QUICker or not? -an Empirical Analysis of QUIC vs TCP for Video Streaming QoE Provisioning , 2019, 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN).

[19]  Mingwei Xu,et al.  When QUIC meets TCP: An experimental study , 2017, 2017 IEEE 36th International Performance Computing and Communications Conference (IPCCC).

[20]  Hari Balakrishnan,et al.  Mahimahi: Accurate Record-and-Replay for HTTP , 2015, USENIX Annual Technical Conference.

[21]  Luca De Cicco,et al.  HTTP over UDP: an experimental investigation of QUIC , 2015, SAC.

[22]  Maarten Wijnants,et al.  HTTP/2 Prioritization and its Impact on Web Performance , 2018, WWW.