Enhancing Dynamic-Viewport Mobile Applications with Screen Scrolling

The pervasive penetration of mobile smart devices has significantly enriched Internet applications and undoubtedly reshaped the way that users access Internet services. Different from traditional desktop applications, mobile Internet applications require users to input via touch screens and view outputs on the displays with considerably limited size. The significant conflict between the limited-size of touch screens and the richness of online media contents widely exists in dynamic-viewport mobile applications, a class of mobile Internet applications that download contents beyond the user’s viewing region (referred to as viewport). As dynamic-viewport mobile applications usually use HTTP for content downloading, to improve their quality of experience (QoE) and cost efficiency, in this paper we present a MobileFriendly HTTP middleware (MF-HTTP), which can interpret user touch screen inputs and optimize the HTTP downloading of media objects for such applications. We first demystify screen scrolling in mobile operating systems and precisely break down the viewport moving process. We identify the key influential factors for media object downloading and develop an optimal download scheme. Towards building a practical middleware, we further discuss and address the implementation issues in detail. We implement a MF-HTTP prototype based on Android platforms and evaluate the performance of MF-HTTP by conducting concrete case studies on two representative dynamic-viewport mobile applications, namely, web browsing and 360-degree video streaming.

[1]  Cheng-Hsin Hsu,et al.  360° Video Viewing Dataset in Head-Mounted Virtual Reality , 2017, MMSys.

[2]  David Wetherall,et al.  Demystifying Page Load Performance with WProf , 2013, NSDI.

[3]  Feng Qian,et al.  Web caching on smartphones: ideal vs. reality , 2012, MobiSys '12.

[4]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[5]  Zhen Wang,et al.  How far can client-only solutions go for mobile browser speed? , 2011, WWW.

[6]  Hari Balakrishnan,et al.  Polaris: Faster Page Loads Using Fine-grained Dependency Tracking , 2016, NSDI.

[7]  Feng Qian,et al.  A close examination of performance and power characteristics of 4G LTE networks , 2012, MobiSys '12.

[8]  Wei Tsang Ooi,et al.  Supporting zoomable video streams with dynamic region-of-interest cropping , 2010, MMSys '10.

[9]  Xuanzhe Liu,et al.  A Tale of Two Fashions: An Empirical Study on the Performance of Native Apps and Web Apps on Android , 2018, IEEE Transactions on Mobile Computing.

[10]  R. Johari,et al.  A buffer-based approach to rate adaptation , 2014 .

[11]  Xuemin Shen,et al.  Cooperative Edge Caching in User-Centric Clustered Mobile Networks , 2017, IEEE Transactions on Mobile Computing.

[12]  Ling Gao,et al.  Optimise web browsing on heterogeneous mobile platforms: A machine learning based approach , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[13]  Feng Li,et al.  Rubiks: Practical 360-Degree Streaming for Smartphones , 2018, MobiSys.

[14]  Wenwu Zhu,et al.  On Energy-Efficient Offloading in Mobile Cloud for Real-Time Video Applications , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[16]  Ted Taekyoung Kwon,et al.  FLARE: Coordinated Rate Adaptation for HTTP Adaptive Streaming in Cellular Networks , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[17]  M. Siekkinen,et al.  Edge Computing Assisted Adaptive Mobile Video Streaming , 2019, IEEE Transactions on Mobile Computing.

[18]  Dario Pompili,et al.  Adaptive Bitrate Video Caching and Processing in Mobile-Edge Computing Networks , 2019, IEEE Transactions on Mobile Computing.

[19]  Zhe Wu,et al.  Klotski: Reprioritizing Web Content to Improve User Experience on Mobile Devices , 2015, NSDI.

[20]  Kate Ching-Ju Lin,et al.  Smart Retransmission and Rate Adaptation in WiFi , 2015, 2015 IEEE 23rd International Conference on Network Protocols (ICNP).

[21]  Songqing Chen,et al.  OpTile: Toward Optimal Tiling in 360-degree Video Streaming , 2017, ACM Multimedia.

[22]  Xiapu Luo,et al.  Are HTTP/2 Servers Ready Yet? , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[23]  Feng Qian,et al.  Flare: Practical Viewport-Adaptive 360-Degree Video Streaming for Mobile Devices , 2018, MobiCom.

[24]  Aruna Balasubramanian,et al.  Improving User Perceived Page Load Times Using Gaze , 2017, NSDI.

[25]  Jeffrey C. Mogul,et al.  Using predictive prefetching to improve World Wide Web latency , 1996, CCRV.

[26]  Jianwei Huang,et al.  Optimal Resource Allocations for Mobile Data Offloading via Dual-Connectivity , 2018, IEEE Transactions on Mobile Computing.

[27]  Jorrit van den Berg,et al.  Using MPEG DASH SRD for zoomable and navigable video , 2016, MMSys.

[28]  Arun Venkataramani,et al.  msocket: System support for mobile, multipath, and middlebox-agnostic applications , 2016, 2016 IEEE 24th International Conference on Network Protocols (ICNP).

[29]  Shiqiang Yang,et al.  A Dataset for Exploring User Behaviors in VR Spherical Video Streaming , 2017, MMSys.

[30]  Mohamed Hefeeda,et al.  MASH: A rate adaptation algorithm for multiview video streaming over HTTP , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[31]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming: Divide and Conquer , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[32]  Jun Li,et al.  Contract-Based Small-Cell Caching for Data Disseminations in Ultra-Dense Cellular Networks , 2019, IEEE Transactions on Mobile Computing.

[33]  Cyril Concolato,et al.  MPEG DASH SRD: spatial relationship description , 2016, MMSys.

[34]  Harsha V. Madhyastha,et al.  Vroom: Accelerating the Mobile Web with Server-Aided Dependency Resolution , 2017, SIGCOMM.

[35]  Dusit Niyato,et al.  Offloading in Mobile Cloudlet Systems with Intermittent Connectivity , 2015, IEEE Transactions on Mobile Computing.

[36]  Yong Liu,et al.  Towards agile and smooth video adaptation in dynamic HTTP streaming , 2012, CoNEXT '12.

[37]  Li Xiao,et al.  RMIP: Resource management with interference precancellation in heterogeneous cellular networks , 2016, 2016 IEEE 24th International Conference on Network Protocols (ICNP).

[38]  Zhenhua Li,et al.  A Measurement Study of Oculus 360 Degree Video Streaming , 2017, MMSys.

[39]  Antoine Coutrot,et al.  A dataset of head and eye movements for 360° videos , 2018, MMSys.

[40]  Feng Wang,et al.  Mobile Instant Video Clip Sharing With Screen Scrolling: Measurement and Enhancement , 2018, IEEE Transactions on Multimedia.

[41]  George Papageorgiou,et al.  Streaming Lower Quality Video over LTE: How Much Energy Can You Save? , 2015, 2015 IEEE 23rd International Conference on Network Protocols (ICNP).

[42]  Feng Wang,et al.  Dispersing Social Content in Mobile Crowd through Opportunistic Contacts , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).