Latency-aware Hybrid Edge Cloud Framework for Mobile Augmented Reality Applications

Mobile Augmented Reality (AR) has become a reality thanks to improvements in mobile hardware. Still, mobile AR lags behind its desktop counterpart in both latency and performance. Simple offloading to external computers has been attempted, but is not practical due to high communication latency and adverse user experience. In this paper, we propose a novel Mobile Edge Computing framework for Augmented Reality applications (MEC-AR). MEC-AR is designed to take advantage of 5G cellular networks and make optimized computation-offloading decisions in a multi-tiered hierarchy. A three-layered architecture involving the end user, the mobile edge, and finally the cloud is envisioned. In the context of MEC resource management, we cast a Mixed Integer Linear Program (MILP) that aims at finding an efficient application placement on the MEC-AR layers to minimize the network latency. We evaluate the performance of our proposed MEC-AR framework by conducting extensive experimental analysis using images taken around Rutgers University. Simulation results coupled with real-time experiments on a small-scale MEC testbed show that our hierarchical computation mechanism improves the performance of mobile AR applications in terms of both energy consumption and network latency.

[1]  Emrecan Demirors,et al.  WNOS: An Optimization-based Wireless Network Operating System , 2018, MobiHoc.

[2]  Jannick P. Rolland,et al.  A Survey of Tracking Technologies for Virtual Environments , 2001 .

[3]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..

[4]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[5]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[6]  Pan Hui,et al.  Mobile Augmented Reality Survey: From Where We Are to Where We Go , 2017, IEEE Access.

[7]  Yonggang Wen,et al.  Collaborative Task Execution in Mobile Cloud Computing Under a Stochastic Wireless Channel , 2015, IEEE Transactions on Wireless Communications.

[8]  Haibin Ling,et al.  Augmented Reality in Reality , 2017, IEEE MultiMedia.

[9]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[10]  Jukka K. Nurminen,et al.  Energy Efficiency of Mobile Clients in Cloud Computing , 2010, HotCloud.

[11]  Xiaobo Sharon Hu,et al.  Signature-based workload estimation for mobile 3D graphics , 2006, 2006 43rd ACM/IEEE Design Automation Conference.

[12]  Xu Chen,et al.  Decentralized Computation Offloading Game for Mobile Cloud Computing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[13]  Schahram Dustdar,et al.  A New Era for Web AR with Mobile Edge Computing , 2018, IEEE Internet Computing.

[14]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[15]  Holger Regenbrecht,et al.  Towards Pervasive Augmented Reality: Context-Awareness in Augmented Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[16]  Alexey Melnikov,et al.  The WebSocket Protocol , 2011, RFC.

[17]  Atay Ozgovde,et al.  How Can Edge Computing Benefit From Software-Defined Networking: A Survey, Use Cases, and Future Directions , 2017, IEEE Communications Surveys & Tutorials.

[18]  Dario Pompili,et al.  Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges , 2016, IEEE Communications Magazine.

[19]  Jeffrey G. Andrews,et al.  What Will 5G Be? , 2014, IEEE Journal on Selected Areas in Communications.

[20]  Dario Pompili,et al.  Bandwidth and Energy-Aware Resource Allocation for Cloud Radio Access Networks , 2018, IEEE Transactions on Wireless Communications.