Practical Methods for Efficient Resource Utilization in Augmented Reality Services

This work presents a novel approach that adopts content caching techniques towards reducing computation and communication costs of Augmented Reality (AR) services. The application scenario under investigation assumes an environment of static objects, each one associated to a holographic content. The goal is to devise practical low-overhead methods so as to reduce the amount of resources above that are needed for the most resource-demanding AR process, namely object recognition. The proposed method is based on caching images using a combination of metrics to rank them such as: (i) an object popularity index which favours objects that are most probable to be requested for recognition, (ii) the percentage of times when the object label has been encountered in the past, (iii) the probability that an image is similar enough with already encountered past images with the same label. The aforementioned image caching method drastically reduces database searches and returns the matched object that satisfies the needs of object recognition. We also devise a binary decision operator that initiates the object recognition process only upon comparison of spatial data of the AR device with the targeted object. The resulting performance is measured using a client-server architecture and components such as Wireshark, Unity Profiler, and Python. For our proposed architecture we deploy an edge server to satisfy the demands of the AR service. Results indicate that the proposed methods can significantly reduce both the computational resources and the induced network traffic, thus improving user experience.

[1]  Xuanzhe Liu,et al.  DeepCache: Principled Cache for Mobile Deep Vision , 2017, MobiCom.

[2]  Pan Hui,et al.  When Augmented Reality meets Big Data , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[3]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless video content delivery through distributed caching helpers , 2011, 2012 Proceedings IEEE INFOCOM.

[4]  Katherine Guo,et al.  Precog: prefetching for image recognition applications at the edge , 2017, SEC.

[5]  Yu Yuan,et al.  Paving the Road for Virtual and Augmented Reality [Standards] , 2018, IEEE Consumer Electronics Magazine.

[6]  Kristina Petljak,et al.  The Role of Store Layout and Visual Merchandising in Food Retailing , 2016 .

[7]  Iordanis Koutsopoulos,et al.  Streaming big data meets backpressure in distributed network computation , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[8]  Shaharyar Ahmed Khan Tareen,et al.  A comparative analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK , 2018, 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET).

[9]  Jacob Chakareski,et al.  VR/AR Immersive Communication: Caching, Edge Computing, and Transmission Trade-Offs , 2017, VR/AR Network@SIGCOMM.

[10]  Augmented and Virtual Reality : the First Wave of 5 G Killer Apps , 2017 .

[11]  Rajesh Krishna Balan,et al.  DeepMon: Mobile GPU-based Deep Learning Framework for Continuous Vision Applications , 2017, MobiSys.

[12]  Pan Hui,et al.  Mobile Augmented Reality Survey: From Where We Are to Where We Go , 2017, IEEE Access.

[13]  Merkourios Karaliopoulos,et al.  Caching-aware recommendations: Nudging user preferences towards better caching performance , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[14]  Samta Shukla,et al.  Hold ’ em Caching : Proactive Retention-Aware Caching with Multipath Routing for Wireless Edge Networks , 2017 .

[15]  C. Radhakrishna,et al.  Demo/poster abstract: XReality research lab — Augmented reality meets Internet of Things , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[16]  Bo Han,et al.  On the Networking Challenges of Mobile Augmented Reality , 2017, VR/AR Network@SIGCOMM.

[17]  Scott Smith,et al.  Smart Responders for Smart Cities: A VR/AR Training Approach for Next Generation First Responders , 2019, Smart Cities in Application.

[18]  Heiko Ludwig,et al.  Zenith: Utility-Aware Resource Allocation for Edge Computing , 2017, 2017 IEEE International Conference on Edge Computing (EDGE).

[19]  Osvaldo Simeone,et al.  Energy-Efficient Resource Allocation for Mobile Edge Computing-Based Augmented Reality Applications , 2016, IEEE Wireless Communications Letters.

[20]  Jaime Llorca,et al.  On the delivery of augmented information services over wireless computing networks , 2017, 2017 IEEE International Conference on Communications (ICC).

[21]  George Iosifidis,et al.  Towards Resource-Efficient Wireless Edge Analytics for Mobile Augmented Reality Applications , 2018, 2018 15th International Symposium on Wireless Communication Systems (ISWCS).

[22]  Hermann J. Müller,et al.  Perception of Delay in Haptic Telepresence Systems , 2010, PRESENCE: Teleoperators and Virtual Environments.

[23]  Stratis Ioannidis,et al.  Jointly Optimal Routing and Caching for Arbitrary Network Topologies , 2017, IEEE Journal on Selected Areas in Communications.