Transparent AR Processing Acceleration at the Edge

Mobile devices are increasingly capable of supporting advanced functionalities but still face fundamental resource limitations. While the development of custom accelerators for compute-intensive functions is progressing, precious battery life and quality vs. latency trade-offs are limiting the potential of applications relying on processing real-time, computational-intensive functions, such as Augmented Reality. Transparent network support for on-the-fly media processing at the edge can significantly extend the capabilities of mobile devices without the need for API changes. In this paper we introduce NEAR, a framework for transparent live video processing and augmentation at the network edge, along with its architecture and preliminary performance evaluation in an object detection use case.

[1]  Trevor N. Mudge,et al.  Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge , 2017, ASPLOS.

[2]  Peng Liu,et al.  EdgeEye: An Edge Service Framework for Real-time Intelligent Video Analytics , 2018, EdgeSys@MobiSys.

[3]  Paramvir Bahl,et al.  Glimpse: Continuous, Real-Time Object Recognition on Mobile Devices , 2015, SenSys.

[4]  Mahadev Satyanarayanan,et al.  Towards wearable cognitive assistance , 2014, MobiSys.

[5]  Massimo Gallo,et al.  CliMB: Enabling Network Function Composition with Click Middleboxes , 2016, CCRV.

[6]  Paramvir Bahl,et al.  VideoEdge: Processing Camera Streams using Hierarchical Clusters , 2018, 2018 IEEE/ACM Symposium on Edge Computing (SEC).

[7]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[8]  Massimo Gallo,et al.  ClickNF: a Modular Stack for Custom Network Functions , 2018, USENIX Annual Technical Conference.

[9]  George Varghese,et al.  P4: programming protocol-independent packet processors , 2013, CCRV.

[10]  Soheil Ghiasi,et al.  CNNdroid: GPU-Accelerated Execution of Trained Deep Convolutional Neural Networks on Android , 2015, ACM Multimedia.

[11]  Olivier Festor,et al.  Oko: Extending Open vSwitch with Stateful Filters , 2018, SOSR.

[12]  Ronald G. Dreslinski,et al.  Sirius: An Open End-to-End Voice and Vision Personal Assistant and Its Implications for Future Warehouse Scale Computers , 2015, ASPLOS.

[13]  Zhenming Liu,et al.  DeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[14]  Eddie Kohler,et al.  The Click modular router , 1999, SOSP.