CARS: Collaborative Augmented Reality for Socialization

As Augmented Reality (AR) ties closely to the physical world, its users looking at overlapped scenes are likely to be in the vicinity of each other, which naturally enables the collaboration and interaction among them. In this paper, we propose CARS (Collaborative Augmented Reality for Socialization), a framework that leverages the social nature of human beings to improve the user-perceived Quality of Experience (QoE) for AR, especially the end-to-end latency. CARS takes advantage of the unique feature of AR to support intelligent sharing of information between nearby users when it is feasible. It brings various benefits at the user, application and system levels, e.g., reduction of end-to-end latency and reuse of networking and computation resources. We demonstrate the efficacy of CARS through a preliminary evaluation based on a prototype implementation.

[1]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[2]  Alfons Juan-Císcar,et al.  Bernoulli mixture models for binary images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[3]  Inseok Hwang,et al.  CoMon: cooperative ambience monitoring platform with continuity and benefit awareness , 2012, MobiSys '12.

[4]  Paramvir Bahl,et al.  GLIMPSE: Continuous, Real-Time Object Recognition on Mobile Devices , 2016, GetMobile Mob. Comput. Commun..

[5]  Christophe Diot,et al.  End-to-end transmission control mechanisms for multiparty interactive applications on the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[6]  Kate Ching-Ju Lin,et al.  Preference-aware content dissemination in opportunistic mobile social networks , 2012, 2012 Proceedings IEEE INFOCOM.

[7]  Vikas Kumar,et al.  CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones , 2010, MobiSys '10.

[8]  Swati Rallapalli,et al.  Enabling physical analytics in retail stores using smart glasses , 2014, MobiCom.

[9]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[10]  Mahadev Satyanarayanan,et al.  Towards wearable cognitive assistance , 2014, MobiSys.

[11]  Justin Manweiler,et al.  OverLay: Practical Mobile Augmented Reality , 2015, MobiSys.

[12]  Florent Perronnin,et al.  Large-scale image retrieval with compressed Fisher vectors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Douglas A. Reynolds,et al.  Speaker Verification Using Adapted Gaussian Mixture Models , 2000, Digit. Signal Process..

[14]  Stratis Ioannidis,et al.  Distributed caching over heterogeneous mobile networks , 2010, SIGMETRICS '10.

[15]  Paramvir Bahl,et al.  The Case for VM-Based Cloudlets in Mobile Computing , 2009, IEEE Pervasive Computing.

[16]  Charles T. Loop,et al.  Holoportation: Virtual 3D Teleportation in Real-time , 2016, UIST.

[17]  Justin Manweiler,et al.  Low Bandwidth Offload for Mobile AR , 2016, CoNEXT.

[18]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[19]  M C Sogayar,et al.  Bone Morphogenetic Proteins , 2014, Journal of dental research.

[20]  Bo Han,et al.  On the Networking Challenges of Mobile Augmented Reality , 2017, VR/AR Network@SIGCOMM.

[21]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[22]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[23]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Fabrizio Falchi,et al.  Aggregating binary local descriptors for image retrieval , 2016, Multimedia Tools and Applications.

[25]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.