MediaScope: Selective on-demand media retrieval from mobile devices

Motivated by an availability gap for visual media, where images and videos are uploaded from mobile devices well after they are generated, we explore the selective, timely retrieval of media content from a collection of mobile devices. We envision this capability being driven by similarity-based queries posed to a cloud search front-end, which in turn dynamically retrieves media objects from mobile devices that best match the respective queries within a given time limit. Building upon a crowd-sensing framework, we have designed and implemented a system called MediaScope that provides this capability. MediaScope is an extensible framework that supports nearest-neighbor and other geometric queries on the feature space (e.g., clusters, spanners), and contains novel retrieval algorithms that attempt to maximize the retrieval of relevant information. From experiments on a prototype, MediaScope is shown to achieve near-optimal query completeness and low to moderate overhead on mobile devices.

[1]  Jacek Blazewicz,et al.  Handbook on Scheduling: From Theory to Applications , 2014 .

[2]  Ramesh Govindan,et al.  Medusa: a programming framework for crowd-sensing applications , 2012, MobiSys '12.

[3]  Md. Yusuf Sarwar Uddin,et al.  PhotoNet: A Similarity-Aware Picture Delivery Service for Situation Awareness , 2011, 2011 IEEE 32nd Real-Time Systems Symposium.

[4]  Chuan Qin,et al.  TagSense: a smartphone-based approach to automatic image tagging , 2011, MobiSys '11.

[5]  Vikas Kumar,et al.  CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones , 2010, MobiSys '10.

[6]  Yiannis S. Boutalis,et al.  Selection of the proper Compact Composite Descriptor for improving content based image retrieval , 2009 .

[7]  Hyeran Byun,et al.  A fast image retrieval system using index lookup table on mobile device , 2008, 2008 19th International Conference on Pattern Recognition.

[8]  Mathias Lux,et al.  Lire: lucene image retrieval: an extensible java CBIR library , 2008, ACM Multimedia.

[9]  Jérôme Gensel,et al.  PhotoMap: from location and time to context-aware photo annotations , 2008, J. Locat. Based Serv..

[10]  Yung-Hsiang Lu,et al.  Energy conservation by adaptive feature loading for mobile content-based image retrieval , 2008, Proceeding of the 13th international symposium on Low power electronics and design (ISLPED '08).

[11]  Changhu Wang,et al.  Learning to reduce the semantic gap in web image retrieval and annotation , 2008, SIGIR '08.

[12]  Yiannis S. Boutalis,et al.  CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval , 2008, ICVS.

[13]  Yiannis S. Boutalis,et al.  FCTH: Fuzzy Color and Texture Histogram - A Low Level Feature for Accurate Image Retrieval , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[14]  Simon King,et al.  MMM2: mobile media metadata for media sharing , 2005, CHI EA '05.

[15]  Moncef Gabbouj,et al.  Content-based image retrieval on mobile devices , 2005, IS&T/SPIE Electronic Imaging.

[16]  Jonathon S. Hare,et al.  Content-based image retrieval using a mobile device as a novel interface , 2005, IS&T/SPIE Electronic Imaging.

[17]  Moncef Gabbouj,et al.  Content-based Image Retrieval for Connected Mobile Devices , 2005 .

[18]  Wei-Ying Ma,et al.  Hierarchical clustering of WWW image search results using visual, textual and link information , 2004, MULTIMEDIA '04.

[19]  Yixin Chen,et al.  Content-based image retrieval by clustering , 2003, MIR '03.

[20]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[21]  A. H. Lipkus A proof of the triangle inequality for the Tanimoto distance , 1999 .

[22]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[24]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[25]  M. Garey Johnson: computers and intractability: a guide to the theory of np- completeness (freeman , 1979 .

[26]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .