Demo abstract - MediaScope: Selective on-demand media retrieval from mobile devices

Motivated by an availability gap for visual media, where images and videos are uploaded from mobile devices well after they are generated, we explore the selective, timely retrieval of media content from a collection of mobile devices. We envision this capability being driven by similarity-based queries posed to a cloud search front-end, which in turn dynamically retrieves media objects from mobile devices that best match the respective queries within a given time limit. Building upon a crowd-sensing framework, we have designed and implemented a system called MediaScope that provides this capability. MediaScope is an extensible framework that supports nearest-neighbor and other geometric queries on the feature space (e.g., clusters, spanners), and contains novel retrieval algorithms that attempt to maximize the retrieval of relevant information. From experiments on a prototype, MediaScope is shown to achieve near-optimal query completeness and low to moderate overhead on mobile devices.

[1]  Md. Yusuf Sarwar Uddin,et al.  PhotoNet: A Similarity-Aware Picture Delivery Service for Situation Awareness , 2011, 2011 IEEE 32nd Real-Time Systems Symposium.

[2]  Vikas Kumar,et al.  CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones , 2010, MobiSys '10.

[3]  Wei-Ying Ma,et al.  Hierarchical clustering of WWW image search results using visual, textual and link information , 2004, MULTIMEDIA '04.

[4]  Ramesh Govindan,et al.  Medusa: a programming framework for crowd-sensing applications , 2012, MobiSys '12.

[5]  Jérôme Gensel,et al.  PhotoMap: from location and time to context-aware photo annotations , 2008, J. Locat. Based Serv..

[6]  Jacek Blazewicz,et al.  Handbook on Scheduling: From Theory to Applications , 2014 .

[7]  A. H. Lipkus.  A proof of the triangle inequality for the Tanimoto distance , 1999 .

[8]  Yung-Hsiang Lu,et al.  Energy conservation by adaptive feature loading for mobile content-based image retrieval , 2008, Proceeding of the 13th international symposium on Low power electronics and design (ISLPED '08).

[9]  Simon King,et al.  MMM2: mobile media metadata for media sharing , 2005, CHI EA '05.

[10]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[11]  Yiannis S. Boutalis,et al.  Selection of the proper Compact Composite Descriptor for improving content based image retrieval , 2009 .

[12]  Yiannis S. Boutalis,et al.  CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval , 2008, ICVS.

[13]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[14]  Hyeran Byun,et al.  A fast image retrieval system using index lookup table on mobile device , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[16]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Jonathon S. Hare,et al.  Content-based image retrieval using a mobile device as a novel interface , 2005, IS&T/SPIE Electronic Imaging.

[18]  Yixin Chen,et al.  Content-based image retrieval by clustering , 2003, MIR '03.

[19]  Moncef Gabbouj,et al.  Content-based Image Retrieval for Connected Mobile Devices , 2005 .

[20]  Wolfgang Kellerer,et al.  Sensor ranking: A primitive for efficient content-based sensor search , 2009, 2009 International Conference on Information Processing in Sensor Networks.

[21]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[22]  Yiannis S. Boutalis,et al.  FCTH: Fuzzy Color and Texture Histogram - A Low Level Feature for Accurate Image Retrieval , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[23]  Chuan Qin,et al.  TagSense: a smartphone-based approach to automatic image tagging , 2011, MobiSys '11.

[24]  Mathias Lux,et al.  Lire: lucene image retrieval: an extensible java CBIR library , 2008, ACM Multimedia.

[25]  Changhu Wang,et al.  Learning to reduce the semantic gap in web image retrieval and annotation , 2008, SIGIR '08.

[26]  Moncef Gabbouj,et al.  Content-based image retrieval on mobile devices , 2005, IS&T/SPIE Electronic Imaging.