Image Based Personalized Search from the Picture Sharing Websites

Although search has become a popular feature in many search engines, including Yahoo!, MSN, Google, etc., the majority of image searches use very little, if any, image information. Due to the success of text-based search of Web pages and, in part, to the difficulty and expense of using image based signals, most search engines return images solely based on the text of the pages from which the images are linked.Web search engines help users find useful information on the World Wide Web (WWW). However, when the same query is submitted by different users, typical search engines return the same result regardless of who submitted the query. Users are increasingly pursuing complex task oriented goals on the Web, such as making travel arrangements, managing finances or planning purchases. Searchers create and use external records of their actions and the corresponding results by writing/ typing notes, using copy and paste functions, and making printouts. The social media sites, such as Flickr and del.icio.us, allow users to upload content and annotate it with descriptive labels known as tags, join special-interest groups, etc. We believe user-generated metadata expresses user’s tastes and interests and can be used to modified information to an individual user. Specifically, we describe a machine learning method that analyzes a corpus of tagged content to find hidden topics. We then these learned topics to select content that matches user’s interests. We empirically validated this approach on the social picture-allocation site Flickr, which allows users to annotate icon s with freely chosen tags and to search for icon s labeled with a certain tag. We use metadata associated with icon s tagged with an ambiguous query term to identify topics corresponding to different senses of the term, and then modified results of icon search by displaying to the user only those icon s that are of interest to her.

[1]  Kristina Lerman,et al.  Social Information Processing in News Aggregation , 2007, IEEE Internet Computing.

[2]  Andrew P. Sage,et al.  Uncertainty in Artificial Intelligence , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Y.-J. Lee Concept mapping your Web searches: a design rationale and Web-enabled application , 2004, J. Comput. Assist. Learn..

[4]  Luo Si,et al.  A study of mixture models for collaborative filtering , 2006, Information Retrieval.

[5]  Bernardo A. Huberman,et al.  Usage patterns of collaborative tagging systems , 2006, J. Inf. Sci..

[6]  Thomas L. Griffiths,et al.  The Author-Topic Model for Authors and Documents , 2004, UAI.

[7]  Kristina Lerman,et al.  Personalizing Image Search Results on Flickr , 2007, ArXiv.

[8]  Krishna P. Gummadi,et al.  Exploiting Social Networks for Internet Search , 2006, HotNets.

[9]  Mor Naaman,et al.  HT06, tagging paper, taxonomy, Flickr, academic article, to read , 2006, HYPERTEXT '06.

[10]  Kristina Lerman,et al.  Social Information Processing in Social News Aggregation , 2007, ArXiv.

[11]  Bernardo A. Huberman,et al.  The Structure of Collaborative Tagging Systems , 2005, ArXiv.

[12]  Dan Frankowski,et al.  Collaborative Filtering Recommender Systems , 2007, The Adaptive Web.

[13]  David M. Pennock,et al.  Probabilistic Models for Unified Collaborative and Content-Based Recommendation in Sparse-Data Environments , 2001, UAI.

[14]  Kristina Lerman,et al.  Exploiting Social Annotation for Automatic Resource Discovery , 2007, ArXiv.

[15]  Jaideep Srivastava,et al.  Automatic personalization based on Web usage mining , 2000, CACM.

[16]  Peter Mika Ontologies Are Us: A Unified Model of Social Networks and Semantics , 2005, International Semantic Web Conference.

[17]  Amanda Spink,et al.  Information seeking and mediated searching study. Part 3. Successive searching , 2002, J. Assoc. Inf. Sci. Technol..

[18]  Edward A. Fox,et al.  Recommender Systems Research: A Connection-Centric Survey , 2004, Journal of Intelligent Information Systems.

[19]  Christoph Meinel,et al.  Web Search Personalization Via Social Bookmarking and Tagging , 2007, ISWC/ASWC.