From Where to What: Metadata Sharing for Digital Photographs with Geographic Coordinates

We describe LOCALE, a system that allows cooperating information systems to share labels for photographs. Participating photographs are enhanced with a geographic location stamp -- the latitude and longitude where the photograph was taken. For a photograph with no label, LOCALE can use the shared information to assign a label based on other photographs that were taken in the same area. LOCALE thus allows (i) text search over unlabeled sets of photos, and (ii) automated label suggestions for unlabeled photos. We have implemented a LOCALE prototype where users cooperate in submitting labels and locations, enhancing search quality for all users in the system. We ran an experiment to test the system in centralized and distributed settings. The results show that the system performs search tasks with surprising accuracy, even when searching for specific landmarks.

[1]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[2]  Michael L. Creech,et al.  FotoFile: a consumer multimedia organization and retrieval system , 1999, CHI '99.

[3]  James Frew,et al.  Geographic Names: The Implementation of a Gazetteer in a Georeferenced Digital Library , 1999, D Lib Mag..

[4]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[5]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[6]  Ben Shneiderman,et al.  Direct annotation: a drag-and-drop strategy for labeling photos , 2000, 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics.

[7]  Remco C. Veltkamp,et al.  Content-based image retrieval systems: A survey , 2000 .

[8]  Mary Czerwinski,et al.  Semi-Automatic Image Annotation , 2001, INTERACT.

[9]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Andreas Paepcke,et al.  Time as essence for photo browsing through personal digital libraries , 2002, JCDL '02.

[11]  Remco C. Veltkamp,et al.  A Survey of Content-Based Image Retrieval Systems , 2002 .

[12]  Allan Kuchinsky,et al.  Requirements for photoware , 2002, CSCW '02.

[13]  Ben Shneiderman,et al.  Immediate Usability: Kiosk design principles from the CHI 2001 Photo Library , 2003 .

[14]  Kerry Rodden,et al.  How do people manage their digital photographs? , 2003, CHI '03.