Mo Músaem Fíorúil: A Web-Based Search and Information Service for Museum Visitors

We describe the prototype of an interactive, web-based, museum artifact search and information service. Mo Musaem Fioruil clusters and indexes images of museum artifacts taken by visitors to the museum where the images are captured using a passive capture device such as Microsoft's SenseCam [1]. The system also matches clustered artifacts to images of the same artifact from the museums official photo collection and allows the user to view images of the same artifact taken by other visitors to the museum. This matching process potentially allows the system to provide more detailed information about a particular artifact to the user based on their inferred preferences, thereby greatly enhancing the user's overall museum experience. In this work, we introduce the system and describe, in broad terms, it's overall functionality and use. Using different image sets of artificial museum objects, we also describe experiments and results carried out in relation to the artifact matching component of the system.

[1]  Marcus Specht,et al.  Adaptive mobile museum guide for information and learning on demand , 1999, HCI.

[2]  Oliver Bimber,et al.  PhoneGuide: museum guidance supported by on-device object recognition on mobile phones , 2005, MUM '05.

[3]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[4]  Gordon Bell,et al.  Passive capture and ensuing issues for a personal lifetime store , 2004, CARPE'04.

[5]  Lora Aroyo,et al.  Personalized Museum Experience: The Rijksmuseum Use Case , 2007 .

[6]  L. Gool,et al.  Interactive museum guide : fast and robust recognition of museum objects , 2006 .

[7]  Noel E. O'Connor,et al.  Exploiting context information to aid landmark detection in SenseCam images , 2006 .

[8]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[9]  Jim Gemmell,et al.  Telling Stories with Mylifebits , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[10]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[12]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Mirjana Spasojevic,et al.  The Electronic Guidebook: Using Portable Devices And A Wireless Web-based Network To Extend The Museum Experience , 2002 .

[15]  Jeff Burke,et al.  Campaignr: A Framework for Participatory Data Collection on Mobile Phones , 2007 .

[16]  Adam Baumberg,et al.  Reliable feature matching across widely separated views , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[17]  Sherry Hsi,et al.  The Electronic Guidebook: A study of user experiences using mobile web content in a museum setting , 2002, Proceedings. IEEE International Workshop on Wireless and Mobile Technologies in Education.

[18]  Wolfram Burgard,et al.  Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva , 2000, Int. J. Robotics Res..

[19]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[20]  Nancy Proctor,et al.  The State of the Art in Museum Handhelds in 2003. , 2003 .