Interactive Museum Guide: Accurate Retrieval of Object Descriptions

In this paper we describe an interactive guide that is able to automatically retrieve information about objects on display in museums. A visitor can point this mobile device at exhibits and automatically retrieve descriptions about objects of interest in a non-distractive way. We investigate Gaussian image intensity attenuation and a foveation-based preprocessing approach which both allow to focus interest point extraction towards the center of an image. Furthermore, we describe a postprocessing strategy that allows to improve object recognition rates by suppressing multiple matches. The proposed interactive museum guide achieves object recognition via image matching and thus allows the use of model sets that do not need to be segmented.

[1]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Wilson S. Geisler,et al.  Implementation of a foveated image coding system for image bandwidth reduction , 1996, Electronic Imaging.

[3]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[4]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  Ee-Chien Chang,et al.  Foveation Techniques and Scheduling Issues in Thinwire Visualization , 1998 .

[6]  Luc Van Gool,et al.  Interactive museum guide , 2005 .

[7]  Wolfram Burgard,et al.  The Interactive Museum Tour-Guide Robot , 1998, AAAI/IAAI.

[8]  Oliver Bimber,et al.  PhoneGuide: museum guidance supported by on-device object recognition on mobile phones , 2005, MUM '05.

[9]  L. Gool,et al.  Interactive museum guide : fast and robust recognition of museum objects , 2006 .

[10]  Adam Baumberg,et al.  Reliable feature matching across widely separated views , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  SchmidCordelia,et al.  A Performance Evaluation of Local Descriptors , 2005 .

[12]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Fusako Kusunoki,et al.  Toward an interactive museum guide system with sensing and wireless network technologies , 2002, Proceedings. IEEE International Workshop on Wireless and Mobile Technologies in Education.

[14]  Wolfram Burgard,et al.  Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva , 2000, Int. J. Robotics Res..