A novel interactive exhibition method based on handheld devices

We propose a novel interactive method for museum exhibitions based on handheld devices such as ordinary camera-equipped mobile phones. It enables museum visitors to automatically get annotations about exhibits interest in a non-distractive way by capturing videos of them. Our method recognizes different comment region of exhibits by applying SIFT algorithm on handheld devices. While SIFT is known to be a strong algorithm for local feature recognition, it is computationally expensive and unsuitable for low-end devices such as mobile phones. We introduce some modified approaches to make it suitable for handheld devices. The usefulness of the proposed method and user satisfaction are evaluated through the experimental results.

[1]  Suya You,et al.  Augmented Exhibitions Using Natural Features , 2007 .

[2]  Dieter Schmalstieg,et al.  Pose tracking from natural features on mobile phones , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[3]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[4]  Lu Wang,et al.  An Augmented Reality Interface for Mobile Information Retrieval , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[5]  Andreas Zimmermann,et al.  LISTEN: a user-adaptive audio-augmented museum guide , 2008, User Modeling and User-Adapted Interaction.

[6]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[7]  Arcot Sowmya,et al.  Multiple Camera, Multiple Person Tracking with Pointing Gesture Recognition in Immersive Environments , 2008, ISVC.

[8]  Oliver Bimber,et al.  Adaptive training of video sets for image recognition on mobile phones , 2009, Personal and Ubiquitous Computing.

[9]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[10]  Natasha Gelfand,et al.  SURFTrac: Efficient tracking and continuous object recognition using local feature descriptors , 2009, CVPR.

[11]  Luc Van Gool,et al.  Interactive Museum Guide: Accurate Retrieval of Object Descriptions , 2006, Adaptive Multimedia Retrieval.

[12]  Quan Wang,et al.  Fast Similarity Search for High-Dimensional Dataset , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[13]  Derrick J. Parkhurst,et al.  Enhancing Multi-user Interaction with Multi-touch Tabletop Displays Using Hand Tracking , 2008, First International Conference on Advances in Computer-Human Interaction.