User localisation using visual sensing and RF signal strength

In this paper, we simulate a museum scenario where we are concerned with identifying the exhibit that a person is observing. Many different technologies exist for determining the location of a user, including GPS, GSM and RF-id tags. Due to their low-power and passive nature, along with their relatively good accuracy, we examine the use of image-based localisation, alongside RF-based localisation for this task. In image-based localisation, we investigate if it is possible to determine a user's location given an image captured at their current location. In RF-based localisation, we can attempt localisation using a set of signal strength readings from detected wireless networks. As the two sources of data are complementary, we investigate different fusion strategies and measure the resulting increase in performance from using both systems.

[1]  Tan-Hsu Tan,et al.  The Ubiquitous Museum Learning Environment: Concept, Design, Implementation, and a Case Study , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[4]  Jana Kosecka,et al.  Global localization and relative positioning based on scale-invariant keypoints , 2005, Robotics Auton. Syst..

[5]  Noel E. O'Connor,et al.  SenseCam Image Localisation Using Hierarchical SURF Trees , 2009, MMM.

[6]  Eyal de Lara,et al.  Are GSM Phones THE Solution for Localization? , 2006, Seventh IEEE Workshop on Mobile Computing Systems & Applications (WMCSA'06 Supplement).

[7]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[8]  Lora Aroyo,et al.  Personalized Museum Experience: The Rijksmuseum Use Case , 2007 .

[9]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[10]  Alan F. Smeaton,et al.  Organising a daily visual diary using multifeature clustering , 2007, Electronic Imaging.

[11]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).