URQUELL: Using wrist-based gestural interaction to discover POIs in urban environments

In this paper, we discuss the implementation of a prototype application (URQUELL) for the opportunistic discovery of POIs in a urban environment, and the multimodal, non-visual interaction with the system to retrieve details about these. The application works by pointing a smartphone or a wrist-worn sensor kit towards a physical venue location of interest. By retrieving information about the venue pointed at over various APIs, the application presents these to the users via high quality text-to-speech synthesis, negating the need to interact with the smartphone, which can be kept in a user's pocket at all times. Here, we discuss the implementation details of our prototype and outline future research directions.

[1]  Charlotte Magnusson,et al.  Guiding Tourists through Haptic Interaction: Vibration Feedback in the Lund Time Machine , 2012, EuroHaptics.

[2]  Thomas Grechenig,et al.  GeoPointing: evaluating the performance of orientation-aware location-based interaction under real-world conditions , 2008, J. Locat. Based Serv..

[3]  Martin Pielot,et al.  Dude, where's my car?: in-situ evaluation of a tactile car finder , 2012, NordiCHI.

[4]  Lynne Baillie,et al.  Rolling, rotating and imagining in a virtual mobile world , 2005, Mobile HCI.

[5]  Dimitrios Buhalis,et al.  Overview of smartphone augmented reality applications for tourism. , 2012, ICIT 2012.

[6]  Charlotte Magnusson,et al.  The Influence of Angle Size in Navigation Applications Using Pointing Gestures , 2010, HAID.

[7]  Radu Vasiu,et al.  Relevant Aspects for the Integration of Linked Data in Mobile Augmented Reality Applications for Tourism , 2014, ICIST.

[8]  Jan O. Borchers,et al.  Where are we?: evaluating the current rendering fidelity of mobile audio augmented reality systems , 2016, MobileHCI.

[9]  Jens Grubert,et al.  Augmented reality browsers: essential products or only gadgets? , 2013, CACM.

[10]  Andreas Butz,et al.  Free-hand pointing for identification and interaction with distant objects , 2013, AutomotiveUI.

[11]  Gary Priestnall,et al.  Mobile capture of remote points of interest using line of sight modelling , 2013, Comput. Geosci..

[12]  Zhang Lei,et al.  A mobile geo-wand enabling gesture based POI search an user generated directional POI photography , 2009, Advances in Computer Entertainment Technology.

[13]  Damianos Gavalas,et al.  Mobile User Experience in Augmented Reality vs. Maps Interfaces: A Case Study in Public Transportation , 2016, AVR.

[14]  Joseph L. Dvorak.  Social Issues of Wearables , 2008 .

[15]  Maria Beatriz Carmo,et al.  Location and orientation based point of interest search interface , 2010, Mobile HCI.

[16]  Andreas Komninos,et al.  Urban exploration using audio scents , 2012, Mobile HCI.

[17]  Pan Hui,et al.  Mobile Augmented Reality Survey: From Where We Are to Where We Go , 2017, IEEE Access.

[18]  Andrew Wilson,et al.  Pointing in Intelligent Environments with the WorldCursor , 2003, INTERACT.

[19]  Ricky Jacob,et al.  What’s up that Street? Exploring Streets Using a Haptic GeoWand , 2012 .

[20]  A. Dunser,et al.  CityViewAR: A mobile outdoor AR application for city visualization , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[21]  Junjun Yin,et al.  Mobile Visibility Querying for LBS , 2010, Trans. GIS.

[22]  Steven Strachan,et al.  Bearing-based selection in mobile spatial interaction , 2009, Personal and Ubiquitous Computing.

[23]  Martin Pielot,et al.  Towards an Objective Comparison of Scanning-Based Interaction Techniques , 2012, HAID.