EgoViz - A Mobile Based Spatial Interaction System

This paper describes research carried out in the area of mobile spatial interaction and the development of a mobile (i.e. on-device) version of a simulated web-based 2D directional query processor. The TellMe application integrates location (from GPS, GSM, WiFi) and orientation (from digital compass/tilt sensors) sensing technologies into an enhanced spatial query processing module capable of exploiting a mobile device's position and orientation for querying real-world 3D spatial datasets. This paper outlines the technique used to combine these technologies and the architecture needed to deploy them on a sensor enabled smartphone (i.e. Nokia 6210 Navigator). With all these sensor technologies now available on one device, it is possible to employ a personal query system that can work effectively in any environment using location and orientation as primary parameters for directional queries. In doing so, novel approaches for determining a user's query space in 3 dimensions based on line-of-sight and 3D visibility (ego-visibility) are also investigated. The result is a mobile application that is location, direction and orientation aware and using these data is able to identify objects (e.g. buildings, points-of-interest, etc.) by pointing at them or when they are in a specified field-of-view.

[1]  Roderick Murray-Smith,et al.  Shoogle: excitatory multimodal interaction on mobile devices , 2007, CHI.

[2]  M. Benedikt,et al.  To Take Hold of Space: Isovists and Isovist Fields , 1979 .

[3]  Peter Fröhlich,et al.  The Point to Discover GeoWand , 2007 .

[4]  Thomas Grechenig,et al.  GeoPointing: evaluating the performance of orientation-aware location-based interaction under real-world conditions , 2008, J. Locat. Based Serv..

[5]  James D. Carswell,et al.  Wireless Positioning Techniques - A Developers Update , 2007, W2GIS.

[6]  Michael Rohs,et al.  Shamus - a Sensor-Based Integrated Mobile phone Instrument , 2007, ICMC.

[7]  James D. Carswell,et al.  An Open Source Approach to Wireless Positioning Techniques , 2007 .

[8]  Steven Strachan,et al.  Bearing-based selection in mobile spatial interaction , 2009, Personal and Ubiquitous Computing.

[9]  Peter Fröhlich,et al.  Comparing conceptual designs for mobile access to geo-spatial information , 2006, Mobile HCI.

[10]  Andrew Wilson,et al.  Pointing in Intelligent Environments with the WorldCursor , 2003, INTERACT.

[11]  Jane Yung-jen Hsu,et al.  Orientation-Aware Handhelds for Panorama-Based Museum Guiding System , 2004 .

[12]  James D. Carswell,et al.  Viewer-based directional querying for mobile applications , 2003, Fourth International Conference on Web Information Systems Engineering Workshops, 2003. Proceedings..

[13]  Peter Fröhlich,et al.  A mobile application framework for the geospatial web , 2007, WWW '07.

[14]  Petra Fagerberg,et al.  GeoNotes: A Location-Based Information System for Public Spaces , 2003, Designing Information Spaces.

[15]  Regina Dunlea.  Mobile Web Best Practices 1.0 10/05 , 2005 .

[16]  Bin Jiang,et al.  AxialGen: A Research Prototype for Automatically Generating the Axial Map , 2009, ArXiv.

[17]  Michela Bertolotto,et al.  Three-Dimensional Spatial Information Systems: State of the Art Review , 2009 .

[18]  Matt Jones,et al.  Point-to-GeoBlog: gestures and sensors to support user generated content creation , 2008, Mobile HCI.

[19]  Lynne Baillie,et al.  Rolling, rotating and imagining in a virtual mobile world , 2005, Mobile HCI.

[20]  Steven A. Shafer,et al.  XWand: UI for intelligent spaces , 2003, CHI '03.

[21]  James D. Carswell,et al.  Urban Location Based Services using Mobile Clients: the ICiNG Approach , 2007 .

[22]  Steven Strachan,et al.  Show me the way to Monte Carlo: density-based trajectory navigation , 2007, CHI.