Multimedia for mobile environment: image enhanced navigation

As mobile systems (such as laptops and mobile telephones) continue growing, navigation assistance and location-based services are becoming increasingly important. Existing technology allow mobile users to access Internet services (e.g. email and web surfing), simple multimedia services (e.g. music and video clips), and make telephone calls. However, the potential of advanced multimedia services has not been fully developed, especially multimedia for navigation or location based services. At Purdue University, we are developing an image database, known as LAID, in which every image is annotated with its location, compass heading, acquisition time, and weather conditions. LAID can be used to study several types of navigation problems: A mobile user can take an image and transmit the image to the LAID sever. The server compares the image with the images stored in the database to determine where the user is located. We refer to this as the "forward" navigation problem. The second type of problem is to provide a "virtual tour on demand". A user inputs a starting and an ending addresses and LAID retrieves the images along a route that connects the two addresses. This is a generalization of route planning. Our database currently contains over 20000 images and covers approximately 25% of the city of West Lafayette, Indiana.

[1]  Joonhwan Lee,et al.  Studying the effectiveness of MOVE: a contextually optimized in-vehicle navigation system , 2005, CHI.

[2]  Christian Kray,et al.  Presenting route instructions on mobile devices , 2003, IUI '03.

[3]  Yang Chen.  Highway overhead structure detection using video image sequences , 2003, IEEE Trans. Intell. Transp. Syst..

[4]  R. Jirawimut,et al.  Visual odometer for pedestrian navigation , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[5]  Jarke J. van Wijk,et al.  A model for smooth viewing and navigation of large 2D information spaces , 2004, IEEE Transactions on Visualization and Computer Graphics.

[6]  Peter Ørbæk,et al.  Towards geo-spatial hypermedia: Concepts and prototype implementation , 2002, HYPERTEXT '02.

[7]  José M. F. Moura,et al.  Three-dimensional modeling from two-dimensional video , 2001, IEEE Trans. Image Process..

[8]  Avinash C. Kak,et al.  Person Tracking with a Mobile Robot using Two Uncalibrated Independently Moving Cameras , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  Ryosuke Shibasaki,et al.  A vehicle-borne urban 3-D acquisition system using single-row laser range scanners , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[10]  Savvas Nikiforou,et al.  Comparison of edge detection algorithms using a structure from motion task , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Catherine Plaisant,et al.  Navigation patterns and usability of zoomable user interfaces with and without an overview , 2002, TCHI.

[12]  Eiji Nakano,et al.  On robot self-navigation in outdoor environments by color image processing , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[13]  Yoshiaki Shirai,et al.  Toward vision-based intelligent navigator: its concept and prototype , 2002, IEEE Trans. Intell. Transp. Syst..

[14]  Mark D. Hickman,et al.  Methods of analyzing traffic imagery collected from aerial platforms , 2003, IEEE Trans. Intell. Transp. Syst..

[15]  John M. Carroll,et al.  Map-based navigation in a graphical MOO , 2002, CROS.

[16]  Alan Chalmers,et al.  Alternate feature location for rapid navigation using a 3D map on a mobile device , 2004, MUM '04.

[17]  Andreas Butz,et al.  The connected user interface: realizing a personal situated navigation service , 2004, IUI '04.

[18]  Sei-Wang Chen,et al.  Automatic license plate recognition , 2004, IEEE Transactions on Intelligent Transportation Systems.

[19]  Rainer Malaka,et al.  Multimodal interaction for pedestrians: an evaluation study , 2005, IUI '05.

[20]  Yang Li,et al.  Topiary: a tool for prototyping location-enhanced applications , 2004, UIST '04.

[21]  Yung-Hsiang Lu,et al.  Image-based location awareness and navigation: who cares? , 2004, 6th IEEE Southwest Symposium on Image Analysis and Interpretation, 2004..

[22]  Teija Vainio,et al.  Developing 3D information systems for mobile users: some usability issues , 2002, NordiCHI '02.

[23]  Lawrence O'Gorman,et al.  Practical Algorithms for Image Analysis: Description, Examples and Code , 2000 .

[24]  Joaquin Sitte,et al.  Active motion vision for distance estimation in autonomous mobile robots , 2004, IEEE Conference on Robotics, Automation and Mechatronics, 2004..

[25]  Wamadeva Balachandran,et al.  Visual odometer for pedestrian navigation , 2003, IEEE Trans. Instrum. Meas..

[26]  Edward J. Delp,et al.  An overview of problems in image-based location awareness and navigation , 2004, IS&T/SPIE Electronic Imaging.

[27]  Christopher Wilson,et al.  Mining GPS data to augment road models , 1999, KDD '99.

[28]  Petri Lankoski,et al.  What should it do?: key isssues in navigation interface design for small screen devices , 2002, CHI Extended Abstracts.

[29]  Sei-Wang Chen,et al.  Video stabilization for a camcorder mounted on a moving vehicle , 2004, IEEE Transactions on Vehicular Technology.

[30]  Wolfgang Wahlster,et al.  A resource-adaptive mobile navigation system , 2002, IUI '02.

[31]  Kentaro Toyama,et al.  Geographic location tags on digital images , 2003, ACM Multimedia.

[32]  Matt Jones,et al.  Navigation via continuously adapted music , 2005, CHI Extended Abstracts.

[33]  M. Xie,et al.  Depth assessment by using qualitative stereo-vision , 1997, 1997 IEEE International Conference on Intelligent Processing Systems (Cat. No.97TH8335).