Visual Nouns for Indoor/Outdoor Navigation

We propose a local orientation and navigation framework based on visual features that provide location recognition, context augmentation, and viewer localization information to a human user. Mosaics are used to map local areas to ease user navigation through streets and hallways, by providing a wider field of view (FOV) and the inclusion of more decisive features. Within the mosaics, we extract "visual noun" features. We consider 3 types of visual noun features: signage, visual-text, and visual-icons that we propose as a low-cost method for augmenting environments.

[1]  Eckehard G. Steinbach,et al.  Exploiting Text-Related Features for Content-based Image Retrieval , 2011, 2011 IEEE International Symposium on Multimedia.

[2]  Jizhong Xiao,et al.  Heterogeneous Multi-Robot Localization in Unknown 3D Space , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[4]  Zhigang Zhu,et al.  Fast Construction of Dynamic and Multi-Resolution 360 ° Panoramas from Video Sequences ( Revised-September 14 , 2005 ) , 2005 .

[5]  Shuihua Wang,et al.  Indoor signage detection based on saliency map and bipartite graph matching , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[6]  Huizhong Chen,et al.  Robust text detection in natural images with edge-enhanced Maximally Stable Extremal Regions , 2011, 2011 18th IEEE International Conference on Image Processing.

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Thomas S. Huang,et al.  Multimodal Surveillance: an Introduction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Allen R. Hanson,et al.  Keeping smart, omnidirectional eyes on you [adaptive panoramic stereovision] , 2004, IEEE Robotics & Automation Magazine.

[10]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[11]  Frédéric Labrosse,et al.  Visual local navigation using warped panoramic images , 2006 .

[12]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Jizhong Xiao,et al.  Self-localization of a heterogeneous multi-robot team in constrained 3D space , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Per-Erik Forssén,et al.  Maximally Stable Colour Regions for Recognition and Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Jiang Yu Zheng Digital Route Panoramas , 2003, IEEE Multim..