Dedicated feature descriptor for outdoor augmented reality detection

Stable augmented reality applications consist of an accurate registration supported by a robust tracking module. In outdoor locations, the changing environmental and light conditions compromise this tracking. Reliable descriptors under unsettled conditions are essential for this process. The most used descriptors have this distinctive capacity, but computers and mobile devices process them in a long time frame. This paper investigates a new lightweight environment dedicated descriptor (EDD) trained with a machine-learning algorithm. The descriptor analyzes the scene characteristics with elements that can be computed fast and that have distinctive information about the selected area. The complete descriptor is used for semantic feature extraction with the aid of a trained random forest classifier. The descriptor is compared with the most popular descriptors—with respect to speed, accuracy, and invariance to illumination changes, scale, affine transformation, and rotation—and the results show that it is faster and in most cases equally reliable .

[1]  Vincent Lepetit,et al.  Fast Keypoint Recognition Using Random Ferns , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[3]  Joachim Denzler,et al.  A Fast Approach for Pixelwise Labeling of Facade Images , 2010, 2010 20th International Conference on Pattern Recognition.

[4]  Katsuya Kondo,et al.  SIFT feature reduction based on feature similarity of repeated patterns , 2013, 2013 International Symposium on Intelligent Signal Processing and Communication Systems.

[5]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[6]  Krystian Mikolajczyk,et al.  Evaluation of local detectors and descriptors for fast feature matching , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  Vincent Lepetit,et al.  TILDE: A Temporally Invariant Learned DEtector , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Ye Jihua,et al.  A face recognition algorithm based on LLE-SIFT feature descriptors , 2015, 2015 10th International Conference on Computer Science & Education (ICCSE).

[9]  Jitendra Malik,et al.  Parsing Images of Architectural Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Nian Cai,et al.  Efficient SIFT descriptor via color quantization , 2014, 2014 IEEE International Conference on Consumer Electronics - China.

[11]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[12]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[13]  Jing Li,et al.  A comprehensive review of current local features for computer vision , 2008, Neurocomputing.

[14]  Bin Fan,et al.  Local Intensity Order Pattern for feature description , 2011, 2011 International Conference on Computer Vision.

[15]  Luciano da Fontoura Costa,et al.  2D Euclidean distance transform algorithms: A comparative survey , 2008, CSUR.

[16]  Jun Wang,et al.  Efficient Euclidean distance transform using perpendicular bisector segmentation , 2011, CVPR 2011.

[17]  Yuxiang Xie,et al.  Survey of local invariant feature description , 2013, 2013 Chinese Automation Congress.

[18]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  J. Franklin,et al.  The elements of statistical learning: data mining, inference and prediction , 2005 .

[20]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[21]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yong Liu,et al.  LOIND: An illumination and scale invariant RGB-D descriptor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Luc Van Gool,et al.  Towards mass-produced building models , 2007 .

[26]  Jie Liu,et al.  I-BRIEF: A Fast Feature Point Descriptor with More Robust Features , 2011, 2011 Seventh International Conference on Signal Image Technology & Internet-Based Systems.

[27]  T. Guan,et al.  Registration Based on Scene Recognition and Natural Features Tracking Techniques for Wide-Area Augmented Reality Systems , 2009, IEEE Transactions on Multimedia.

[28]  Leibo Liu,et al.  A 181 GOPS AKAZE Accelerator Employing Discrete-Time Cellular Neural Networks for Real-Time Feature Extraction , 2015, Sensors.

[29]  Zhanyi Hu,et al.  Aggregating gradient distributions into intensity orders: A novel local image descriptor , 2011, CVPR 2011.

[30]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[31]  Hai Tao,et al.  A novel feature descriptor invariant to complex brightness changes , 2009, CVPR.

[32]  Gang Hua,et al.  Discriminative Learning of Local Image Descriptors , 1990, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[34]  Vincent Lepetit,et al.  On the relevance of sparsity for image classification , 2014, Comput. Vis. Image Underst..

[35]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[36]  Henning Lategahn,et al.  How to learn an illumination robust image feature for place recognition , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[37]  Chu.  Color Invariant SURF in Discriminative Object Tracking , 2010 .

[38]  Paul Newman,et al.  Scene Signatures: Localised and Point-less Features for Localisation , 2014, Robotics: Science and Systems.

[39]  Achim J. Lilienthal,et al.  SIFT, SURF & seasons: Appearance-based long-term localization in outdoor environments , 2010, Robotics Auton. Syst..