FARES: Fast and Accurate Recognition of Exact Scenes on Mobile Devices

Mobile devices represented by smartphones have been continuously evolving to support various applications. In this paper, we study a new mobile application, named exact scene recognition, where a user can identify a particular place by comparing two images taken there. This application framework enables users to annotate a scene supporting more descriptive image-based interactions such as mobile augmented-reality applications. We enhance the regular approaches with the assistance of the angle-of-view (AOV) information obtained from the smartphone. Our experimental results show a significant improvement on accuracy compared to the existing solutions.

[1]  Jungwon Lee,et al.  Fused DNN: A Deep Neural Network Fusion Approach to Fast and Robust Pedestrian Detection , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[2]  Pietro Perona,et al.  Evaluation of Features Detectors and Descriptors Based on 3D Objects , 2005, ICCV.

[3]  Shuicheng Yan,et al.  Hybrid CNN and Dictionary-Based Models for Scene Recognition and Domain Adaptation , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Fei-Fei Li,et al.  Spatially Coherent Latent Topic Model for Concurrent Segmentation and Classification of Objects and Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Achim J. Lilienthal,et al.  SIFT, SURF & seasons: Appearance-based long-term localization in outdoor environments , 2010, Robotics Auton. Syst..

[7]  Jiwen Lu,et al.  Scene recognition with objectness , 2018, Pattern Recognit..

[8]  Bo Sheng,et al.  EDOS: Edge Assisted Offloading System for Mobile Devices , 2017, 2017 26th International Conference on Computer Communication and Networks (ICCCN).

[9]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[10]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[11]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[12]  Justin Manweiler,et al.  OverLay: Practical Mobile Augmented Reality , 2015, MobiSys.

[13]  Jinhui Tang,et al.  Hand-Crafted Features or Machine Learnt Features? Together They Improve RGB-D Object Recognition , 2014, 2014 IEEE International Symposium on Multimedia.

[14]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[15]  Luis Herranz,et al.  Scene Recognition with CNNs: Objects, Scales and Dataset Bias , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[17]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[18]  Stephen J. McKenna,et al.  University of Dundee Gland segmentation in colon histology images using hand-crafted features and convolutional neural networks , 2016 .