TouchPaper: an augmented reality application with cloud-based image recognition service

Augmented reality applications are increasingly used to enhance physical objects with digital information. In this paper, we present a TouchPaper system that consists of a mobile application and a cloud-based image recognition service. Through an authoring system, images can be linked to online content that will be invoked when a printed version of the image is captured and "touched" on a mobile phone screen. We describe a sBIP (Structured Binary Intensity Pattern) algorithm that performs the matching of the images and evaluate the performance of the overall TouchPaper system.

[1]  Richard I. Hartley,et al.  Optimised KD-trees for fast image descriptor matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  Hai Tao,et al.  A novel feature descriptor invariant to complex brightness changes , 2009, CVPR.

[4]  Karen Sparck Jones.  A statistical interpretation of term specificity and its application in retrieval , 1972 .

[5]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[6]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[7]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Karen Spärck Jones.  A statistical interpretation of term specificity and its application in retrieval , 2021, J. Documentation.

[9]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[11]  Lynn Wilcox,et al.  Embedded media markers: marks on paper that signify associated media , 2010, IUI '10.

[12]  Shih-Fu Chang,et al.  Mobile product search with Bag of Hash Bits and boundary reranking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.