TouchPaper: making print interactive

Traditional printed materials such as photobooks and collages are static in that the information conveyed is unchanging and limited to what was printed. In this paper, we describe an online service for augmenting prints with rich media by using image recognition. A print can have multiple hotspots with each one linking to different content on the web (e.g. Facebook, Youtube video, animations, etc.). When a print is viewed through a mobile device, it is automatically recognized and the interactive hot regions are highlighted on the screen. The user can click regions of interest to link to relevant content on the web. This technology significantly enhances the potential for personalization and interaction and ultimately the end user experience and the value of the prints. As an example application, we leverage our Facebook auto-photobook application to automatically create interactive links for each photo in a page. The user can easily view additional content such as photo comments for each photo through the augmentation mechanism.

[1]  Shih-Fu Chang,et al.  Mobile product search with Bag of Hash Bits and boundary reranking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Hai Tao,et al.  A novel feature descriptor invariant to complex brightness changes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Lynn Wilcox,et al.  Embedded media marker: linking multimedia to paper , 2010, ACM Multimedia.

[4]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[6]  Berna Erol,et al.  HOTPAPER demonstration: multimedia interaction with paper using mobile phones , 2008, ACM Multimedia.

[7]  Tobias Jaeggli,et al.  Kooaba interactive posters , 2011, MM '11.

[8]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..