One-click scanning of large-size documents using mobile phone camera

Currently mobile apps for document scanning do not provide convenient operations to tackle large-size documents. In this paper, we present a one-click scanning approach for large-size documents using mobile phone camera. After capturing a continuous video of documents, our approach automatically extracts several key frames by optical flow analysis. Then based on key frames, a mobile GPU based image stitching method is adopted to generate a completed document image with high details. There are no extra manual intervention in the process and experimental results show that our app performs well, showing convenience and practicability for daily life.

[1]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[2]  Sian Lun Lau,et al.  Movement recognition using the accelerometer in smartphones , 2010, 2010 Future Network & Mobile Summit.

[3]  Masakazu Iwamura,et al.  Camera-Based Document Analysis and Recognition , 2013, Lecture Notes in Computer Science.

[4]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[7]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[8]  Raja Bala,et al.  Mobile Video Capture of Multi-page Documents , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[10]  Koji Ishikawa,et al.  A method of analyzing the handling of paper documents in motion images , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[11]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[12]  Muhammad Muzzamil Luqman,et al.  Mobile Phone Camera-Based Video Scanning of Paper Documents , 2013, CBDAR.

[13]  Bo Jiang,et al.  Video-based document image scanning using a mobile device , 2015, 2015 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[14]  Xu Liu,et al.  Document Image Mosaicing with Mobile Phones , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[15]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[16]  Joseph R. Cavallaro,et al.  A fast and efficient sift detector using the mobile GPU , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.