Identifying books in library using line segment detector and contour clustering

In this paper, a new method is presented to automatically identify books based on recognition of call number label on the book spine captured by a smartphone in library. In previous methods for book spine segmentation, Canny edge detector results in curved or broken lines instead of detecting straight lines formed by book spine boundary. Moreover, line detection by Hough transform is prone to interference of texts on the book spine. We address these issues by employing color segmentation with line segment detector to separate every individual book. For call number extraction, characters on the label cannot be easily distinguished from texts like the title and author's name of the book. To solve this problem, we adopt contour clustering to group connected components of characters on the edge map according to their geometrical features. The experimental results demonstrate that our method is effective for the exaction and recognition of books used by existing automated library robotic systems or mobile devices.

[1]  H. Sakoe,et al.  BOUNDARY DETECTION FROM BOOKSHELF IMAGE BASED ON MODEL FITTING , .

[2]  Cheng-Hsin Hsu,et al.  Mobile augmented reality for books on a shelf , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[3]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Huizhong Chen,et al.  Combining image and text features: a hybrid approach to mobile book spine recognition , 2011, ACM Multimedia.

[5]  Gregory S. Chirikjian,et al.  An Enhanced Robotic Library System for an Off-Site Shelving Facility , 2003, FSR.

[6]  Yong Zhou,et al.  Automatic call number localization in color book images , 2005, J. Electronic Imaging.

[7]  Dah-Jye Lee,et al.  An Effective Color Addition to Feature Detection and Description for Book Spine Image Matching , 2012 .

[8]  Yuchou Chang,et al.  Matching book-spine images for library shelf-reading process automation , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[9]  Won-Ho Choi,et al.  A Framework for Recognition Books on Bookshelves , 2009, ICIC.

[10]  Alberto Del Bimbo,et al.  Proceedings of the international conference on Multimedia , 2010 .

[11]  Shin'ichi Yuta,et al.  Remote book browsing system using a mobile manipulator , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  Cheng-Hsin Hsu,et al.  Building book inventories using smartphones , 2010, ACM Multimedia.

[13]  R. Smith,et al.  An Overview of the Tesseract OCR Engine , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[14]  Shin'ichi Yuta,et al.  Book Extraction for Remote Book Browsing Robot , 2004, J. Robotics Mechatronics.

[15]  Angel P. del Pobil,et al.  The UJI librarian robot , 2008, Intell. Serv. Robotics.

[16]  Yonatan Wexler,et al.  Detecting text in natural scenes with stroke width transform , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.