A Logo-Based Approach for Recognising Multiple Products on a Shelf

This paper addresses detecting, localizing and recognizing various grocery products in retail store images. Our object recognition algorithm achieves this goal using just one image per product for training, assuming that the category of the products (like cereals, rice, etc.) is known. This algorithm uses logo detection as a precursor to product recognition. So, the first step involves detecting and classifying products, at a broader level, based on their brands. The second step is the finer classification step for recognizing and localizing the exact product label, which involves using colour information. This hierarchical approach limits the confusion in classifying similar looking products and outperforms product recognition that was implemented without logo detection. The algorithm was tested on 80 annotated grocery shelf images containing 238 different products that fall under 3 categories. This facilitates smarter inventory management in retail stores on a large scale and on a day to day basis for the visually impaired people.

[1]  Michael J. Swain,et al.  Indexing via color histograms , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[2]  Serge J. Belongie,et al.  Toward real-time grocery detection for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[3]  Tess Winlock ShelfScanner: Toward real-time detection of groceries for the visually impaired , 2010 .

[4]  D. Lowe,et al.  Fast Matching of Binary Features , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[5]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[6]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[8]  Wen Gao,et al.  Finding Multiple Object Instances with Occlusion , 2010, 2010 20th International Conference on Pattern Recognition.

[9]  Siddhartha S. Srinivasa,et al.  Object recognition and full pose registration from a single image for robotic manipulation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Michael J. Black,et al.  Robust Principal Component Analysis for Computer Vision , 2001, ICCV.

[11]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[12]  Christian Floerkemeier,et al.  Recognizing Products: A Per-exemplar Multi-label Image Classification Approach , 2014, ECCV.

[13]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[14]  Marcin Skoczylas Detection of positions and recognition of brand logos visible on images captured using mobile devices , 2014, 2014 International Conference and Exposition on Electrical and Power Engineering (EPE).

[15]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .