Planogram Compliance Checking Based on Detection of Recurring Patterns

In this article, the authors propose a novel method for automatic planogram compliance checking in retail chains that doesn't require product template images for training. Product layout is extracted from an input image by means of unsupervised recurring pattern detection and matched via graph matching, with the expected product layout specified by a planogram to measure the level of compliance. A divide-and-conquer strategy is employed to improve the speed. Specifically, the input image is divided into several regions based on the planogram. Recurring patterns are detected in each region, respectively, and then merged together to estimate the product layout.

[1]  Alexei A. Efros,et al.  Discovering object categories in image collections , 2005 .

[2]  Jianbo Shi,et al.  Image Matching via Saliency Region Correspondences , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Mauricio G. C. Resende,et al.  Greedy Randomized Adaptive Search Procedures , 1995, J. Glob. Optim..

[4]  조민수,et al.  Unsupervised Detection and Segmentation of Identical Objects , 2010 .

[5]  Andrew Blake,et al.  Cosegmentation of Image Pairs by Histogram Matching - Incorporating a Global Constraint into MRFs , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Shimon Ullman,et al.  Unsupervised Classification and Part Localization by Consistency Amplification , 2008, ECCV.

[7]  Xing Xie,et al.  Spatial pyramid mining for logo detection in natural scenes , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[8]  Nicole Vincent,et al.  How to Use SIFT Vectors to Analyze an Image with Database Templates , 2007, Adaptive Multimedia Retrieval.

[9]  Minsu Cho,et al.  Feature correspondence and deformable object matching via agglomerative correspondence clustering , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Ruigang Yang,et al.  Unsupervised learning of high-order structural semantics from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Gül Varol,et al.  Toward retail product recognition on grocery shelves , 2015, International Conference on Graphic and Image Processing.

[12]  Andreas Nürnberger,et al.  Adaptive Multimedia Retrieval: Retrieval, User, and Semantics , 2008 .

[13]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Serge J. Belongie,et al.  Toward real-time grocery detection for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[15]  Kyoung Mu Lee,et al.  Unsupervised detection and segmentation of identical objects , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Song Liu,et al.  Planogram Compliance Checking Using Recurring Patterns , 2015, 2015 IEEE International Symposium on Multimedia (ISM).

[17]  Yanxi Liu,et al.  GRASP Recurring Patterns from a Single View , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Ying Wu,et al.  Spatial Random Partition for Common Visual Pattern Discovery , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[19]  Shuicheng Yan,et al.  Common visual pattern discovery via spatially coherent correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Minsu Cho,et al.  Co-recognition of Image Pairs by Data-Driven Monte Carlo Image Exploration , 2008, ECCV.