Using scale space filtering to make thinning algorithms robust against noise in sketch images

We apply scale space filtering to thinning of binary sketch images by introducing a framework for making thinning algorithms robust against noise. Our framework derives multiple representations of an input image within multiple scales of filtering. Then, the filtering scale that gives the best trade-off between noise removal and shape distortion is selected. The scale selection is done using a performance measure that detects extra artifacts (redundant branches and lines) caused by noise and shape distortions introduced by high amount of filtering. In other words, our contribution is an adaptive preprocessing, in which various thinning algorithms can be used, and which task is to estimate automatically the optimal amount of filtering to deliver a neat thinning result. Experiments using five state-of-the-art thinning algorithms, as the framework’s thinning stage, show that robustness against various types of noise was achieved. They are mainly contour noise, scratch, and dithers. In addition, application of the framework in sketch matching shows its usefulness as a preprocessing and normalization step that improves matching performances.

[1]  John M. Weiss Grayscale Thinning , 2002, Computers and Their Applications.

[2]  Yung-Sheng Chen Hidden Deletable Pixel Detection Using Vector Analysis in Parallel Thinning to Obtain Bias-Reduced Skeletons , 1998, Comput. Vis. Image Underst..

[3]  T. Lindeberg,et al.  Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[4]  Keisuke Kameyama,et al.  Towards making thinning algorithms robust against noise in sketch images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[5]  Edward K. Wong,et al.  Scale-space approach to image thinning using the most prominent ridge line in the image pyramid data structure , 1998, Electronic Imaging.

[6]  Fred Stentiford,et al.  Some new heuristics for thinning binary handprinted characters for OCR , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Chong Wang,et al.  Off-line Chinese signature verification based on support vector machines , 2005, Pattern Recognit. Lett..

[8]  Yoshiki Kumagai,et al.  Query-by-Sketch Image Retrieval Using Edge Relation Histogram , 2013, MVA.

[9]  Zicheng Guo,et al.  Parallel thinning with two-subiteration algorithms , 1989, Commun. ACM.

[10]  Jie Tian,et al.  Image enhancement and minutiae matching in fingerprint verification , 2003, Pattern Recognit. Lett..

[11]  Roland T. Chin,et al.  One-Pass Parallel Thinning: Analysis, Properties, and Quantitative Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[13]  Toshikazu Kato,et al.  A sketch retrieval method for full color image database-query by visual example , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[14]  Yung-Sheng Chen,et al.  Thinning approach for noisy digital patterns , 1996, Pattern Recognit..

[15]  Fen Zhang,et al.  An improved parallel thinning algorithm with two subiterations , 2008 .

[16]  Tsuhan Chen,et al.  Trademark retrieval using contour-skeleton stroke classification , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[17]  Kuo-Chin Fan,et al.  Extraction of characters from form documents by feature point clustering , 1995, Pattern Recognit. Lett..

[18]  Gian Luca Marcialis,et al.  Fingerprint verification by fusion of optical and capacitive sensors , 2004, Pattern Recognit. Lett..

[19]  Ebroul Izquierdo,et al.  Large Scale Sketch Based Image Retrieval Using Patch Hashing , 2012, ISVC.

[20]  Guoliang Fan,et al.  An efficient algorithm for extraction of anatomical structures in retinal images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[21]  Ching Y. Suen,et al.  An Evaluation of Parallel Thinning Algorithms for Character Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Ruowei Zhou,et al.  A novel single-pass thinning algorithm and an effective set of performance criteria , 1995, Pattern Recognit. Lett..

[23]  Houssem Chatbri,et al.  Sketch-based image retrieval by shape points description in support regions , 2013, 2013 20th International Conference on Systems, Signals and Image Processing (IWSSIP).

[24]  Keisuke Kameyama,et al.  An adaptive thinning algorithm for sketch images based on Gaussian Scale Space , 2012 .

[25]  Roman M. Palenichka,et al.  Multi-scale model-based skeletonization of object shapes using self-organizing maps , 2002, Object recognition supported by user interaction for service robots.

[26]  Abdolah Chalechale,et al.  Sketch-based image matching Using Angular partitioning , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[28]  Bhabatosh Chanda,et al.  Writer-independent off-line signature verification using surroundedness feature , 2012, Pattern Recognit. Lett..

[29]  Arnaldo de Albuquerque Araújo,et al.  Video segmentation based on 2D image analysis , 2003, Pattern Recognit. Lett..

[30]  Ching Y. Suen,et al.  Thinning Methodologies - A Comprehensive Survey , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Lei Huang,et al.  An improved parallel thinning algorithm , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[32]  Josef Kittler,et al.  Efficient and Robust Retrieval by Shape Content through Curvature Scale Space , 1998, Image Databases and Multi-Media Search.

[33]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[34]  Mariano Fons,et al.  Fingerprint Image Processing Acceleration Through Run-Time Reconfigurable Hardware , 2010, IEEE Transactions on Circuits and Systems II: Express Briefs.

[35]  Nikolaos Papanikolopoulos,et al.  Determining the skeletal description of sparse shapes , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[36]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[37]  David S. Doermann,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Signature Detection and Matching , 2022 .

[38]  Ching Y. Suen,et al.  Evaluation of thinning algorithms from an OCR viewpoint , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[39]  Jinhai Cai,et al.  Robust Filtering-Based Thinning Algorithm for Pattern Recognition , 2012, Comput. J..

[40]  Carlo Arcelli,et al.  Pattern thinning by contour tracing , 1981 .

[41]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[42]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .