A Hybrid Method for Objective Quality Assessment of Binary Images

In the paper, a novel hybrid method for an automatic quality assessment of binary images is proposed that may be useful, e.g., for computationally limited embedded systems or Optical Character Recognition applications. Since the quality of binary images used as the input for further image analysis strongly influences the obtained results, a reliable evaluation of their quality is a crucial element for the validation of such systems. Assuming the availability of several video frames, an objective quality assessment of individual video frames may also be helpful for the choice of a binarized image leading to the “best” final results. Nevertheless, most of the image quality assessment methods concern the analysis of grayscale or color images, utilizing the available image datasets containing numerous images subject to various distortions together with the corresponding subjective quality scores. Therefore, a reliable quality assessment of binary images is troublesome due to a small number of datasets and methods dedicated to binary images. The approach presented in the paper is based on the combination of one of such metrics, known as Border Distance, with some other methods, utilizing the nonlinear model based on the weighted sum and product of individual metrics. The experimental verification of the proposed hybrid metric conducted for the publicly available Bilevel Image Similarity Ground Truth Archive dataset leads to a significantly higher correlation with subjective quality scores in comparison to the other methods.

[1]  Ricardo da Silva Barboza,et al.  A Quality, Size and Time Assessment of the Binarization of Documents Photographed by Smartphones , 2023, J. Imaging.

[2]  Ricardo da Silva Barboza,et al.  Binarization of photographed documents image quality, processing time and size assessment , 2022, DocEng.

[3]  V. Lukin,et al.  Combined No-Reference Image Quality Metrics for Visual Quality Assessment Optimized for Remote Sensing Images , 2022, Applied Sciences.

[4]  V. Lukin,et al.  A Modified Algorithm of Visual Quality Providing in Lossy Compression of Remote Sensing Images , 2021, 2021 IEEE International Conference on Information and Telecommunication Technologies and Radio Electronics (UkrMiCo).

[5]  Mykhail M. Uss,et al.  Similarity Measure with Additional Modality Information for Multimodal Remote Sensing Images , 2021, 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS.

[6]  Karen O. Egiazarian,et al.  Color Image Database HTID for Verification of No-Reference Metrics: Peculiarities and Preliminary Results , 2021, 2021 9th European Workshop on Visual Information Processing (EUVIP).

[7]  Wei Xiong,et al.  An enhanced binarization framework for degraded historical document images , 2021, EURASIP J. Image Video Process..

[8]  Sam Kwong,et al.  A reference-free underwater image quality assessment metric in frequency domain , 2021, Signal Process. Image Commun..

[9]  Pooryaa Cheraaqee,et al.  Quality Assessment of Screen Content Images in Wavelet Domain , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Hantao Liu,et al.  CUID: A New Study Of Perceived Image Quality And Its Subjective Assessment , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[11]  Dietmar Saupe,et al.  Critical analysis on the reproducibility of visual quality assessment using deep features , 2020, PloS one.

[12]  Alan C. Bovik,et al.  Blind Image Quality Assessment for Super Resolution via Optimal Feature Selection , 2020, IEEE Access.

[13]  Usha Rani,et al.  Modified Sauvola binarization for degraded document images , 2020, Eng. Appl. Artif. Intell..

[14]  Le Yang,et al.  Modeling the Screen Content Image Quality via Multiscale Edge Attention Similarity , 2020, IEEE Transactions on Broadcasting.

[15]  Guangtao Zhai,et al.  Perceptual image quality assessment: a survey , 2020, Science China Information Sciences.

[16]  Dietmar Saupe,et al.  KonIQ-10k: An Ecologically Valid Database for Deep Learning of Blind Image Quality Assessment , 2019, IEEE Transactions on Image Processing.

[17]  Verónica Bolón-Canedo,et al.  Feature selection in image analysis: a survey , 2019, Artificial Intelligence Review.

[18]  Rajiv Soundararajan,et al.  Subjective and Objective Quality Assessment of Stitched Images for Virtual Reality , 2019, IEEE Transactions on Image Processing.

[19]  Nikolay N. Ponomarenko,et al.  Combined no-reference IQA metric and its performance analysis , 2019, Image Processing: Algorithms and Systems.

[20]  S. Kwong,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[21]  Lazaros T. Tsochatzidis,et al.  ICDAR 2019 Competition on Document Image Binarization (DIBCO 2019) , 2017, 2019 International Conference on Document Analysis and Recognition (ICDAR).

[22]  Mariusz Oszust,et al.  A Regression-Based Family of Measures for Full-Reference Image Quality Assessment , 2016 .

[23]  David L. Neuhoff,et al.  Similarity of Scenic Bilevel Images , 2016, IEEE Transactions on Image Processing.

[24]  Krzysztof Okarma,et al.  Prediction of the Optical Character Recognition Accuracy based on the Combined Assessment of Image Binarization Results , 2015 .

[25]  Nikolay N. Ponomarenko,et al.  Combining full-reference image visual quality metrics by neural network , 2015, Electronic Imaging.

[26]  David L. Neuhoff,et al.  Subjective similarity evaluation for scenic bilevel images , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  David L. Neuhoff,et al.  Objective similarity metrics for scenic bilevel images , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Mohamed Cheriet,et al.  An Efficient Ground Truthing Tool for Binarization of Historical Manuscripts , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[29]  Weisi Lin,et al.  Image Quality Assessment Using Multi-Method Fusion , 2013, IEEE Transactions on Image Processing.

[30]  I. Pratikakis,et al.  Performance Evaluation Methodology for Historical Document Image Binarization , 2013, IEEE Transactions on Image Processing.

[31]  Krzysztof Okarma,et al.  Combined image similarity index , 2012 .

[32]  Elisa H. Barney Smith,et al.  Effect of "Ground Truth" on Image Binarization , 2012, 2012 10th IAPR International Workshop on Document Analysis Systems.

[33]  Fan Zhang,et al.  A simple quality evaluation method of binary images based on Border Distance , 2011 .

[34]  Krzysztof Okarma,et al.  Combined Full-Reference Image Quality Metric Linearly Correlated with Subjective Assessment , 2010, ICAISC.

[35]  Mohamed Cheriet,et al.  A multi-scale framework for adaptive binarization of degraded document images , 2010, Pattern Recognit..

[36]  J.M. Ferryman,et al.  PETS Metrics: On-Line Performance Evaluation Service , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[37]  Haiping Lu,et al.  Distance-reciprocal distortion measure for binary document images , 2004, IEEE Signal Processing Letters.

[38]  Leida Li,et al.  An Underwater Image Quality Assessment Metric , 2022, IEEE Transactions on Multimedia.

[39]  Rafael Dueire Lins,et al.  ICDAR 2021 Competition on Time-Quality Document Image Binarization , 2021, ICDAR.

[40]  Annette Morales-González,et al.  Assessing the Relationship Between Binarization and OCR in the Context of Deep Learning-Based ID Document Analysis , 2021, IWAIPR.

[41]  Wenzhong Guo,et al.  2D and 3D Image Quality Assessment: A Survey of Metrics and Challenges , 2019, IEEE Access.

[42]  J. Astola,et al.  Image database TID 2013 : Peculiarities , results and perspectives , 2016 .

[43]  Krzysztof Okarma,et al.  Binary Image Quality Assessment - A Hybrid Approach Based on Binarization Evaluation Methods , 2016, CSOC.

[44]  Mariusz Oszust,et al.  Decision Fusion for Image Quality Assessment using an Optimization Approach , 2016, IEEE Signal Processing Letters.

[45]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..