R-MSSIM: image quality assessment while performing object detection

As deep learning continues to mature, researchers have increasingly turned to deep neural network to process object detection in images. While the accuracy of object detection continues to increase, researchers can analyze object features in images better. Image quality assessment is an important research topic in computer vision. When analyzing and processing images, it will lead to more computing overhead if different tasks are performed separately. It can save computing overhead that combining object detection and quality assessment. In order to process quality assessment better while detecting object and to improve the efficiency of image processing, we introduce R-MSSIM, a new system of image quality assessment stronger based on region proposal and structural similarity measure. R-MSSIM can improves the performance of classical algorithms greatly based on object detection. R-MSSIM fits the features of local regions to the final mean opinion score(MOS) while detecting region proposals in an image, which makes the interpretability of image quality assessment stronger. Finally, we prove that our method has a large performance improvement compared with the classical algorithm through a series of experiments, and achieved relatively good performance.

[1]  Fei Gao,et al.  DeepSim: Deep similarity for image quality assessment , 2017, Neurocomputing.

[2]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[4]  Miriam Bellver,et al.  Hierarchical Object Detection with Deep Reinforcement Learning , 2016, NIPS 2016.

[5]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[6]  Alan C. Bovik,et al.  Objective quality assessment of multiply distorted images , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[7]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[13]  Tingting Jiang,et al.  From image quality to patch quality: An Image-Patch Model for No-Reference image quality assessment , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).