Analysis of Image Quality for Image Fusion via Monotonic Correlation

This paper introduces a nonlinear correlation coefficient that exploits isotonic (or monotonic) regression. We refer to this correlation coefficient as the monotonic correlation (MC). This paper demonstrates how the MC scores the consistency between possible image quality (IQ) features and actual human performance, which is measured by a perception study. This paper also shows the relationship between the MC and the generalized likelihood ratio (GLR) test for the H 1 hypothesis that the IQ features are monotonically related to intrinsic human performance versus the null hypothesis that the relationship is arbitrary. Finally, the paper introduces a normalized GLR in order to assess the statistical significance of a high MC value. Using actual results from human perception experiments and the corresponding proposed IQ feature values for the imagery, the paper demonstrates how MC can identify worthy features that could be overlooked by traditional correlation values. The focus of the experiments center around the evaluation of IQ measures for image fusion applications.

[1]  J. Kalbfleisch.  Statistical Inference Under Order Restrictions , 1975 .

[2]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[3]  Allen M. Waxman,et al.  Color Night Vision: Opponent Processing in the Fusion of Visible and IR Imagery , 1997, Neural Networks.

[4]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[5]  Krzysztof Krawiec,et al.  Visual learning by coevolutionary feature synthesis , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[8]  Richard Alan Peters,et al.  Image Complexity Metrics for Automatic Target Recognizers , 1990 .

[9]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[10]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[11]  Richard K. Moore,et al.  Monotonic correlation analysis of image quality measures for image fusion , 2008, SPIE Defense + Commercial Sensing.

[12]  H. D. Brunk,et al.  AN EMPIRICAL DISTRIBUTION FUNCTION FOR SAMPLING WITH INCOMPLETE INFORMATION , 1955 .

[13]  Hung T. Nguyen,et al.  Probability for statistics , 1989 .

[14]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[15]  A. Lee Swindlehurst,et al.  IEEE Journal of Selected Topics in Signal Processing Inaugural Issue: [editor-in-chief's message] , 2007, J. Sel. Topics Signal Processing.

[16]  Rick S. Blum,et al.  On estimating the quality of noisy images , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[17]  Joseph A. O'Sullivan,et al.  Kullback-Leibler distances for quantifying clutter and models , 1999 .

[18]  Alexander Toet,et al.  Perceptual evaluation of different image fusion schemes , 2003 .

[19]  Anuj Srivastava,et al.  Probability Models for Clutter in Natural Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  O.O. Fadiran,et al.  A statistical approach to quantifying clutter in hyperspectral infrared images , 2006, 2006 IEEE Aerospace Conference.

[21]  Marshall Weathersby,et al.  Detection Performance in Clutter with Variable Resolution , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[22]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[23]  Anuj Srivastava,et al.  Universal Analytical Forms for Modeling Image Probabilities , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  R.S. Blum,et al.  Experimental tests of image fusion for night vision , 2005, 2005 7th International Conference on Information Fusion.

[25]  Michael J. Best,et al.  Active set algorithms for isotonic regression; A unifying framework , 1990, Math. Program..

[26]  R. Fisher.  The Advanced Theory of Statistics , 1943, Nature.

[27]  Kamesh Namuduri,et al.  Image metrics for clutter characterization , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[28]  Firooz Sadjadi,et al.  Comparative Image Fusion Analysais , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[29]  Colin E. Reese,et al.  Comparison of additive image fusion vs. feature-level image fusion techniques for enhanced night driving , 2003, SPIE Optics + Photonics.

[30]  Lance M. Kaplan.  Extended fractal analysis for texture classification and segmentation , 1999, IEEE Trans. Image Process..

[31]  Panos M. Pardalos,et al.  Algorithms for a Class of Isotonic Regression Problems , 1999, Algorithmica.

[32]  Honghua Chang,et al.  New metrics for clutter affecting human target acquisition , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[33]  Jianqi Zhang,et al.  New metrics for clutter affecting human target acquisition , 2006 .

[34]  Douglas F. Britton,et al.  Generalized Gaussian Decompositions for Image Analysis and Synthesis , 2006 .

[35]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[36]  P.K. Varshney,et al.  Imaging for concealed weapon detection: a tutorial overview of development in imaging sensors and processing , 2005, IEEE Signal Processing Magazine.

[37]  Gordon Pledger,et al.  On Consistency in Monotonic Regression , 1973 .

[38]  Alan Peters,et al.  Association and Auditory Cortices , 1985, Cerebral Cortex.

[39]  Grant R. Gerhart,et al.  A relative clutter metric , 1998 .

[40]  Rick S. Blum,et al.  A new automated quality assessment algorithm for image fusion , 2009, Image Vis. Comput..

[41]  Rick S. Blum,et al.  Multi-sensor image fusion and its applications , 2005 .

[42]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[43]  G. Piella.  New quality measures for image fusion , 2004 .

[44]  Pramod K. Varshney,et al.  A human perception inspired quality metric for image fusion based on regional information , 2007, Inf. Fusion.

[45]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[46]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[47]  E. G. Jones.  Cerebral Cortex , 1987, Cerebral Cortex.

[48]  Chris P. Tsokos,et al.  Mathematical Statistics with Applications , 2009 .