Efficient, Edge-Aware, Combined Color Quantization and Dithering

In this paper, we present a novel algorithm to simultaneously accomplish color quantization and dithering of images. This is achieved by minimizing a perception-based cost function, which considers pixel-wise differences between filtered versions of the quantized image and the input image. We use edge aware filters in defining the cost function to avoid mixing colors on the opposite sides of an edge. The importance of each pixel is weighted according to its saliency. To rapidly minimize the cost function, we use a modified multi-scale iterative conditional mode (ICM) algorithm, which updates one pixel a time while keeping other pixels unchanged. As ICM is a local method, careful initialization is required to prevent termination at a local minimum far from the global one. To address this problem, we initialize ICM with a palette generated by a modified median-cut method. Compared with previous approaches, our method can produce high-quality results with a fewer visual artifacts but also requires significantly less computational effort.

[1]  Patrick Hébert,et al.  Median Filtering in Constant Time , 2007, IEEE Transactions on Image Processing.

[2]  Michael Gervautz,et al.  A simple method for color quantization: octree quantization , 1990 .

[3]  Shi-Min Hu,et al.  PoseShop: Human Image Database Construction and Personalized Content Synthesis , 2013, IEEE Transactions on Visualization and Computer Graphics.

[4]  Touradj Ebrahimi,et al.  Christopoulos: Thc Jpeg2000 Still Image Coding System: an Overview the Jpeg2000 Still Image Coding System: an Overview , 2022 .

[5]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Horst Bischof,et al.  Saliency driven total variation segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Zhigang Xiang,et al.  Color image quantization by minimizing the maximum intercluster distance , 1997, TOGS.

[8]  Michael T. Orchard,et al.  Color quantization of images , 1991, IEEE Trans. Signal Process..

[9]  Hua Huang,et al.  Efficient Structure-Aware Image Smoothingby Local Extrema on Space-Filling Curve , 2014, IEEE Transactions on Visualization and Computer Graphics.

[10]  Manuel Menezes de Oliveira Neto,et al.  Domain transform for edge-aware image and video processing , 2011, ACM Trans. Graph..

[11]  Vibhav Vineet,et al.  Efficient Salient Region Detection with Soft Image Abstraction , 2013, 2013 IEEE International Conference on Computer Vision.

[12]  Qingxiong Yang,et al.  Recursive Bilateral Filtering , 2012, ECCV.

[13]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Quan Wen,et al.  An effective real-time color quantization method based on divisive hierarchical clustering , 2012, Journal of Real-Time Image Processing.

[15]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[16]  Paul S. Heckbert Color image quantization for frame buffer display , 1982, SIGGRAPH.

[17]  Lale Akarun,et al.  Fuzzy algorithms for combined quantization and dithering , 2001, IEEE Trans. Image Process..

[18]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[19]  Xiaogang Jin,et al.  Structure-Aware Nonlocal Optimization Framework for Image Colorization , 2015, Journal of Computer Science and Technology.

[20]  Yuan Zhang,et al.  Perceptual image quality assessment metric using mutual information of Gabor features , 2013, Science China Information Sciences.

[21]  John F. Jarvis,et al.  A survey of techniques for the display of continuous tone pictures on bilevel displays , 1976 .

[22]  Lale Akarun,et al.  A fuzzy algorithm for color quantization of images , 2002, Pattern Recognit..

[23]  Anthony H. Dekker,et al.  Kohonen neural networks for optimal colour quantization , 1994 .

[24]  M. Emre Celebi,et al.  Improving the performance of k-means for color quantization , 2011, Image Vis. Comput..

[25]  Xiangchu Feng,et al.  Adaptive variational models for image decomposition , 2012, Science China Information Sciences.

[26]  Quan Wen,et al.  Colour quantisation using the adaptive distributing units algorithm , 2014 .

[27]  P. Scheunders,et al.  Joint quantisation and error diffusion of colour images using competitive learning , 1998 .

[28]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[29]  Lizhuang Ma,et al.  Edge-preserving image decomposition via joint weighted least squares , 2015, Computational Visual Media.

[30]  Andrew Adams,et al.  Fast High‐Dimensional Filtering Using the Permutohedral Lattice , 2010, Comput. Graph. Forum.

[31]  Joachim M. Buhmann,et al.  On spatial quantization of color images , 2000, IEEE Trans. Image Process..

[32]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.