Real-Time Knowledge-Based Processing of Images: Application of the Online NLPM Method to Perceptual Visual Analysis

Perceptual analysis is an interesting topic in the field of image processing, and can be considered a missing link between image processing and human vision. Of the various forms of perception, one of the most important and best known is shape perception. In this paper, a framework based on the online nonlocal patch means (NLPM) method is developed, which is designed to infer possible perceptual observations of an input image using the knowledge images provided. Thanks to the speed of online NLPM, the proposed method can simulate the transformation of the input image to the final perceptual image in real time. In order to improve the performance of the method, a hidden chain series is considered for the model that delivers faster convergence. The capability of the method is evaluated on several well-known perceptual examples.

[1]  C. Spence,et al.  Visual dominance and attention: The Colavita effect revisited , 2007, Perception & psychophysics.

[2]  Ronen Basri,et al.  Shape representation and classification using the Poisson equation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[3]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[4]  W. Köhler.  Gestalt psychology , 1967 .

[5]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Avideh Zakhor,et al.  Automatic registration of aerial imagery with untextured 3D LiDAR models , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Nariman Farvardin,et al.  A perceptually motivated three-component image model-Part I: description of the model , 1995, IEEE Trans. Image Process..

[9]  J. Tenenbaum,et al.  Probabilistic models of cognition: exploring representations and inductive biases , 2010, Trends in Cognitive Sciences.

[10]  Rui Hu,et al.  Gradient field descriptor for sketch based retrieval and localization , 2010, 2010 IEEE International Conference on Image Processing.

[11]  Mohamed Cheriet,et al.  Beyond pixels and regions: A non-local patch means (NLPM) method for content-level restoration, enhancement, and reconstruction of degraded document images , 2011, Pattern Recognit..

[12]  Adam Krzyzak,et al.  Rotation invariant pattern recognition using ridgelets, wavelet cycle-spinning and Fourier features , 2005, Pattern Recognit..

[13]  Wei Ji Ma,et al.  Optimal inference of sameness , 2012, Proceedings of the National Academy of Sciences.

[14]  Lu Wang,et al.  A robust approach for automatic registration of aerial images with untextured aerial LiDAR data , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Dirk Bartz,et al.  The Role of Perception for Computer Graphics , 2008, Eurographics.

[16]  A. Pouget,et al.  Behavior and neural basis of near-optimal visual search , 2011, Nature Neuroscience.

[17]  Derek R. Magee,et al.  Detecting lameness using 'Re-sampling Condensation' and 'multi-stream cyclic hidden Markov models' , 2002, Image Vis. Comput..

[18]  R. Gregory,et al.  Border Locking and the Café Wall Illusion , 1979, Perception.

[19]  Chi-Keung Tang,et al.  Image repairing: robust image synthesis by adaptive ND tensor voting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[20]  Tolga Tasdizen,et al.  Principal Neighborhood Dictionaries for Nonlocal Means Image Denoising , 2009, IEEE Transactions on Image Processing.

[21]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[22]  Marc Alexa,et al.  A descriptor for large scale image retrieval based on sketched feature lines , 2009, SBIM '09.

[23]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Heiko Neumann,et al.  Iterated tensor voting and curvature improvement , 2007, Signal Process..

[25]  Tomaso Poggio,et al.  Intracellular measurements of spatial integration and the MAX operation in complex cells of the cat primary visual cortex. , 2004, Journal of neurophysiology.

[26]  Gérard G. Medioni,et al.  Inferring global perceptual contours from local features , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[27]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[28]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Gérard G. Medioni,et al.  Curvature-Augmented Tensor Voting for Shape Inference from Noisy 3D Data , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  P. Fletcher,et al.  Seeing other minds: attributed mental states influence perception , 2010, Trends in Cognitive Sciences.

[31]  Chi-Keung Tang,et al.  Robust estimation of adaptive tensors of curvature by tensor voting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Mohamed Cheriet,et al.  A multi-scale framework for adaptive binarization of degraded document images , 2010, Pattern Recognit..

[33]  Trevor Heath.  Observation, Perception and Education , 1980 .

[34]  Marcus Gallagher,et al.  Learning to play Pac-Man: an evolutionary, rule-based approach , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[35]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[38]  Min-Seok Choi,et al.  A novel two stage template matching method for rotation and illumination invariance , 2002, Pattern Recognit..

[39]  Xiao Bai,et al.  In Search of Perceptually Salient Groupings , 2011, IEEE Transactions on Image Processing.

[40]  A Yonas,et al.  What's in a shape? Children represent shape variability differently than adults when naming objects. , 2001, Journal of experimental child psychology.

[41]  Bahram Parvin,et al.  Iterative Tensor Voting for Perceptual Grouping of Ill-Defined Curvilinear Structures , 2011, IEEE Transactions on Medical Imaging.

[42]  Leonidas A. A. Doumas,et al.  A Computational Account of the Development of the Generalization of Shape Information , 2010, Cogn. Sci..

[43]  Daniel J. Kersten,et al.  Object Perception: Generative Image Models and Bayesian Inference , 2002, Biologically Motivated Computer Vision.

[44]  T. Mondal,et al.  An Accelerated Approach of Template Matching for Rotation, Scale and Illumination Invariance , 2011 .

[45]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[46]  Jianying Hu,et al.  Extraction of perceptually important colors and similarity measurement for image matching, retrieval and analysis , 2002, IEEE Trans. Image Process..

[47]  Francesc J. Ferri,et al.  Regularization operators for natural images based on nonlinear perception models , 2006, IEEE Transactions on Image Processing.

[48]  Aleksandra Mojsilovic,et al.  Adaptive perceptual color-texture image segmentation , 2005, IEEE Transactions on Image Processing.

[49]  Chi-Keung Tang,et al.  A Computational Framework for Feature Extraction and Segmentation , 2000 .

[50]  Nicolai Petkov,et al.  Contour detection based on nonclassical receptive field inhibition , 2003, IEEE Trans. Image Process..

[51]  Liora Linchevski,et al.  To see or not to see: analyzing difficulties in geometry from the perspective of visual perception , 2010 .

[52]  A. Mack,et al.  The dissociation of position and extent in Müller-Lyer figures , 1985, Perception & psychophysics.