Guest Editors' Introduction: Perceptual Organization in Computer Vision: Status, Challenges, and Potential

1 In a classic experiment, Smith [1] presented a perceptu random stimulus to subjects who were asked to reproduc The reproduced set was then used as a stimulus for a seco of subjects who were also asked to reproduce what they w shown. After about 12 cascades the final reproduction h definite structure to it. The subjects had (gradually) impo organization on an entirely random stimulus! The experim indicates the importance of organization in human percep The human visual system values organization to such a de that it attempts to find (or impose) it even when none actu exists. Clearly this heuristic behavior has evolved in a wo which, generally, is very much structured. By perceptual or nization we refer to this ability of a vision system to organ detected features, or primitives, in images based on for insta Gestaltic criteria. To put it another way, perceptual organiza can be defined as the ability to impose structural regularity sensory data, so as to group sensory primitives arising fro common underlying cause. This sort of organization then mits the formation of object hypotheses with minimal dom knowledge and, therefore, minimal restrictions. The importance of finding organization in sensory data long been recognized by researchers in human vision, espe the Gestalt psychologists. However, until relatively recently, roles of structure and organization have been minimal in c puter vision systems. Nevertheless, perceptual organizatio been identified as one of the insufficiently emphasized area computer vision, lying as it does in the “middle ground” betwe low-level and high-level processing. Early work in perceptual organization in computer visi dates back to Marr [2] (curvilinear groupings), Witkin a Tenenbaum [3], and Lowe [4]. It was then that the well-kno principle of nonaccidentalness, also known as the principl common cause or the coincidence explanation, was postu for perceptual organization. This principle states that it is hig unlikely for organized arrangements of image features to a by chance and hence, the occurrence of such is significant. S the work of Lowe, who showed that even simple organizatio such as parallel lines and rectangles, can drastically prun recognition search tree, there have been a number of cont tions that demonstrate the importance of perceptual organiz for various vision tasks, e.g., object recognition [5, 6], stereo ally e it. d set ere d a ed ent on. gree lly rld aze nce, ion on m a erin

[1]  Josef Kittler,et al.  Low-level Grouping of Straight Line Segments , 1991 .

[2]  Davi Geiger,et al.  Segmentation by grouping junctions , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[3]  Allen R. Hanson,et al.  Perceptual Completion of Occluded Surfaces , 1996, Comput. Vis. Image Underst..

[4]  Martin D. Levine,et al.  Geometric Primitive Extraction Using a Genetic Algorithm , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Rama Chellappa,et al.  Delineating buildings by grouping lines with MRFs , 1996, IEEE Trans. Image Process..

[6]  Kim L. Boyer,et al.  Integration, Inference, and Management of Spatial Information Using Bayesian Networks: Perceptual Organization , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Sudeep Sarkar,et al.  A Framework for Performance Characterization of Intermediate-Level Grouping Modules , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  S.W. Zucker,et al.  Fragment grouping via the principle of perceptual occlusion , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[9]  Steven W. Zucker,et al.  Computing Contour Closure , 1996, ECCV.

[10]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[11]  Linda G. Shapiro,et al.  3D matching using statistically significant groupings , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[12]  Kim L. Boyer,et al.  The Robust Sequential Estimator: A General Approach and its Application to Surface Organization in Range Data , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[14]  Tanveer Fathima Syeda-Mahmood,et al.  Data- and Model-Driven Selection Using Parallel Line Groups , 1997, Comput. Vis. Image Underst..

[15]  Thomas S. Huang,et al.  Salient structure analysis of fluid flow , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Kim L. Boyer,et al.  Perceptual organization in computer vision: a review and a proposal for a classificatory structure , 1993, IEEE Trans. Syst. Man Cybern..

[17]  C. Dyer,et al.  Dynamic Perceptual Organization Computing Spatiotemporal Relations for Dynamic Perceptual Organizationy , 1993 .

[18]  Robert B. Fisher From Surfaces to Objects: Computer Vision and Three Dimensional Scene Analysis , 1989 .

[19]  Narendra Ahuja,et al.  Extraction of early perceptual structure in dot patterns: Integrating region, boundary, and component gestalt , 1989, Comput. Vis. Graph. Image Process..

[20]  Geoff A. W. West,et al.  Segmenting curves into elliptic arcs and straight lines , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[21]  Andrea Salgian,et al.  A cubist approach to object recognition , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Ramakant Nevatia,et al.  Detection of buildings using perceptual grouping and shadows , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Kim L. Boyer,et al.  Quantitative Measures of Change Based on Feature Organization: Eigenvalues and Eigenvectors , 1998, Comput. Vis. Image Underst..

[24]  R. Nevatia,et al.  Shape description from imperfect and incomplete data , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[25]  J. Sklansky,et al.  Segmentation of people in motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[26]  J. McCafferty Human and machine vision: computing perceptual organisation , 1990 .

[27]  Olof Henricsson,et al.  The Role of Color Attributes and Similarity Grouping in 3-D Building Reconstruction , 1998, Comput. Vis. Image Underst..

[28]  Jitendra Malik,et al.  Finding objects in image databases by grouping , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[29]  S. Zucker Computational and Psychophysical Experiments in Grouping: Early Orientation Selection , 1983 .

[30]  Geoff A. W. West,et al.  Extracting surfaces of revolution by perceptual grouping of ellipses , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Steven W. Zucker,et al.  The Organization Of Curve Detection: Coarse Tangent Fields And Fine Spline Coverings , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[32]  A. Witkin,et al.  On the Role of Structure in Vision , 1983 .

[33]  Steven W. Zucker,et al.  Early orientation selection: Tangent fields and the dimensionality of their support , 1985, Comput. Vis. Graph. Image Process..

[34]  Jake K. Aggarwal,et al.  Line Correspondences from Cooperating Spatial and Temporal Grouping Processes for a Sequence of Images , 1997, Comput. Vis. Image Underst..

[35]  Charles R. Dyer,et al.  Computing spatiotemporal relations for dynamic perceptual organization , 1993 .

[36]  Radu Horaud,et al.  Figure-Ground Discrimination: A Combinatorial Optimization Approach , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  T. Pun,et al.  Asynchronous Perceptual Grouping: From Contours to Relevant 2-D Structures , 1997, Comput. Vis. Image Underst..

[38]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Laxmi Parida,et al.  Visual organization for figure/ground separation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Jiri Matas,et al.  Low-level Grouping of Straight Line Segments , 1991, BMVC.

[41]  Michael Lindenbaum,et al.  A Generic Grouping Algorithm and Its Quantitative Analysis , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  David W. Jacobs,et al.  Robust and Efficient Detection of Salient Convex Groups , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Sudeep Sarkar,et al.  Learning to form large groups of salient image features , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[44]  Mubarak Shah,et al.  Motion trajectories , 1993, IEEE Trans. Syst. Man Cybern..

[45]  Ramesh C. Jain,et al.  Vector field analysis for oriented patterns , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Kim L. Boyer,et al.  A Computational Structure for Preattentive Perceptual Organization: Graphical Enumeration and Voting Methods , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[47]  Steven W. Zucker Early orientation selection: tangent fields and the dimensionality of their support , 1986 .

[48]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1995, Neural Computation.

[49]  Jitendra Malik,et al.  Normalized Cut and Image Segmentation , 1997 .

[50]  Seth Hutchinson,et al.  A Probabilistic Approach to Perceptual Grouping , 1996, Comput. Vis. Image Underst..

[51]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[52]  Mubarak Shah,et al.  The trajectory primal sketch: a multi-scale scheme for representing motion characteristics , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.