What Size Window for Image Classification? A Cognitive Perspective

Windows are commonly used in digital image classification studies to define the local information content around a single pixel using a per-pixel classifier. Other studies use windows for characterizing the information content of a region, or group of pixels, in an area-based classifier. Research on identifying window size and shape properties, such as minimum, maximum, or optimum size of a window, is almost exclusively based on the results from automated classifications. Under the notably different hypothesis about optimum sizes of windows in automated classifications and approaches for determining such optimum window size, this article presents a cognitive approach for evaluating the functional relationship between window size and classification accuracy. Using human subjects, a randomized experimental design, and a continuum of window sizes, portions of digital aerial photographs were classified into urban land-use classes. Unlike ihe-findings from purely automated approaches, classification accuracv from visual analvsis increased in a monotonic form with &;easing window &ze for the urban land-use classes investigated. A minimum window size of 40 by 40 pixels (60-m by 60-m ground areal was required for classifying Level II urban land use using 1.5-m by 1.5-m resolution data (2 75 percent accuracy). This finding is dramatically different from the "ideal" window size range (i.e., 3 by 3 to 9 by 9) and functional relation between window size and classification accuracy found in automated per-pixel classifications. A theoretical curve depicting the relationship between classification accuracy and window size, spatial resolution, and classification specificity is presented.

[1]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[2]  S. Barr,et al.  INFERRING URBAN LAND USE FROM SATELLITE SENSOR IMAGES USING KERNEL-BASED SPATIAL RECLASSIFICATION , 1996 .

[3]  D. Roy,et al.  An empirical investigation of image resampling effects upon the spectral and textural supervised classification of a high spatial resolution multispectral image , 1996 .

[4]  C. Woodcock,et al.  Combining Spectral and Texture Data in the Segmentation of Remotely Sensed Images , 1996 .

[5]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[6]  A. Jones,et al.  The Land Cover Map of Great Britain: an automated classification of Landsat Thematic Mapper data , 1994 .

[7]  Peng Gong Reducing boundary effects in a kernel-based classifier , 1994 .

[8]  T. Fung,et al.  Spatial composition of spectral classes. A structural approach for image analysis of heterogeneous land-use and land-cover types , 1994 .

[9]  Pol Coppin,et al.  Satellite inventory of Minnesota forest resources , 1994 .

[10]  J. Schott,et al.  Resolution enhancement of multispectral image data to improve classification accuracy , 1993 .

[11]  S. Levin The problem of pattern and scale in ecology , 1992 .

[12]  W. Cohen,et al.  Estimating structural attributes of Douglas-fir/western hemlock forest stands from Landsat and SPOT imagery , 1992 .

[13]  Peng Gong,et al.  A comparison of spatial feature extraction algorithms for land-use classification with SPOT HRV data , 1992 .

[14]  Warren B. Cohen,et al.  Estimating structural attributes of Douglas-fir , 1992 .

[15]  D. Lanter,et al.  A research paradigm for propagating error in layer-based GIS , 1992 .

[16]  P. A. Agbu,et al.  Comparisons between spectral mapping units derived from SPOT imager texture and field soil map units , 1991 .

[17]  J. Greenfeld An operator-based matching system , 1991 .

[18]  D. Peddle,et al.  Image texture processing and data integration for surface pattern discrimination , 1991 .

[19]  Jeremy M Wolfe,et al.  Modeling the role of parallel processing in visual search , 1990, Cognitive Psychology.

[20]  P. Gong,et al.  The use of structural information for improving land-cover classification accuracies at the rural-urban fringe. , 1990 .

[21]  C. Harlow,et al.  Computational image interpretation models : an overview and a perspective , 1990 .

[22]  C. Tomlin Geographic information systems and cartographic modeling , 1990 .

[23]  Robert R. Hoffman,et al.  Psychological factors in remote sensing: A review of some recent research , 1989 .

[24]  C. Lundberg On the Structuration of Multiactivity Task-Environments , 1988 .

[25]  Pawel Lewicki,et al.  Acquisition of procedural knowledge about a pattern of stimuli that cannot be articulated , 1988, Cognitive Psychology.

[26]  P. O. Adeniyi,et al.  An enhanced classification approach to change detection in semi-arid environments , 1988 .

[27]  C. Woodcock,et al.  The factor of scale in remote sensing , 1987 .

[28]  John P. McDermott,et al.  Rule-Based Interpretation of Aerial Imagery , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Ray Harris Contextual classification post-processing of LANDSAT data using a probabilistic relaxation model , 1985 .

[30]  D. L. Murphy Estimating neighborhood variability with a binary comparison matrix. , 1985 .

[31]  Luciano Vieira Dutra,et al.  Some experiments with spatial feature extraction methods in multispectral classification , 1984 .

[32]  J. W. Merchant Using spatial logic in classification of Landsat TM data , 1984 .

[33]  Pat S. Chavez,et al.  An automatic pptimum kernel-size selection technique for edge enhancement , 1982 .

[34]  R. Welch,et al.  Spatial resolution requirements for urban studies , 1982 .

[35]  L. O. Harvey,et al.  Internal representation of visual texture as the basis for the judgment of similarity. , 1981, Journal of experimental psychology. Human perception and performance.

[36]  James R. Irons,et al.  Texture transforms of remote sensing data , 1981 .

[37]  Richard W. Conners,et al.  A Theoretical Comparison of Texture Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[39]  I. L. Thomas Spartially postprocessing of spectrally classified Landsat data. , 1980 .

[40]  J. R. Jensen SPECTRAL AND TEXTURAL FEATURES TO CLASSIFY ELUSIVE LAND COVER AT THE URBAN FRINGE , 1979 .

[41]  Judy M. Olson COGNITIVE CARTOGRAPHIC EXPERIMENTATION , 1979 .

[42]  James R. Anderson,et al.  A land use and land cover classification system for use with remote sensor data , 1976 .

[43]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[44]  R. M. Haralick,et al.  Textural features for image classification. IEEE Transaction on Systems, Man, and Cybernetics , 1973 .

[45]  Kirk H. Stone A GUIDE TO THE INTERPRETATION AND ANALYSIS OF AERIAL PHOTOS1 , 1964 .