Validation of a large area land cover product using purpose-acquired airborne video

Abstract Large area land cover products generated from remotely sensed data are difficult to validate in a timely and cost effective manner. As a result, pre-existing data are often used for validation. Temporal, spatial, and attribute differences between the land cover product and pre-existing validation data can result in inconclusive depictions of map accuracy. This approach may therefore misrepresent the true accuracy of the land cover product, as well as the accuracy of the validation data, which is not assumed to be without error. Hence, purpose-acquired validation data is preferred; however, logistical constraints often preclude its use — especially for large area land cover products. Airborne digital video provides a cost-effective tool for collecting purpose-acquired validation data over large areas. An operational trial was conducted, involving the collection of airborne video for the validation of a 31,000 km2 sub-sample of the Canadian large area Earth Observation for Sustainable Development of Forests (EOSD) land cover map (Vancouver Island, British Columbia, Canada). In this trial, one form of agreement between the EOSD product and the airborne video data was defined as a match between the mode land cover class of a 3 by 3 pixel neighbourhood surrounding the sample pixel and the primary or secondary choice of land cover for the interpreted video. This scenario produced the highest level of overall accuracy at 77% for level 4 of classification hierarchy (13 classes). The coniferous treed class, which represented 71% of Vancouver Island, had an estimated user's accuracy of 86%. Purpose acquired video was found to be a useful and cost-effective data source for validation of the EOSD land cover product. The impact of using multiple interpreters was also tested and documented. Improvements to the sampling and response designs that emerged from this trial will benefit a full-scale accuracy assessment of the EOSD product and also provides insights for other regional and global land cover mapping programs.

[1]  G. Woodwell,et al.  Map of the vegetation of South America based on satellite imagery , 1994 .

[2]  Paul L. Patterson,et al.  Classification accuracy for stratification with remotely sensed data , 2003 .

[3]  J. Townshend,et al.  Global land cover classi(cid:142) cation at 1 km spatial resolution using a classi(cid:142) cation tree approach , 2004 .

[4]  Kenneth L. Driese,et al.  A digital land cover map of Wyoming, USA: a tool for vegetation analysis , 1997 .

[5]  S. Mitchell,et al.  Use of vector polygons for the accuracy assessment of pixel-based land cover maps , 2006 .

[6]  Ronald J. Hall,et al.  Operational mapping of the land cover of the forested area of Canada with Landsat data: EOSD land cover program , 2003 .

[7]  Douglas E Meisner,et al.  Fundamentals of airborne video remote sensing , 1986 .

[8]  Geir-Harald Strand,et al.  The effect of field experience on the accuracy of identifying land cover types in aerial photographs , 2002 .

[9]  Martin Herold,et al.  A joint initiative for harmonization and validation of land cover datasets , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Ross S. Lunetta,et al.  Remote Sensing and GIS Accuracy Assessment , 2007 .

[11]  Tom Bobbe,et al.  Georeferenced Airborne Video Imagery: Natural Resource Applications on the Tongass , 1993 .

[12]  R. Congalton,et al.  A pilot study evaluating ground reference data collection efforts for use in forest inventory , 1992 .

[13]  Frédéric Baret,et al.  Developments in the 'validation' of satellite sensor products for the study of the land surface , 2000 .

[14]  Potential of airborne video for updating forest maps , 1996 .

[15]  D. Roberts,et al.  Sources of error in accuracy assessment of thematic land-cover maps in the Brazilian Amazon , 2004 .

[16]  Limin Yang,et al.  Development of a global land cover characteristics database and IGBP DISCover from 1 km AVHRR data , 2000 .

[17]  M. Gillis Canada's National Forest Inventory (Responding to Current Information Needs) , 2001, Environmental monitoring and assessment.

[18]  G. B. Groom,et al.  The Land Cover Map of Great Britain , 1993 .

[19]  Andrew K. Skidmore,et al.  Remotely sensed estimation of forest canopy density: A comparison of the performance of four methods , 2006 .

[20]  William G. Cochran,et al.  Sampling Techniques, 3rd Edition , 1963 .

[21]  James H. Everitt,et al.  Airborne videography : current status and future perspectives , 1992 .

[22]  R. Hall,et al.  Discrimination of conifer height, age and crown closure classes using Landsat-5 TM imagery in the Canadian Northwest Territories , 2003 .

[23]  Stephen V. Stehman,et al.  Design and Analysis for Thematic Map Accuracy Assessment: Fundamental Principles , 1998 .

[24]  J. L. Walsh,et al.  Evaluation of airborne video data for land-cover classification accuracy assessment in an isolated Brazilian forest , 1994 .

[25]  Limin Yang,et al.  An analysis of the IGBP global land-cover characterization process , 1999 .

[26]  Michael A. Wulder,et al.  An accuracy assessment framework for large‐area land cover classification products derived from medium‐resolution satellite data , 2006 .

[27]  Stuart E. Marsh,et al.  Assessing the Accuracy of Satellite-Derived Land-Cover Classification Using Historical Aerial Photography, Digital Orthophoto Quadrangles, and Airborne Video Data , 2004 .

[28]  Peter M. Atkinson,et al.  Defining an optimal size of support for remote sensing investigations , 1995, IEEE Trans. Geosci. Remote. Sens..

[29]  J. Wickham,et al.  Thematic accuracy of the 1992 National Land-Cover Data for the eastern United States: Statistical methodology and regional results , 2003 .

[30]  D. Meidinger,et al.  Ecosystems of British Columbia , 1991 .

[31]  D. Meidinger,et al.  Revision of biogeoclimatic units of coastal British Columbia , 1991 .

[32]  Stephen V. Stehman,et al.  Introduction to special issue on map accuracy , 2003, Environmental and Ecological Statistics.

[33]  M. Wulder,et al.  Spatially Partitioning Canada with the Landsat Worldwide Referencing System , 2001 .

[34]  A. Belward,et al.  The international geosphere biosphere programme data and information system global land cover data set (DIScover) , 1997 .

[35]  D. E. Escobar,et al.  A multiband video system for quick assessment of vegetal condition and discrimination of plant species. , 1985 .

[36]  C. Justice,et al.  A framework for the validation of MODIS Land products , 2002 .

[37]  Jesslyn F. Brown,et al.  Development of a land-cover characteristics database for the conterminous U.S. , 1991 .

[38]  Debby Beardsley,et al.  Using a mensuration approach with FIA vegetation plot data to assess the accuracy of tree size and crown closure classes in a vegetation map of northeastern California. , 2000 .

[39]  Dana Slaymaker,et al.  Using Georeferenced Large-Scale Aerial Videography as a Surrogate for Ground Validation Data , 2003 .

[40]  J. Asanuma,et al.  Land surface identification near Yakutsk in eastern Siberia using video images taken from a hedgehopping aircraft , 2004 .

[41]  Ruiliang Pu,et al.  Crown closure estimation of oak savannah in a dry season with Landsat TM imagery: Comparison of various indices through correlation analysis , 2003 .

[42]  D. Jacobs February 1994 ice storm: forest resource damage assessment in northern Mississippi , 2000 .

[43]  D. King Airborne Multispectral Digital Camera and Video Sensors: A Critical Review of System Designs and Applications , 1995 .

[44]  John W. Holt,et al.  Geocoded digital videography for validation of land cover mapping in the Amazon basin , 2002 .

[45]  A. Jones,et al.  The Land Cover Map of Great Britain: an automated classification of Landsat Thematic Mapper data , 1994 .

[46]  D. Jacobs,et al.  AIRBORNE VIDEOGRAPHY AND GPS FOR ASSESSMENT OF FOREST DAMAGE IN SOUTHERN LOUISIANA FROM HURRICANE ANDREW , 1993 .

[47]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[48]  R. Pu,et al.  EO‐1 Hyperion, ALI and Landsat 7 ETM+ data comparison for estimating forest crown closure and leaf area index , 2005 .

[49]  Scott Mitchell,et al.  Integration of forest inventory and satellite imagery:: a Canadian status assessment and research issues , 2005 .

[50]  L. Graham Airborne video for near-real-time vegetation mapping , 1993 .

[51]  J. Cihlar Land cover mapping of large areas from satellites: Status and research priorities , 2000 .

[52]  S. Drake,et al.  Visual Interpretation of Vegetation Classes from Airborne Videography: An Evaluation of Observer Proficiency with Minimal Training , 1993 .

[53]  R. D. Ramsey,et al.  Landscape Cover-Type Modeling Using a Multi-Scene Thematic Mapper Mosaic , 1997 .

[54]  S. Franklin,et al.  Remote sensing of forest environments : concepts and case studies , 2003 .

[55]  M. Norton-Griffiths Aerial Point Sampling for Land Use Surveys , 1988 .

[56]  R. G. Wright,et al.  GAP ANALYSIS: A GEOGRAPHIC APPROACH TO PROTECTION OF BIOLOGICAL DIVERSITY , 1993 .