Calibration of hyperspectral close-range pushbroom cameras for plant phenotyping

Abstract Hyperspectral sensors are able to detect biological processes of plants which are invisible to the naked eye. Close-range cameras in particular support the identification of biotic and abiotic stress reactions at an early stage. Up to now, their full potential is only partially realized because geometrical factors as leaf angle, curvature and self-shading, overlay the signal of biological processes. Suitable 3D plant models constitutes an important step to removing these factors from the data. The matching of these 3D model and the hyperspectral image with sufficient accuracy even for small leaf veins is required but relies on an adequate geometric calibration of hyperspectral cameras. We present a method for the geometric calibration of hyperspectral pushbroom cameras in the close-range, which enables reliable and reproducible results at sub-pixel scale. This approach extends the linear pushbroom camera by the ability to model non-linear fractions. Accuracy and reproducibility of the method is validated using a hyperspectral senor system with two line cameras observing the reflected radiation in the spectral range from 400 to 2500 nm. We point out new potentials arising from with the proposed camera calibration, e.g. hyperspectral 3D plant models, which have high potential for crop plant phenotyping.

[1]  W. Verhoef,et al.  PROSPECT+SAIL models: A review of use for vegetation characterization , 2009 .

[2]  Ayan Chakrabarti,et al.  Statistics of real-world hyperspectral images , 2011, CVPR 2011.

[3]  Donald B. Gennery,et al.  Generalized Camera Calibration Including Fish-Eye Lenses , 2006, International Journal of Computer Vision.

[4]  F. Rottensteiner,et al.  A generic pushbroom sensor model for high-resolution satellite imagery applied to SPOT5, Quickbird and ALOS data sets , 2007 .

[5]  T. J. Rivlin The Chebyshev polynomials , 1974 .

[6]  Simone Gasparini,et al.  Camera Models and Fundamental Concepts Used in Geometric Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[7]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[8]  W. R. Windham,et al.  A Hyperspectral Imaging System for Identification of Faecal and Ingesta Contamination on Poultry Carcasses , 2003 .

[9]  Kristian Kersting,et al.  Hyperspectral phenotyping on the microscopic scale: towards automated characterization of plant-pathogen interactions , 2015, Plant Methods.

[10]  Juho Kannala,et al.  Geometric Camera Calibration , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[11]  Steven M. de Jong,et al.  The spectral response of Buxus sempervirens to different types of environmental stress – A laboratory experiment , 2012 .

[12]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[13]  Bostjan Likar,et al.  Geometric calibration of a hyperspectral imaging system. , 2010, Applied optics.

[14]  Todd E. Zickler,et al.  A coaxial optical scanner for synchronous acquisition of 3D geometry and surface reflectance , 2010, SIGGRAPH 2010.

[15]  S. Jacquemoud,et al.  Leaf BRDF measurements and model for specular and diffuse components differentiation , 2005 .

[16]  Seema Singh,et al.  Understanding tissue specific compositions of bioenergy feedstocks through hyperspectral Raman imaging , 2011, Biotechnology and bioengineering.

[17]  J. Léon,et al.  High-precision laser scanning system for capturing 3D plant architecture and analysing growth of cereal plants , 2014 .

[18]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[19]  Rajiv Gupta,et al.  Linear pushbroom cameras , 1997 .

[20]  B. Andrieu,et al.  Functional-structural plant modelling: a new versatile tool in crop science. , 2010, Journal of experimental botany.

[21]  T. Clarke,et al.  The Development of Camera Calibration Methods and Models , 1998 .

[22]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[23]  V Sturm,et al.  Correction of spatial distortion in MR imaging: a prerequisite for accurate stereotaxy. , 1987, Journal of computer assisted tomography.

[24]  David J. Harding,et al.  Amazon forests maintain consistent canopy structure and greenness during the dry season , 2014, Nature.

[25]  Gerhard Buck-Sorlin,et al.  PART OF A SPECIAL ISSUE ON GROWTH AND ARCHITECTURAL MODELLING A functional-structural model of rice linking quantitative genetic information with morphological development and physiological processes , 2011 .

[26]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[27]  Paul Geladi,et al.  Techniques and applications of hyperspectral image analysis , 2007 .

[28]  A. Huete,et al.  MODIS VEGETATION INDEX ( MOD 13 ) ALGORITHM THEORETICAL BASIS DOCUMENT Version 3 . 1 Principal Investigators , 1999 .

[29]  Bunkei Matsushita,et al.  Sensitivity of the Enhanced Vegetation Index (EVI) and Normalized Difference Vegetation Index (NDVI) to Topographic Effects: A Case Study in High-Density Cypress Forest , 2007, Sensors.

[30]  Thierry Toutin,et al.  Review of developments in geometric modelling for high resolution satellite pushbroom sensors , 2012 .

[31]  Patrick Hostert,et al.  Simulation of Multitemporal and Hyperspectral Vegetation Canopy Bidirectional Reflectance Using Detailed Virtual 3-D Canopy Models , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[33]  Heiner Kuhlmann,et al.  Surface feature based classification of plant organs from 3D laserscanned point clouds for plant phenotyping , 2013, BMC Bioinformatics.

[34]  Robert M. Haralick,et al.  Review and analysis of solutions of the three point perspective pose estimation problem , 1994, International Journal of Computer Vision.

[35]  J. G. Lyon,et al.  Hyperspectral Remote Sensing of Vegetation , 2011 .

[36]  Jim Antonisse,et al.  Image georegistration methods: A framework for application guidelines , 2013, 2013 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[37]  Radu Horaud,et al.  On single-scanline camera calibration , 1993, IEEE Trans. Robotics Autom..

[38]  A. Walter,et al.  Plant phenotyping: from bean weighing to image analysis , 2015, Plant Methods.

[39]  R. Bessudo,et al.  The ENVISAT Medium Resolution Imaging Spectrometer (MERIS) , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[40]  L. Plümer,et al.  Detection of early plant stress responses in hyperspectral images , 2014 .

[41]  A. Bradley,et al.  Theory and measurement of ocular chromatic aberration , 1990, Vision Research.

[42]  Manuel A. Aguilar,et al.  Assessing geometric accuracy of the orthorectification process from GeoEye-1 and WorldView-2 panchromatic images , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[43]  Manfred Schroeder,et al.  Geometric in-flight calibration of the stereoscopic line-CCD scanner MOMS-2P , 2000 .

[44]  Glenn Healey,et al.  Radiometric CCD camera calibration and noise estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  P. Thenkabail,et al.  Hyperspectral Vegetation Indices and Their Relationships with Agricultural Crop Characteristics , 2000 .

[46]  Anne-Katrin Mahlein,et al.  Recent advances in sensing plant diseases for precision crop protection , 2012, European Journal of Plant Pathology.

[47]  Lutz Plümer,et al.  Low-Cost 3D Systems: Suitable Tools for Plant Phenotyping , 2014, Sensors.

[48]  N. Broge,et al.  Comparing prediction power and stability of broadband and hyperspectral vegetation indices for estimation of green leaf area index and canopy chlorophyll density , 2001 .

[49]  Gerd Hirzinger,et al.  Stereo Vision Based Reconstruction of Huge Urban Areas from an Airborne Pushbroom Camera (HRSC) , 2005, DAGM-Symposium.

[50]  W. R. Windham,et al.  CALIBRATION OF A PUSHBROOM HYPERSPECTRAL IMAGING SYSTEM FOR AGRICULTURAL INSPECTION , 2003 .

[51]  J. R. Jensen Remote Sensing of the Environment: An Earth Resource Perspective , 2000 .

[52]  Th. Schäfer,et al.  Deformation Measurement Using Terrestrial Laser Scanning at the Hydropower Station of Gabcikovo , 2004 .