A New 4D-RGB Mapping Technique for Field-Based High-Throughput Phenotyping

In this paper, we proposed the use of Infrared Thermography (IRT) along with multiview, visible imaging technology to monitor plants 24/7 and to better understand their behavior in response to different biotic and/or abiotic stresses. The proposed method uses a high-throughput plant phenotyping platform previously developed by the authors: in special an observation tower that collects data throughout the growing season. Stereo RGB and Thermal images are used to create 4D-RGB models of the canopy: i.e. their 3D appearance with temperature and texture information. We evaluate the accuracy of our thermal projection using quantitative and qualitative analysis and the results show high spatial consistency between appearance and temperature. The usefulness of our proposed 4D-RGB point cloud is demonstrated for two test cases: 1) over various days during the growing season; and 2) over various hours throughout the daytime.

[1]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Griffiths G. Atungulu,et al.  Impacts of storage temperature and rice moisture content on color characteristics of rice from fields with different disease management practices , 2018, Journal of Stored Products Research.

[3]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[4]  Guilherme N. DeSouza,et al.  Vinobot and vinoculer: from real to simulated platforms , 2018, Commercial + Scientific Sensing and Imaging.

[5]  Benjamin S. Hornsby,et al.  High-resolution infrared thermography for capturing wildland fire behaviour: RxCADRE 2012 , 2016 .

[6]  H. Jones,et al.  Thermal infrared imaging of crop canopies for the remote diagnosis and quantification of plant responses to water stress in the field. , 2009, Functional plant biology : FPB.

[7]  D. Jayas,et al.  Applications of Thermal Imaging in Agriculture and Food Industry—A Review , 2011 .

[8]  Mohammadreza Aghaei,et al.  FAULT INSPECTION BY AERIAL INFRARED THERMOGRAPHY IN A PV PLANT AFTER A METEOROLOGICAL TSUNAMI , 2018 .

[9]  H. Jones,et al.  Infra-Red Thermography as a High-Throughput Tool for Field Phenotyping , 2014 .

[10]  B. Mistele,et al.  Thermal phenotyping of stomatal sensitivity in spring barley , 2017 .

[11]  Tor Arne Johansen,et al.  A ligth-weight thermal camera payload with georeferencing capabilities for small fixed-wing UAVs , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[12]  Andreas Nüchter,et al.  Thermal 3D Mapping of Building Façades , 2012, IAS.

[13]  Michael Bosse,et al.  3D thermal mapping of building interiors using an RGB-D and thermal camera , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Avinash C. Kak,et al.  An world-independent approach for the calibration of mobile robotics active stereo heads , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[16]  I. Guerrero,et al.  Thermographic survey of two rural buildings in Spain , 2004 .

[17]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[18]  H. Jones,et al.  Monitoring and screening plant populations with combined thermal and chlorophyll fluorescence imaging. , 2007, Journal of experimental botany.

[19]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  Senem Velipasalar,et al.  Heat Mapping Drones: An Autonomous Computer-Vision-Based Procedure for Building Envelope Inspection Using Unmanned Aerial Systems (UAS) , 2018 .

[21]  Giovanni Maria Carlomagno,et al.  Infrared Thermography: Recent Advances And Future Trends , 2018 .

[22]  Ian B. Stewart,et al.  A Comparison between Conductive and Infrared Devices for Measuring Mean Skin Temperature at Rest, during Exercise in the Heat, and Recovery , 2015, PloS one.

[23]  Hong Zheng,et al.  Automatic Crowd Detection Based on Unmanned Aerial Vehicle Thermal Imagery , 2017 .

[24]  John P. Fulton,et al.  An overview of current and potential applications of thermal remote sensing in precision agriculture , 2017, Comput. Electron. Agric..

[25]  Anna Vladova Stoynova,et al.  Infrared survey in electrical preventive maintenance , 2017, 2017 XXVI International Scientific Conference Electronics (ET).

[26]  Soteris A. Kalogirou,et al.  Infrared thermography (IRT) applications for building diagnostics: A review , 2014 .

[27]  Xinkai Wu,et al.  Pedestrian Detection and Tracking from Low-Resolution Unmanned Aerial Vehicle Thermal Imagery , 2016, Sensors.

[28]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Simon Bennertz,et al.  Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[30]  Guilherme N. DeSouza,et al.  Vinobot and Vinoculer: Two Robotic Platforms for High-Throughput Field Phenotyping , 2017, Sensors.

[31]  H. Jones,et al.  New phenotyping methods for screening wheat and barley for beneficial responses to water deficit. , 2010, Journal of experimental botany.