Automated leaf movement tracking in time-lapse imaging for plant phenotyping

Abstract The analysis of the rhythm of leaf movement is a simple yet effective method to quantify the impacts of external (e.g. abiotic stress) and/or internal (e.g. gene mutations) perturbations on plant growth. We developed an automated monitoring system to quantify leaf movement using time-lapse imaging and a subsequent leaf-tracking algorithm. The leaf-tracking algorithm was based on dense optical flow algorithm to directly record temporal motion events. The algorithm measures motion directly, rather than detecting leaf or cotyledon tip in every image, so multiple leaves, including occluded leaves, can be measured simultaneously. To test the monitoring system, wild-type and drought-tolerant mutant genotypes of Arabidopsis (Arabidopsis thaliana) were subjected to a combinatorial two water and two nitrogen levels. High-frequency time-lapse images were acquired from top view for little over 6 consecutive days at a frequency of 4 min. Results showed that nitrogen and water treatments elicited differences in mean plant displacement in both genotypes. It also showed significant differences among the two different genotypes in the mean displacement when plants were under water or nitrogen stress. These results confirmed the new monitoring system’s ability to discern environmental and genotypic differences in plant response.

[1]  G. Meyer,et al.  Verification of color vegetation indices for automated crop imaging applications , 2008 .

[2]  A. Krapp,et al.  Plant nitrogen assimilation and its regulation: a complex puzzle with missing pieces. , 2015, Current opinion in plant biology.

[3]  Michael J. Black,et al.  A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them , 2013, International Journal of Computer Vision.

[4]  M. Stephens EDF Statistics for Goodness of Fit and Some Comparisons , 1974 .

[5]  K. Miura,et al.  The Arabidopsis GTL1 Transcription Factor Regulates Water Use Efficiency and Drought Tolerance by Modulating Stomatal Density via Transrepression of SDD1[W][OA] , 2010, Plant Cell.

[6]  Naser El-Sheimy,et al.  A New Vegetation Segmentation Approach for Cropped Fields Based on Threshold Detection from Hue Histograms , 2018, Sensors.

[7]  Puneet Singla,et al.  Evaluation of advanced Lukas–Kanade optical flow on thoracic 4D-CT , 2013, Journal of Clinical Monitoring and Computing.

[8]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[9]  E. Brookner Tracking and Kalman Filtering Made Easy , 1998 .

[10]  Martin Straume,et al.  Least-Squares Analysis of Fluorescence Data , 2002 .

[11]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[12]  Remus Brad,et al.  Optimal Filter Estimation for Lucas-Kanade Optical Flow , 2012, Sensors.

[13]  C Robertson McClung,et al.  CIRCADIAN RHYTHMS IN PLANTS. , 2003, Annual review of plant physiology and plant molecular biology.

[14]  Joachim Weickert,et al.  Dense versus Sparse Approaches for Estimating the Fundamental Matrix , 2011, International Journal of Computer Vision.

[15]  Wenyu Yang,et al.  The Influence of Light Intensity and Leaf Movement on Photosynthesis Characteristics and Carbon Balance of Soybean , 2019, Front. Plant Sci..

[16]  Yongliang Ma,et al.  An object tracking algorithm based on optical flow and temporal–spatial context , 2019, Cluster Computing.

[17]  C. Robertson McClung,et al.  Plant Circadian Rhythms , 2006, The Plant Cell Online.

[18]  Andrew J. Millar,et al.  Strengths and Limitations of Period Estimation Methods for Circadian Data , 2014, PloS one.

[19]  Claudio Pastenes,et al.  Leaf movements and photoinhibition in relation to water stress in field-grown beans. , 2004, Journal of experimental botany.

[20]  Gerd Patrick Bienert,et al.  The plasma membrane aquaporin NtAQP1 is a key component of the leaf unfolding mechanism in tobacco. , 2004, The Plant journal : for cell and molecular biology.

[21]  Wenyu Yang,et al.  Shade Inhibits Leaf Size by Controlling Cell Proliferation and Enlargement in Soybean , 2017, Scientific Reports.

[22]  Wenyu Yang,et al.  Auxin-to-Gibberellin Ratio as a Signal for Light Intensity and Quality in Regulating Soybean Growth and Matter Partitioning , 2018, Front. Plant Sci..

[23]  Wiebe Nijland,et al.  Using excess greenness and green chromatic coordinate colour indices from aerial images to assess lodgepole pine vigour, mortality and disease occurrence , 2016 .

[24]  Michael J. Black,et al.  Learning Optical Flow , 2008, ECCV.

[25]  Shai Avidan,et al.  Support vector tracking , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Guihong Bi,et al.  Effects of Irrigation Frequency and Nitrogen Fertilizer Rate on Water Stress, Nitrogen Uptake, and Plant Growth of Container-grown Rhododendron , 2011 .

[27]  Xiaolu Yang,et al.  An Improved Median-based Otsu Image Thresholding Algorithm , 2012 .

[28]  Menachem Moshelion,et al.  Plasma Membrane Aquaporins in the Motor Cells of Samanea saman , 2002, The Plant Cell Online.

[29]  Kuo-Chin Fan,et al.  Estimating Optical Flow by Integrating Multi-Frame Information , 2008, J. Inf. Sci. Eng..

[30]  Andrew J. Millar,et al.  Detection and resolution of genetic loci affecting circadian period in Brassica oleracea , 2007, Theoretical and Applied Genetics.

[31]  Ishwar K. Sethi,et al.  Feature Point Correspondence in the Presence of Occlusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[33]  Olivia W. Wilkins,et al.  Time of day shapes Arabidopsis drought transcriptomes. , 2010, The Plant journal : for cell and molecular biology.

[34]  M. Ishiura,et al.  Large-scale screening of Arabidopsis circadian clock mutants by a high-throughput real-time bioluminescence monitoring system. , 2004, The Plant journal : for cell and molecular biology.

[35]  Hai Tao,et al.  Object Tracking with Bayesian Estimation of Dynamic Layer Representations , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Isabelle A. Carré,et al.  Circadian regulation of abiotic stress tolerance in plants , 2015, Front. Plant Sci..

[37]  R. Green,et al.  Regulation of output from the plant circadian clock , 2007, The FEBS journal.

[38]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[39]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Q. Guo,et al.  Fast nastic motion of plants and bioinspired structures , 2015, Journal of The Royal Society Interface.

[41]  David J. Fleet,et al.  Computing Optical Flow with Physical Models of Brightness Variation , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Yanqun Li,et al.  Effects of light intensity on leaf photosynthetic characteristics, chloroplast structure, and alkaloid content of Mahonia bodinieri (Gagnep.) Laferr. , 2016, Acta Physiologiae Plantarum.