Automated Counting Grains on the Rice Panicle Based on Deep Learning Method

Grain number per rice panicle, which directly determines grain yield, is an important agronomic trait for rice breeding and yield-related research. However, manually counting grains of rice per panicle is time-consuming, laborious, and error-prone. In this research, a grain detection model was proposed to automatically recognize and count grains on primary branches of a rice panicle. The model used image analysis based on deep learning convolutional neural network (CNN), by integrating the feature pyramid network (FPN) into the faster R-CNN network. The performance of the grain detection model was compared to that of the original faster R-CNN model and the SSD model, and it was found that the grain detection model was more reliable and accurate. The accuracy of the grain detection model was not affected by the lighting condition in which images of rice primary branches were taken. The model worked well for all rice branches with various numbers of grains. Through applying the grain detection model to images of fresh and dry branches, it was found that the model performance was not affected by the grain moisture conditions. The overall accuracy of the grain detection model was 99.4%. Results demonstrated that the model was accurate, reliable, and suitable for detecting grains of rice panicles with various conditions.

[1]  Umair Ashraf,et al.  Exploring the Relationships Between Yield and Yield-Related Traits for Rice Varieties Released in China From 1978 to 2017 , 2019, Front. Plant Sci..

[2]  Saeed Khaki,et al.  Convolutional Neural Networks for Image-Based Corn Kernel Detection and Counting , 2020, Sensors.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Stefano Bianchi,et al.  Seed-per-pod estimation for plant breeding using deep learning , 2018, Comput. Electron. Agric..

[5]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Seishi Ninomiya,et al.  Automatic estimation of heading date of paddy rice using deep learning , 2019, Plant Methods.

[7]  Meng Zhang,et al.  Development of a drought stress-resistant rice restorer line through Oryza sativa–rufipogon hybridization , 2019, Journal of Genetics.

[8]  Lingfeng Duan,et al.  A novel machine-vision-based facility for the automatic evaluation of yield-related traits in rice , 2011, Plant Methods.

[9]  A. Anjos,et al.  P-TRAP: a Panicle Trait Phenotyping tool , 2013, BMC Plant Biology.

[10]  Long Qi,et al.  Segmentation and counting algorithm for touching hybrid rice grains , 2019, Comput. Electron. Agric..

[11]  H. K. Mebatsion,et al.  A Fourier analysis based algorithm to separate touching kernels in digital images , 2011 .

[12]  Hamid Laga,et al.  Detection and analysis of wheat spikes using Convolutional Neural Networks , 2018, Plant Methods.

[13]  Muhammad Ahsan,et al.  Correlation and Cluster Analysis of Some Yield and Yield Related Traits in Rice (Oryza Sativa) , 2013 .

[14]  Yi-nian Li,et al.  A method for estimating spikelet number per panicle: Integrating image analysis and a 5-point calibration model , 2015, Scientific Reports.

[15]  Lisa M. Smith,et al.  A Rice Transcription Factor Controls Grain Length through Cell Number , 2019, Plant Physiology.

[16]  Qingming Luo,et al.  Original paper: Fast discrimination and counting of filled/unfilled rice spikelets based on bi-modal imaging , 2011 .

[17]  Yong He,et al.  A novel matching algorithm for splitting touching rice kernels based on contour curvature analysis , 2014 .

[18]  Tao Liu,et al.  Image analysis-based recognition and quantification of grain number per panicle in rice , 2019, Plant Methods.

[19]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[20]  Gynheung An,et al.  Mutation of ONAC096 Enhances Grain Yield by Increasing Panicle Number and Delaying Leaf Senescence during Grain Filling in Rice , 2019, International journal of molecular sciences.

[21]  Zheng Yuan,et al.  Image-Based On-Panicle Rice [Oryza sativa L.] Grain Counting with a Prior Edge Wavelet Correction Model , 2018, Agronomy.

[22]  Ping Wang,et al.  Leaf Counting with Multi-Scale Convolutional Neural Network Features and Fisher Vector Coding , 2019, Symmetry.