A High-Resolution Spatial and Time-Series Labeled Unmanned Aerial Vehicle Image Dataset for Middle-Season Rice

The existing remote sensing image datasets target the identification of objects, features, or man-made targets but lack the ability to provide the date and spatial information for the same feature in the time-series images. The spatial and temporal information is important for machine learning methods so that networks can be trained to support precision classification, particularly for agricultural applications of specific crops with distinct phenological growth stages. In this paper, we built a high-resolution unmanned aerial vehicle (UAV) image dataset for middle-season rice. We scheduled the UAV data acquisition in five villages of Hubei Province for three years, including 11 or 13 growing stages in each year that were accompanied by the annual agricultural surveying business. We investigated the accuracy of the vector maps for each field block and the precise information regarding the crops in the field by surveying each village and periodically arranging the UAV flight tasks on a weekly basis during the phenological stages. Subsequently, we developed a method to generate the samples automatically. Finally, we built a high-resolution UAV image dataset, including over 500,000 samples with the location and phenological growth stage information, and employed the imagery dataset in several machine learning algorithms for classification. We performed two exams to test our dataset. First, we used four classical deep learning networks for the fine classification of spatial and temporal information. Second, we used typical models to test the land cover on our dataset and compared this with the UCMerced Land Use Dataset and RSSCN7 Dataset. The results showed that the proposed image dataset supported typical deep learning networks in the classification task to identify the location and time of middle-season rice and achieved high accuracy with the public image dataset.

[1]  Lijun Zhao,et al.  Remote Sensing Image Scene Classification Using CNN-CapsNet , 2019, Remote. Sens..

[2]  Titus Cieslewski,et al.  Are We Ready for Autonomous Drone Racing? The UZH-FPV Drone Racing Dataset , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[3]  Julio Martin Duarte-Carvajalino,et al.  Evaluating Late Blight Severity in Potato Crops Using Unmanned Aerial Vehicles and Machine Learning Algorithms , 2018, Remote. Sens..

[4]  Jingye Han,et al.  A near real-time deep learning approach for detecting rice phenology based on UAV images , 2020, Agricultural and Forest Meteorology.

[5]  M. Wopereis,et al.  Crops that feed the world 7: Rice , 2012, Food Security.

[6]  Lizhe Wang,et al.  A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[7]  P. Lancashire,et al.  A uniform decimal code for growth stages of crops and weeds , 1991 .

[8]  Zhifeng Xiao,et al.  Elliptic Fourier transformation-based histograms of oriented gradients for rotationally invariant object detection in remote-sensing images , 2015 .

[9]  Hoonyol Lee,et al.  Identification of Alpine Glaciers in the Central Himalayas Using Fully Polarimetric L-Band SAR Data , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Qing Liu,et al.  Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Yu Chen,et al.  Large-Scale Structure from Motion with Semantic Constraints of Aerial Images , 2018, PRCV.

[12]  Xiao Xiang Zhu,et al.  Model Fusion for Building Type Classification from Aerial and Street View Images , 2019, Remote. Sens..

[13]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[16]  Michael Ying Yang,et al.  UAVid: A semantic segmentation dataset for UAV imagery , 2018 .

[17]  Weiguo Gong,et al.  Web-Net: A Novel Nest Networks with Ultra-Hierarchical Sampling for Building Extraction from Aerial Imageries , 2019, Remote. Sens..

[18]  Xiaoqiang Lu,et al.  Hierarchical and Robust Convolutional Neural Network for Very High-Resolution Remote Sensing Object Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Eli Saber,et al.  Supervised Classification of Multisensor Remotely Sensed Images Using a Deep Learning Framework , 2018, Remote. Sens..

[20]  Bernard Ghanem,et al.  A Benchmark and Simulator for UAV Tracking , 2016, ECCV.

[21]  Wen Yang,et al.  High-resolution satellite scene classification using a sparse coding based multiple feature combination , 2012 .

[22]  Adel Hafiane,et al.  Deep Learning with Unsupervised Data Labeling for Weed Detection in Line Crops in UAV Images , 2018, Remote. Sens..

[23]  Pierre Alliez,et al.  Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[24]  Ashok K. Mishra,et al.  A review of remote sensing applications in agriculture for food security: Crop growth and yield, irrigation, and crop losses , 2020 .

[25]  Fei Wang,et al.  Multi-Scale Semantic Segmentation and Spatial Relationship Recognition of Remote Sensing Images Based on an Attention Model , 2019, Remote. Sens..

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Juan Du,et al.  Mid-Season High-Resolution Satellite Imagery for Forecasting Site-Specific Corn Yield , 2016, Remote. Sens..

[28]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jordi Pont-Tuset,et al.  The Open Images Dataset V4 , 2018, International Journal of Computer Vision.

[30]  M. Weiss,et al.  Remote sensing for agricultural applications: A meta-review , 2020 .

[31]  Shawn D. Newsam,et al.  Geographic Image Retrieval Using Local Invariant Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[33]  Supratik Mukhopadhyay,et al.  DeepSat: a learning framework for satellite imagery , 2015, SIGSPATIAL/GIS.

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Zhenfeng Shao,et al.  PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrieval , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  Yun Zhang,et al.  Very Deep Convolutional Neural Networks for Complex Land Cover Mapping Using Multispectral Remote Sensing Imagery , 2018, Remote. Sens..

[37]  Zhao Zhang,et al.  Temperature variations and rice yields in China: historical contributions and future trends , 2014, Climatic Change.