Weed identification based on K-means feature learning combined with convolutional neural network

Unstable identification and weak generalization in feature extraction are overcome.A weed identification model based on K-means combined with CNN is constructed.We take K-means pre-training to replace the random initialization of weights of CNN.The parameters can get more reasonable value before being optimized. Aiming at the problem that unstable identification results and weak generalization ability in feature extraction based on manual design features in weed identification, this paper take the soybean seedlings and its associated weeds as the research object, and construct a weed identification model based on K-means feature learning combined with Convolutional neural network. Combining advantages of multilayer and fine-turning of parameters of the convolutional neural network, this paper set k-means unsupervised feature learning as pre-training process, and replaced the random initialization weights of traditional CNN parameters. This method make the parameters can be obtained more reasonable values before optimization to gain higher weed identification accuracy. The experimental results show that this method with K-means pre-training achieved 92.89% accuracy, beyond 1.82% than convolutional neural network with random initialization and 6.01% than the two layer network without fine-tuning. Our results suggest that identification accuracy might be improved by fine-tuning of parameters.

[1]  Dimitris Kanellopoulos,et al.  Data Preprocessing for Supervised Leaning , 2007 .

[2]  Yann LeCun,et al.  Convolutional neural networks applied to house numbers digit classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[3]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[4]  Lianwen Jin,et al.  A Comparative Study of Several Feature Extraction Methods for Person Re-identification , 2012, CCBR.

[5]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yilin Zhao,et al.  The Design and Implementation of Intrusion Detection System based on Data Mining Technology , 2013 .

[7]  Luca Maria Gambardella,et al.  Convolutional Neural Network Committees for Handwritten Character Classification , 2011, 2011 International Conference on Document Analysis and Recognition.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Chenghai Yang,et al.  An application of soft sets in weed identification , 2013 .

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  Te-Won Lee,et al.  Independent Component Analysis , 1998, Springer US.

[12]  Trupti M. Kodinariya,et al.  Review on determining number of Cluster in K-Means Clustering , 2013 .

[13]  Wu Lanlan,et al.  Weed identification method based on SVM in the corn field. , 2009 .

[14]  H. Abdi,et al.  Principal component analysis , 2010 .

[15]  Andrew Y. Ng,et al.  Selecting Receptive Fields in Deep Networks , 2011, NIPS.

[16]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.