The Automatic Identification of Butterfly Species

The available butterfly data sets comprise a few limited species, and the images in the data sets are always standard patterns without the images of butterflies in their living environment. To overcome the aforementioned limitations in the butterfly data sets, we build a butterfly data set composed of all species of butterflies in China with 4270 standard pattern images of 1176 butterfly species, and 1425 images from living environment of 111 species. We propose to use the deep learning technique Faster-Rcnn to train an automatic butterfly identification system including butterfly position detection and species recognition. We delete those species with only one living environment image from data set, then partition the rest images from living environment into two subsets, one used as test subset, the other as training subset respectively combined with all standard pattern butterfly images or the standard pattern butterfly images with the same species of the images from living environment. In order to construct the training subset for FasterRcnn, nine methods were adopted to amplifying the images in the training subset including the turning of up and down, and left and right, rotation with different angles, adding noises, blurring, and contrast ratio adjusting etc. Three prediction models were trained. The mAP (Mean Average prediction) criterion was used to evaluate the performance of the prediction model. The experimental results demonstrate that our Faster-Rcnn based butterfly automatic identification system performed well, and its worst mAP is up to 60%, and can simultaneously detect the positions of more than one butterflies in one images from living environment and recognize the species of those butterflies as well.

[1]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Yilmaz Kaya,et al.  Evaluation of texture features for automatic detecting butterfly species using extreme learning machine , 2014, J. Exp. Theor. Artif. Intell..

[5]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[8]  Seung-Ho Kang,et al.  Identification of butterfly species with a single neural network system , 2012 .

[9]  Andrés Hernández-Serna,et al.  Automatic identification of species with neural networks , 2014, PeerJ.

[10]  Sang-Hee Lee,et al.  Identification of butterfly based on their shapes when viewed from different angles using an artificial neural network , 2014 .

[11]  C. Io Monographia rhopalocerorum sinensium (Monograph of Chinese butterflies). Two volumes. , 1994 .

[12]  Gerard Talavera,et al.  A Comprehensive and Dated Phylogenomic Analysis of Butterflies , 2018, Current Biology.

[13]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[14]  J. Dubois,et al.  Evaluation Of The Grey-level Co-occurrence Matrix Method For Land-cover Classification Using Spot Imagery , 1990 .

[15]  Liqiang Ji,et al.  The identification of butterfly families using content-based image retrieval , 2012 .