Research on image classification method based on improved multi-scale relational network

Small sample learning aims to learn information about object categories from a single or a few training samples. This learning style is crucial for deep learning methods based on large amounts of data. The deep learning method can solve small sample learning through the idea of meta-learning “how to learn by using previous experience.” Therefore, this paper takes image classification as the research object to study how meta-learning quickly learns from a small number of sample images. The main contents are as follows: After considering the distribution difference of data sets on the generalization performance of measurement learning and the advantages of optimizing the initial characterization method, this paper adds the model-independent meta-learning algorithm and designs a multi-scale meta-relational network. First, the idea of META-SGD is adopted, and the inner learning rate is taken as the learning vector and model parameter to learn together. Secondly, in the meta-training process, the model-independent meta-learning algorithm is used to find the optimal parameters of the model. The inner gradient iteration is canceled in the process of meta-validation and meta-test. The experimental results show that the multi-scale meta-relational network makes the learned measurement have stronger generalization ability, which further improves the classification accuracy on the benchmark set and avoids the need for fine-tuning of the model-independent meta-learning algorithm.

[1]  Joshua B. Tenenbaum,et al.  One shot learning of simple visual concepts , 2011, CogSci.

[2]  Lirong Yin,et al.  The Retrieved Urban LST in Beijing Based on TM, HJ-1B and MODIS , 2016 .

[3]  Tao Xiang,et al.  Learning to Compare: Relation Network for Few-Shot Learning , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Fan Liu,et al.  Comparative Analysis on Classical Meta-Metric Models for Few-Shot Learning , 2020, IEEE Access.

[5]  Bo Yang,et al.  Semantic representation for visual reasoning , 2019, MATEC Web of Conferences.

[6]  Wenfeng Zheng,et al.  Construction of force haptic reappearance system based on Geomagic Touch haptic device , 2020, Comput. Methods Programs Biomed..

[7]  Xiaolu Li,et al.  Fractal dimension analysis for seismicity spatial and temporal distribution in the circum-Pacific seismic belt , 2019, Journal of Earth System Science.

[8]  Daan Wierstra,et al.  Meta-Learning with Memory-Augmented Neural Networks , 2016, ICML.

[9]  J. Biggs THE ROLE OF METALEARNING IN STUDY PROCESSES , 1985 .

[10]  Lirong Yin,et al.  Seismic spatiotemporal characteristics in the Alpide Himalayan Seismic Belt , 2020, Earth Science Informatics.

[11]  Hong Yu,et al.  Meta Networks , 2017, ICML.

[12]  Dan Wang,et al.  Predicting seismicity trend in southwest of China based on wavelet analysis , 2015, Int. J. Wavelets Multiresolution Inf. Process..

[13]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[14]  Lirong Yin,et al.  Earthquakes spatio–temporal distribution and fractal analysis in the Eurasian seismic belt , 2020, Rendiconti Lincei. Scienze Fisiche e Naturali.

[15]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[16]  Bo Yang,et al.  Multi-scale Relation Network for Few-Shot Learning Based on Meta-learning , 2019, ICVS.

[17]  Lirong Yin,et al.  Sentence Representation Method Based on Multi-Layer Semantic Network , 2021, Applied Sciences.

[18]  Qian Liu,et al.  Domain-specific meta-embedding with latent semantic structures , 2020, Inf. Sci..

[19]  Jiawei Tian,et al.  Temporal evolution characteristics of PM2.5 concentration based on continuous wavelet transform. , 2020, The Science of the total environment.

[20]  Jinxin Xie,et al.  Impact of human activities on haze in Beijing based on grey relational analysis , 2015, Rendiconti Lincei.

[21]  Lirong Yin,et al.  Spatiotemporal heterogeneity of urban air pollution in China based on spatial analysis , 2016, Rendiconti Lincei.

[22]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[23]  Sergio Gomez Colmenarejo,et al.  Hybrid computing using a neural network with dynamic external memory , 2016, Nature.

[24]  Andrew L. Maas,et al.  One-Shot Learning with Bayesian Networks , 2009 .

[25]  Bhaskara Marthi,et al.  A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs , 2017, Science.

[26]  Bartunov Sergey,et al.  Meta-Learning with Memory-Augmented Neural Networks , 2016 .

[27]  Daan Wierstra,et al.  One-Shot Generalization in Deep Generative Models , 2016, ICML.

[28]  Yoshua Bengio,et al.  MetaGAN: An Adversarial Approach to Few-Shot Learning , 2018, NeurIPS.

[29]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[30]  Lirong Yin,et al.  Joint embedding VQA model based on dynamic word vector , 2021, PeerJ Comput. Sci..

[31]  Hugo Larochelle,et al.  Optimization as a Model for Few-Shot Learning , 2016, ICLR.

[32]  Joshua B. Tenenbaum,et al.  Building machines that learn and think like people , 2016, Behavioral and Brain Sciences.

[33]  Wenfeng Zheng,et al.  An improved method for soft tissue modeling , 2021, Biomed. Signal Process. Control..

[34]  Xiaolu Li,et al.  Influence of Social-economic Activities on Air Pollutants in Beijing, China , 2017 .

[35]  Pietro Perona,et al.  A Bayesian approach to unsupervised one-shot learning of object categories , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[36]  Yu Zhou,et al.  Wavelet analysis of the temporal-spatial distribution in the Eurasia seismic belt , 2017, Int. J. Wavelets Multiresolution Inf. Process..