Learning Models for Semantic Classification of Insufficient Plantar Pressure Images

Establishing a reliable and stable model to predict a target by using insufficient labeled samples is feasible and effective, particularly, for a sensor-generated data-set. This paper has been inspired with insufficient data-set learning algorithms, such as metric-based, prototype networks and meta-learning, and therefore we propose an insufficient data-set transfer model learning method. Firstly, two basic models for transfer learning are introduced. A classification system and calculation criteria are then subsequently introduced. Secondly, a dataset of plantar pressure for comfort shoe design is acquired and preprocessed through foot scan system; and by using a pre-trained convolution neural network employing AlexNet and convolution neural network (CNN)- based transfer modeling, the classification accuracy of the plantar pressure images is over 93.5%. Finally, the proposed method has been compared to the current classifiers VGG, ResNet, AlexNet and pre-trained CNN. Also, our work is compared with known-scaling and shifting (SS) and unknown-plain slot (PS) partition methods on the public test databases: SUN, CUB, AWA1, AWA2, and aPY with indices of precision (tr, ts, H) and time (training and evaluation). The proposed method for the plantar pressure classification task shows high performance in most indices when comparing with other methods. The transfer learning-based method can be applied to other insufficient data-sets of sensor imaging fields.

[1]  Zhongfei Zhang,et al.  Zero-shot learning with Multi-Battery Factor Analysis , 2017, Signal Process..

[2]  Andrew Y. Ng,et al.  Zero-Shot Learning Through Cross-Modal Transfer , 2013, NIPS.

[3]  James Hays,et al.  SUN attribute database: Discovering, annotating, and recognizing scene attributes , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Venkatesh Saligrama,et al.  Zero-Shot Learning via Semantic Similarity Embedding , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Julian Andres Ramirez-Bautista,et al.  Review on plantar data analysis for disease diagnosis , 2018 .

[7]  Wei Liu,et al.  On the Systematic Method to Enhance the Epiphany Ability of Individuals , 2014, ITQM.

[8]  Timothée Masquelier,et al.  Deep Learning in Spiking Neural Networks , 2018, Neural Networks.

[9]  Bernt Schiele,et al.  Latent Embeddings for Zero-Shot Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Xun Xu,et al.  Zero-Shot Crowd Behavior Recognition , 2019, Group and Crowd Behavior for Computer Vision.

[11]  Changshui Zhang,et al.  Boosting Few-Shot Image Recognition Via Domain Alignment Prototypical Networks , 2018, 2018 IEEE 30th International Conference on Tools with Artificial Intelligence (ICTAI).

[12]  Daoqiang Zhang,et al.  Attribute relation learning for zero-shot classification , 2014, Neurocomputing.

[13]  Xiao Li,et al.  Zero-shot classification by transferring knowledge and preserving data structure , 2017, Neurocomputing.

[14]  Jichang Guo,et al.  Zero-shot learning with regularized cross-modality ranking , 2017, Neurocomputing.

[15]  Herman Bruyninckx,et al.  Efficacy measures associated to a plantar pressure based classification system in diabetic foot medicine. , 2016, Gait & posture.

[16]  J. Snedeker,et al.  What is in a name? The development of cross-cultural differences in referential intuitions , 2018, Cognition.

[17]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[18]  Kelly Dombroski,et al.  Learning to be affected: Maternal connection, intuition and "elimination communication" , 2017 .

[19]  Muhammad A. Rushdi,et al.  Classification of scaled texture patterns with transfer learning , 2019, Expert Syst. Appl..

[20]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[21]  Ling Shao,et al.  Zero-shot Hashing with orthogonal projection for image retrieval , 2019, Pattern Recognit. Lett..

[22]  Loris Nanni,et al.  Deep learning and transfer learning features for plankton classification , 2019, Ecol. Informatics.

[23]  Bin Liu,et al.  Combining ontology and reinforcement learning for zero-shot classification , 2017, Knowl. Based Syst..

[24]  Ali Farhadi,et al.  Describing objects by their attributes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Ezzeddine Zagrouba,et al.  Deep feature learning for soft tissue sarcoma classification in MR images via transfer learning , 2019, Expert Syst. Appl..

[26]  Hafiz Imtiaz,et al.  A template matching approach of one-shot-learning gesture recognition , 2013, Pattern Recognit. Lett..

[27]  Rajesh Mehra,et al.  Breast cancer histology images classification: Training from scratch or transfer learning? , 2018, ICT Express.

[28]  Yang Yang,et al.  Zero-shot learning via discriminative representation extraction , 2017, Pattern Recognit. Lett..

[29]  Shaogang Gong,et al.  Semantic Autoencoder for Zero-Shot Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Wei-Lun Chao,et al.  Synthesized Classifiers for Zero-Shot Learning , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Walid Barhoumi,et al.  An image-based segmentation recommender using crowdsourcing and transfer learning for skin lesion extraction , 2019, Expert Syst. Appl..

[32]  P. Hérent,et al.  Detection and characterization of MRI breast lesions using deep learning. , 2019, Diagnostic and interventional imaging.

[33]  Matthew R. Dally,et al.  Plantar Acceleration Time: A Novel Technique to Evaluate Arterial Flow to the Foot. , 2019, Annals of vascular surgery.

[34]  Yingjie Tian,et al.  Multi-view transfer learning with privileged learning framework , 2019, Neurocomputing.

[35]  George Tzanetakis,et al.  Singing Style Investigation by Residual Siamese Convolutional Neural Networks , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  Christoph H. Lampert,et al.  Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Yanlin Li,et al.  A convolutional neural network Cascade for plantar pressure images registration. , 2019, Gait & posture.

[38]  Philip H. S. Torr,et al.  An embarrassingly simple approach to zero-shot learning , 2015, ICML.

[39]  Hugo Terashima-Marín,et al.  Selecting meta-heuristics for solving vehicle routing problems with time windows via meta-learning , 2019, Expert Syst. Appl..

[40]  Yiannis Demiris,et al.  A morphable template framework for robot learning by demonstration: Integrating one-shot and incremental learning approaches , 2014, Robotics Auton. Syst..

[41]  Christoph H. Lampert,et al.  Attribute-Based Classification for Zero-Shot Visual Object Categorization , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  David G. Rand,et al.  Modeling Intuition's Origins , 2016 .

[43]  Zhongfei Zhang,et al.  Manifold regularized cross-modal embedding for zero-shot learning , 2017, Inf. Sci..

[44]  Yang Yang,et al.  One-shot learning based pattern transition map for action early recognition , 2018, Signal Process..

[45]  Aman Hussain,et al.  Text Normalization using Memory Augmented Neural Networks , 2019, Speech Commun..

[46]  Thomas Burwick,et al.  Few-shot learning in deep networks through global prototyping , 2017, Neural Networks.

[47]  Bernt Schiele,et al.  Evaluation of output embeddings for fine-grained image classification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Piyush Rai,et al.  A Simple Exponential Family Framework for Zero-Shot Learning , 2017, ECML/PKDD.

[49]  Bo Xu,et al.  Concept Learning through Deep Reinforcement Learning with Memory-Augmented Neural Networks , 2018, Neural Networks.

[50]  Samy Bengio,et al.  Zero-Shot Learning by Convex Combination of Semantic Embeddings , 2013, ICLR.

[51]  Shubham Pachori,et al.  Hashing in the zero shot framework with domain adaptation , 2017, Neurocomputing.

[52]  André Crosnier,et al.  Haptic Zero-Shot Learning: Recognition of objects never touched before , 2018, Robotics Auton. Syst..