Image Classification Using Multiple Convolutional Neural Networks on the Fashion-MNIST Dataset

As the elderly population grows, there is a need for caregivers, which may become unsustainable for society. In this situation, the demand for automated help increases. One of the solutions is service robotics, in which robots have automation and show significant promise in working with people. In particular, household settings and aged people’s homes will need these robots to perform daily activities. Clothing manipulation is a daily activity and represents a challenging area for a robot. The detection and classification are key points for the manipulation of clothes. For this reason, in this paper, we proposed to study fashion image classification with four different neural network models to improve apparel image classification accuracy on the Fashion-MNIST dataset. The network models are tested with the highest accuracy with a Fashion-Product dataset and a customized dataset. The results show that one of our models, the Multiple Convolutional Neural Network including 15 convolutional layers (MCNN15), boosted the state of art accuracy, and it obtained a classification accuracy of 94.04% on the Fashion-MNIST dataset with respect to the literature. Moreover, MCNN15, with the Fashion-Product dataset and the household dataset, obtained 60% and 40% accuracy, respectively.

[1]  Nader H. Bshouty,et al.  On Learning and Testing Decision Tree , 2021, ArXiv.

[2]  Amirthalingam Ramanan,et al.  A knowledge-sharing semi-supervised approach for fashion clothes classification and attribute prediction , 2021, The Visual Computer.

[3]  Shivangi Aneja,et al.  IndoFashion : Apparel Classification for Indian Ethnic Clothes , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Anita M. R. Fernandes,et al.  Classifying Garments from Fashion-MNIST Dataset Through CNNs , 2021 .

[5]  Yanning Zhang,et al.  Where to Look and How to Describe: Fashion Image Retrieval With an Attentional Heterogeneous Bilinear Network , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  S. Gelly,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2020, ICLR.

[7]  Yusi Tang,et al.  Optimal Design of Deep Residual Network Based on Image Classification of Fashion-MNIST Dataset , 2020, Journal of Physics: Conference Series.

[8]  Amirthalingam Ramanan,et al.  An improved landmark-driven and spatial–channel attentive convolutional neural network for fashion clothes classification , 2020, The Visual Computer.

[9]  Saiharsha B,et al.  Evaluating Performance of Deep Learning Architectures for Image Classification , 2020, 2020 5th International Conference on Communication and Electronics Systems (ICCES).

[10]  Derya Soydaner,et al.  A Comparison of Optimization Algorithms for Deep Learning , 2020, Int. J. Pattern Recognit. Artif. Intell..

[11]  Lei Gao,et al.  An improved object detection algorithm based on multi-scaled and deformable convolutional neural networks , 2020, Human-centric Computing and Information Sciences.

[12]  Bingo Wing-Kuen Ling,et al.  Shallow convolutional neural network for image classification , 2019, SN Applied Sciences.

[13]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[14]  Takuya Akiba,et al.  Optuna: A Next-generation Hyperparameter Optimization Framework , 2019, KDD.

[15]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[16]  Aleena Swetapadma,et al.  A Brief Review of Nearest Neighbor Algorithm for Learning and Classification , 2019, 2019 International Conference on Intelligent Computing and Control Systems (ICCS).

[17]  Andrea Prati,et al.  Fashion Product Classification through Deep Learning and Computer Vision , 2019, Applied Sciences.

[18]  Kyung-shik Shin,et al.  Hierarchical convolutional neural networks for fashion image classification , 2019, Expert Syst. Appl..

[19]  Ion Stoica,et al.  Tune: A Research Platform for Distributed Model Selection and Training , 2018, ArXiv.

[20]  Zheng Wang,et al.  Evaluating Brush Movements for Chinese Calligraphy: A Computer Vision Based Approach , 2018, IJCAI.

[21]  Abien Fred Agarap.  An Architecture Combining Convolutional Neural Network (CNN) and Support Vector Machine (SVM) for Image Classification , 2017, ArXiv.

[22]  Maheshkumar H. Kolekar,et al.  Classification of fashion article images using convolutional neural networks , 2017, 2017 Fourth International Conference on Image Information Processing (ICIIP).

[23]  Max Jaderberg,et al.  Population Based Training of Neural Networks , 2017, ArXiv.

[24]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Guo-Wei Yang,et al.  Multiple Convolutional Neural Network for Feature Extraction , 2015, ICIC.

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Aaron C. Courville,et al.  Generative Adversarial Nets , 2014, NIPS.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  S Micera,et al.  Technology and Innovative Services , 2011, IEEE Pulse.

[31]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[32]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[33]  Harinder P. Singh,et al.  An introduction to artificial neural networks , 2001, astro-ph/0102224.

[34]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[35]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[36]  Hyperparameter Optimization and Regularization on Fashion-MNIST Classification , 2019, International Journal of Recent Technology and Engineering.

[37]  K V Greeshma,et al.  Fashion-MNIST Classification Based on HOG Feature Descriptor Using SVM , 2019 .

[38]  Shu Shen.  Image Classification of Fashion-MNIST Dataset Using Long Short-Term Memory Networks , 2018 .

[39]  Kexin Zhang.  LSTM: An Image Classification Model Based on Fashion-MNIST Dataset , 2018 .

[40]  Aboul Ella Hassanien,et al.  Linear discriminant analysis: A detailed tutorial , 2017, AI Commun..

[41]  Eshwar S G,et al.  Apparel classification using Convolutional Neural Networks , 2016, 2016 International Conference on ICT in Business Industry & Government (ICTBIG).

[42]  David D. Cox,et al.  Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms , 2013, SciPy.

[43]  D. Viswanathan,et al.  Features from Accelerated Segment Test ( FAST ) , 2011 .

[44]  Christopher Hunt.  SURF: Speeded-Up Robust Features , 2009 .

[45]  Thomas J. Watson,et al.  An empirical study of the naive Bayes classifier , 2001 .