Evolving 1D Convolutional Neural Networks for Human Activity Recognition

Human activity recognition is an important research field with a variety of applications in healthcare monitoring, fitness tracking and in user-adaptive systems in smart environments. The problem of human activity recognition can be solved using a 1D convolutional neural network (CNN) trained with accelerometric data. The design of an appropriate CNN architecture for solving a particular problem is not an easy task and usually requires considerable specialized knowledge to setup the network hyperparameters based on experimental evaluation. This article proposes an automated approach for CNN architecture optimization that uses genetic algorithms. The suggested approach for evolution of the architecture of 1D CNN is evaluated on two data sets for accelerometer-based human activity recognition and the results show that the GA based CNN design generates CNN architectures with competitive performance compared to the usage of other manually designed CNN models.

[1]  Vijay Kumar,et al.  A review on genetic algorithm: past, present, and future , 2020, Multimedia tools and applications.

[2]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[3]  Sung-Bae Cho,et al.  Deep Convolutional Neural Networks for Human Activity Recognition with Smartphone Sensors , 2015, ICONIP.

[4]  Ramesh Raskar,et al.  Designing Neural Network Architectures using Reinforcement Learning , 2016, ICLR.

[5]  Anton Kummert,et al.  Activity recognition using inertial sensors and a 2-D convolutional neural network , 2017, 2017 10th International Workshop on Multidimensional (nD) Systems (nDS).

[6]  Alan L. Yuille,et al.  Genetic CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Guang-Zhong Yang,et al.  Deep learning for human activity recognition: A resource efficient implementation on low-power devices , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[8]  Tobias Senst,et al.  Hyper-parameter optimization for convolutional neural network committees based on evolutionary algorithms , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[9]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[10]  Milan Tuba,et al.  Optimizing Convolutional Neural Network Hyperparameters by Enhanced Swarm Intelligence Metaheuristics , 2020, Algorithms.

[11]  Ulas Bagci,et al.  Automatically Designing CNN Architectures for Medical Image Segmentation , 2018, MLMI@MICCAI.

[12]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[13]  Alok Aggarwal,et al.  Regularized Evolution for Image Classifier Architecture Search , 2018, AAAI.

[14]  Moosa Ayati,et al.  Magnetic resonance imaging-based brain tumor grades classification and grading via convolutional neural networks and genetic algorithms , 2019, Biocybernetics and Biomedical Engineering.

[15]  Bin Wang,et al.  Evolving Deep Convolutional Neural Networks by Variable-Length Particle Swarm Optimization for Image Classification , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[16]  Li Zhang,et al.  Evolving Image Classification Architectures With Enhanced Particle Swarm Optimisation , 2018, IEEE Access.

[17]  Quoc V. Le,et al.  Large-Scale Evolution of Image Classifiers , 2017, ICML.

[18]  Oriol Vinyals,et al.  Hierarchical Representations for Efficient Architecture Search , 2017, ICLR.

[19]  Julian F. Miller,et al.  Proceedings of the Genetic and Evolutionary Computation Conference , 2021, GECCO.

[20]  Elliot Meyerson,et al.  Evolving Deep Neural Networks , 2017, Artificial Intelligence in the Age of Neural Networks and Brain Computing.

[21]  Masanori Suganuma,et al.  A genetic programming approach to designing convolutional neural network architectures , 2017, GECCO.

[22]  Hwee Pink Tan,et al.  Deep Activity Recognition Models with Triaxial Accelerometers , 2015, AAAI Workshop: Artificial Intelligence Applied to Assistive Technologies and Smart Environments.

[23]  Yong Yu,et al.  Efficient Architecture Search by Network Transformation , 2017, AAAI.

[24]  Quoc V. Le,et al.  Neural Architecture Search with Reinforcement Learning , 2016, ICLR.

[25]  S Tsokov,et al.  Accelerometer-based human activity recognition using 1D convolutional neural network , 2021 .

[26]  Mengjie Zhang,et al.  Automatically Evolving CNN Architectures Based on Blocks , 2018, ArXiv.

[27]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[28]  Frank Hutter,et al.  Simple And Efficient Architecture Search for Convolutional Neural Networks , 2017, ICLR.

[29]  Mengjie Zhang,et al.  Evolving Deep Convolutional Neural Networks for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[30]  Yulong Wang,et al.  cPSO-CNN: An efficient PSO-based algorithm for fine-tuning hyper-parameters of convolutional neural networks , 2019, Swarm Evol. Comput..

[31]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[32]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[33]  Xin-She Yang,et al.  Handling dropout probability estimation in convolution neural networks using meta-heuristics , 2018, Soft Comput..