Smart Footwear Insole for Recognition of Foot Pronation and Supination Using Neural Networks

Abnormal foot postures during gait are common sources of pain and pathologies of the lower limbs. Measurements of foot plantar pressures in both dynamic and static conditions can detect these abnormal foot postures and prevent possible pathologies. In this work, a plantar pressure measurement system is developed to identify areas with higher or lower pressure load. This system is composed of an embedded system placed in the insole and a user application. The instrumented insole consists of a low-power microcontroller, seven pressure sensors and a low-energy bluetooth module. The user application receives and shows the insole pressure information in real-time and, finally, provides information about the foot posture. In order to identify the different pressure states and obtain the final information of the study with greater accuracy, a Deep Learning neural network system has been integrated into the user application. The neural network can be trained using a stored dataset in order to obtain the classification results in real-time. Results prove that this system provides an accuracy over 90% using a training dataset of 3000+ steps from 6 different users.

[1]  Claudia Giacomozzi,et al.  Hardware performance assessment recommendations and tools for baropodometric sensor systems. , 2010, Annali dell'Istituto superiore di sanita.

[2]  Kamiar Aminian,et al.  Instrumented shoes for activity classification in the elderly. , 2016, Gait & posture.

[3]  Bing Yu,et al.  Comparison of different structural foot types for measures of standing postural control. , 2006, The Journal of orthopaedic and sports physical therapy.

[4]  Emile Fiesler,et al.  Neural Networks with Adaptive Learning Rate and Momentum Terms , 1995 .

[5]  Edward Sazonov,et al.  Automatic Recognition of Activities of Daily Living Utilizing Insole-Based and Wrist-Worn Wearable Sensors , 2018, IEEE Journal of Biomedical and Health Informatics.

[6]  Jan Babič,et al.  Evaluation of psychological effects on human postural stability , 2017 .

[7]  Hylton B Menz,et al.  The relationship between foot posture and plantar pressure during walking in adults: A systematic review. , 2018, Gait & posture.

[8]  Xuegang Wang,et al.  A foot-wearable interface for locomotion mode recognition based on discrete contact force distribution , 2015 .

[9]  Qiao Li,et al.  In-Shoe Plantar Pressure Measurement and Analysis System Based on Fabric Pressure Sensing Array , 2010, IEEE Transactions on Information Technology in Biomedicine.

[10]  Joseph A. Paradiso,et al.  Gait Analysis Using a Shoe-Integrated Wireless Sensor System , 2008, IEEE Transactions on Information Technology in Biomedicine.

[11]  Hylton B Menz,et al.  Foot posture is associated with plantar pressure during gait: A comparison of normal, planus and cavus feet. , 2018, Gait & posture.

[12]  O. Svensson,et al.  Kinematics of the Ankle/Foot Complex—Part 2: Pronation and Supination , 1989, Foot & ankle.

[13]  Sang-Il Choi,et al.  Classification of Gait Type Based on Deep Learning Using Various Sensors with Smart Insole , 2019, Sensors.

[14]  A. Gordon,et al.  Gait Segmentation of Data Collected by Instrumented Shoes Using a Recurrent Neural Network Classifier. , 2019, Physical Medicine and Rehabilitation Clinics of North America.

[15]  Cuong Pham,et al.  e-Shoes: Smart shoes for unobtrusive human activity recognition , 2017, 2017 9th International Conference on Knowledge and Systems Engineering (KSE).

[16]  Lourdes Miro-Amarante,et al.  Designing a Wearable Device for Step Analyzing , 2019, 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS).

[17]  B. Eskofier,et al.  Sensor-based Gait Parameter Extraction with Deep Convolutional Neural Networks. , 2016, IEEE journal of biomedical and health informatics.

[18]  Qian Wang,et al.  Deep Learning-Based Gait Recognition Using Smartphones in the Wild , 2018, IEEE Transactions on Information Forensics and Security.

[19]  Hylton B. Menz,et al.  Association of Planus Foot Posture and Pronated Foot Function With Foot Pain: The Framingham Foot Study , 2013, Arthritis care & research.

[20]  Joseph A. Paradiso,et al.  Shoe-integrated sensor system for wireless gait analysis and real-time feedback , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[21]  J. P. Paul Gait analysis. , 1989, Annals of the rheumatic diseases.

[22]  Toshiki Kobayashi,et al.  Kinetic Gait Analysis Using a Low-Cost Insole , 2013, IEEE Transactions on Biomedical Engineering.

[23]  R. B. Davis,et al.  A gait analysis data collection and reduction technique , 1991 .

[24]  G F Harris,et al.  A system for the analysis of foot and ankle kinematics during gait. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  Pierre Moretto,et al.  Baropodometric information return device for foot unloading. , 2009, Medical engineering & physics.

[26]  D. M. Titterington,et al.  Neural Networks: A Review from a Statistical Perspective , 1994 .

[27]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[28]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[29]  K. Gnana Sheela,et al.  Review on Methods to Fix Number of Hidden Neurons in Neural Networks , 2013 .

[30]  Alfred D. Grant Gait Analysis: Normal and Pathological Function , 2010 .

[31]  Hélène Moffet,et al.  Design and Accuracy of an Instrumented Insole Using Pressure Sensors for Step Count , 2019, Sensors.

[32]  H. Menz,et al.  The population prevalence of foot and ankle pain in middle and old age: A systematic review , 2011, PAIN.

[33]  John Lazzaro,et al.  Winner-Take-All Networks of O(N) Complexity , 1988, NIPS.

[34]  Mohsen Razeghi,et al.  Foot type classification: a critical review of current methods. , 2002, Gait & posture.