Cognitive Intelligence for Monitoring Fractured Post-Surgery Ankle Activity Using Channel Information

In the past decades, cognitive computing and communication densely used in lots of networking areas. Current improvement in deep learning (DL) and big data analysis create great potential to analyze cognitive intelligence (CI) for many applications such as human activity monitoring and recognition through wireless communication. Cognitive intelligence and wireless communication are using to establish smart healthcare systems. Healthcare monitoring systems turn into interesting research subjects where monitoring post-operative surgical patients are the current focal point to the researcher. In this paper, we argue that deep learning along with the wireless communication technique introduces cognitive intelligence for the healthcare monitoring system. We present a deep learning based convolutional neural network (CNN) model to classify image data and a convenient and multi-functional software-defined radio (SDR) platform to detect movement of the ankle of patients who underwent ankle fracture surgery. Capturing wireless channel state information (WCSI) in the presence of the human body and classifying using CNN to observe distinct movements is the key idea of this study. A universal software radio peripheral (USRP) platform used to capture WCSI data and used for classification. AlexNet and ZFNet both are the famous architecture of CNN and used in a parallel way to classify captured WCSI-based images that converted from numeric data. The classification established on the ankles movements after surgery and classification results show that CNN provides satisfying results where test accuracy is 98.98%.

[1]  Syed Aziz Shah,et al.  Seizure episodes detection via smart medical sensing system , 2018, J. Ambient Intell. Humaniz. Comput..

[2]  Jameela Al-Jaroodi,et al.  Applications of big data to smart cities , 2015, Journal of Internet Services and Applications.

[3]  Thad B. Welch,et al.  Teaching software defined radio using the USRP and LabVIEW , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Danilo De Donno,et al.  An IoT-Aware Architecture for Smart Healthcare Systems , 2015, IEEE Internet of Things Journal.

[5]  Zijuan Liu,et al.  Human Movement Detection and Gait Periodicity Analysis Using Channel State Information , 2016, 2016 12th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN).

[6]  Syed Aziz Shah,et al.  Cognitive health care system and its application in pill‐rolling assessment , 2019, International Journal of Numerical Modelling: Electronic Networks, Devices and Fields.

[7]  Fadi Al-Turjman,et al.  Intelligence in the Internet of Medical Things era: A systematic review of current and future trends , 2020, Comput. Commun..

[8]  Syed Aziz Shah,et al.  A Compact Beam-Scanning Leaky-Wave Antenna With Improved Performance , 2018, IEEE Antennas and Wireless Propagation Letters.

[9]  Wendong Xiao,et al.  Extreme Learning Machine Ensemble for CSI based Device-free Indoor Localization , 2019, 2019 28th Wireless and Optical Communications Conference (WOCC).

[10]  Willem H Meeuwisse,et al.  A Dynamic Model of Etiology in Sport Injury: The Recursive Nature of Risk and Causation , 2007, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[11]  Syed Aziz Shah,et al.  An efficient monitoring of eclamptic seizures in wireless sensors networks , 2019, Comput. Electr. Eng..

[12]  Erik G. Larsson,et al.  Adversarial Attacks on Deep-Learning Based Radio Signal Classification , 2018, IEEE Wireless Communications Letters.

[13]  Syed Aziz Shah,et al.  Radar for Health Care: Recognizing Human Activities and Monitoring Vital Signs , 2019, IEEE Potentials.

[14]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[15]  Olivier Romain,et al.  Monitoring Body Motions Related To Huntington Disease by Exploiting the 5G Paradigm , 2019, 2019 UK/ China Emerging Technologies (UCET).

[16]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[17]  Ken'ichi Yano,et al.  Analysis of involuntary movement and development of a writing assistance system for adults with tension athetosis type cerebral palsy , 2014, 2014 IEEE Conference on Control Applications (CCA).

[18]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[19]  Abdelhamid Bouchachia,et al.  A review of smart homes in healthcare , 2015, J. Ambient Intell. Humaniz. Comput..

[20]  Julian Fiérrez,et al.  Comparative Analysis and Fusion of Spatiotemporal Information for Footstep Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Daniyal Haider,et al.  Post-surgical fall detection by exploiting the 5 G C-Band technology for eHealth paradigm , 2019, Appl. Soft Comput..

[22]  Syed Aziz Shah,et al.  Design of Software Defined Radios Based Platform for Activity Recognition , 2019, IEEE Access.

[23]  Namyoon Lee,et al.  Blind detection for MIMO systems with low-resolution ADCs using supervised learning , 2016, 2017 IEEE International Conference on Communications (ICC).

[24]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Ingrid Moerman,et al.  End-to-End Learning From Spectrum Data: A Deep Learning Approach for Wireless Signal Identification in Spectrum Monitoring Applications , 2017, IEEE Access.

[27]  Victor C. M. Leung,et al.  SOVCAN: Safety-Oriented Vehicular Controller Area Network , 2017, IEEE Communications Magazine.

[28]  Frédo Durand,et al.  Capturing the human figure through a wall , 2015, ACM Trans. Graph..

[29]  Leonardo Mostarda,et al.  Artificial Muscle Intelligence System With Deep Learning for Post-Stroke Assistance and Rehabilitation , 2019, IEEE Access.

[30]  Syed Aziz Shah,et al.  Utilizing a 5G spectrum for health care to detect the tremors and breathing activity for multiple sclerosis , 2018, Trans. Emerg. Telecommun. Technol..

[31]  Li Deng,et al.  A tutorial survey of architectures, algorithms, and applications for deep learning , 2014, APSIPA Transactions on Signal and Information Processing.

[32]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[33]  Chen Wang,et al.  Human Identification Using Temporal Information Preserving Gait Template , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Francisco Herrera,et al.  Cognitive Computing: Architecture, Technologies and Intelligent Applications , 2018, IEEE Access.

[35]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  R. Bahr,et al.  Incidence of acute volleyball injuries: a prospective cohort study of injury mechanisms and risk factors , 1997, Scandinavian journal of medicine & science in sports.

[37]  Otilia Popescu,et al.  An Experimental Study of the Transmit Power for a USRP Software-Defined Radio , 2018, 2018 International Conference on Communications (COMM).

[38]  Syed Aziz Shah,et al.  Chronic Obstructive Pulmonary Disease Warning in the Approximate Ward Environment , 2018, Applied Sciences.

[39]  Jawad Ahmad,et al.  Privacy-Preserving Non-Wearable Occupancy Monitoring System Exploiting Wi-Fi Imaging for Next-Generation Body Centric Communication , 2020, Micromachines.

[40]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[41]  Aly El Gamal,et al.  Deep neural network architectures for modulation classification , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[42]  Daniel George,et al.  Deep Neural Networks to Enable Real-time Multimessenger Astrophysics , 2016, ArXiv.

[43]  K. Froberg,et al.  Comparison of two intervention programmes in young female players in European handball – with and without ankle disc , 2003, Scandinavian journal of medicine & science in sports.

[44]  Yu-Yen Ou,et al.  Incorporating deep learning with convolutional neural networks and position specific scoring matrices for identifying electron transport proteins , 2017, J. Comput. Chem..

[45]  Matthew Y. W. Teow,et al.  Understanding convolutional neural networks using a minimal model for handwritten digit recognition , 2017, 2017 IEEE 2nd International Conference on Automatic Control and Intelligent Systems (I2CACIS).

[46]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[47]  C. Milgrom,et al.  Risk Factors for Lateral Ankle Sprain: A Prospective Study Among Military Recruits , 1991, Foot & ankle.

[48]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[49]  Philip Schniter,et al.  Onsager-corrected deep learning for sparse linear inverse problems , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[50]  Hongmei Deng,et al.  Real-Time and Embedded Deep Learning on FPGA for RF Signal Classification , 2019, MILCOM 2019 - 2019 IEEE Military Communications Conference (MILCOM).

[51]  Lei Guan,et al.  Gait signals classification and comparison , 2019 .

[52]  Syed Aziz Shah,et al.  Radar sensing for healthcare , 2019, Electronics Letters.

[53]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[54]  Qing Wang,et al.  Cognitive passive radar system: software defined radio and deep learning approach , 2019 .

[55]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[56]  Syed Aziz Shah,et al.  Respiration Symptoms Monitoring in Body Area Networks , 2018 .

[57]  Ryan M. Gibson,et al.  WiFreeze: Multiresolution Scalograms for Freezing of Gait Detection in Parkinson’s Leveraging 5G Spectrum with Deep Learning , 2019, Electronics.

[58]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[59]  L. Mathew,et al.  Increasing trend of wearables and multimodal interface for human activity monitoring: A review. , 2017, Biosensors & bioelectronics.

[60]  Tuan-Tu Huynh,et al.  Identification of clathrin proteins by incorporating hyperparameter optimization in deep learning and PSSM profiles , 2019, Comput. Methods Programs Biomed..

[61]  Syed Hassan Ahmed,et al.  A Deep Learning Framework Using Passive WiFi Sensing for Respiration Monitoring , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[62]  Luiz A. DaSilva,et al.  Context-aware cognitive radio using deep learning , 2017, 2017 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[63]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[64]  Fadi Al-Turjman,et al.  Intelligence and security in big 5G-oriented IoNT: An overview , 2020, Future Gener. Comput. Syst..

[65]  Michael F. Otero,et al.  Application of a continuous wave radar for human gait recognition , 2005, SPIE Defense + Commercial Sensing.

[66]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[67]  Jie Tian,et al.  Wandering Pattern Sensing at S-Band , 2018, IEEE Journal of Biomedical and Health Informatics.

[68]  Akram Alomainy,et al.  Diagnosis of the Hypopnea syndrome in the early stage , 2019, Neural Computing and Applications.

[69]  Pravin Yannawar,et al.  Overview of fingerprint recognition system , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).

[70]  Meikang Qiu,et al.  Health-CPS: Healthcare Cyber-Physical System Assisted by Cloud and Big Data , 2017, IEEE Systems Journal.

[71]  Shyamnath Gollakota,et al.  Bringing Gesture Recognition to All Devices , 2014, NSDI.

[72]  Syed Aziz Shah,et al.  RF Sensing Technologies for Assisted Daily Living in Healthcare: A Comprehensive Review , 2019, IEEE Aerospace and Electronic Systems Magazine.

[73]  Andrea J. Goldsmith,et al.  Detection Algorithms for Communication Systems Using Deep Learning , 2017, ArXiv.

[74]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[75]  M. Hoch,et al.  The Ankle-Joint Complex: A Kinesiologic Approach to Lateral Ankle Sprains. , 2019, Journal of athletic training.

[76]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[77]  Victor C. M. Leung,et al.  Artificial Intelligence for Cognitive Wireless Communications , 2019, IEEE Wirel. Commun..

[78]  Shuang Wang,et al.  A Review on Human Activity Recognition Using Vision-Based Method , 2017, Journal of healthcare engineering.

[79]  Wei Wang,et al.  Gait recognition using wifi signals , 2016, UbiComp.

[80]  David Akopian,et al.  SDR-Fi: Deep-Learning-Based Indoor Positioning via Software-Defined Radio , 2019, IEEE Access.

[81]  S. Prasad,et al.  Help patients prevent repeat ankle injury. , 2010, The Journal of family practice.