Adaptive Generation of Phantom Limbs Using Visible Hierarchical Autoencoders

This paper proposed a hierarchical visible autoencoder in the adaptive phantom limbs generation according to the kinetic behavior of functional body-parts, which are measured by heterogeneous kinetic sensors. The proposed visible hierarchical autoencoder consists of interpretable and multi-correlated autoencoder pipelines, which is directly derived from the hierarchical network described in forest data-structure. According to specified kinetic script (e.g., dancing, running, etc.) and users' physical conditions, hierarchical network is extracted from human musculoskeletal network, which is fabricated by multiple body components (e.g., muscle, bone, and joints, etc.) that are bio-mechanically, functionally, or nervously correlated with each other and exhibit mostly non-divergent kinetic behaviors. Multi-layer perceptron (MLP) regressor models, as well as several variations of autoencoder models, are investigated for the sequential generation of missing or dysfunctional limbs. The resulting kinematic behavior of phantom limbs will be constructed using virtual reality and augmented reality (VR/AR), actuators, and potentially controller for a prosthesis (an artificial device that replaces a missing body part). The addressed work aims to develop practical innovative exercise methods that (1) engage individuals at all ages, including those with a chronic health condition(s) and/or disability, in regular physical activities, (2) accelerate the rehabilitation of patients, and (3) release users' phantom limb pain. The physiological and psychological impact of the addressed work will critically be assessed in future work.

[1]  G. A. Einicke,et al.  Smoothing, Filtering and Prediction - Estimating The Past, Present and Future , 2012 .

[2]  Javier Cuadrado,et al.  Biomechanical models for human gait analyses using inverse dynamics formulation , 2013 .

[3]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[4]  Danica Kragic,et al.  Deep Representation Learning for Human Motion Prediction and Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Edward A. Lee Cyber Physical Systems: Design Challenges , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[6]  Laurence T. Yang,et al.  Finite-element-wise domain decomposition iterative solvers with polynomial preconditioning , 2013, Math. Comput. Model..

[7]  Paul Zarchan,et al.  Fundamentals of Kalman Filtering: A Practical Approach , 2001 .

[8]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[9]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[10]  Steve Horvath,et al.  WGCNA: an R package for weighted correlation network analysis , 2008, BMC Bioinformatics.

[11]  Kyung-shik Shin,et al.  Hierarchical convolutional neural networks for fashion image classification , 2019, Expert Syst. Appl..

[12]  Yu Liang,et al.  A Data Preprocessing Technique for Gesture Recognition Based on Extended-Kalman-Filter , 2017, 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[13]  Olli Mäkinen,et al.  Streaming at the Edge: Local Service Concepts Utilizing Mobile Edge Computing , 2015, NGMAST.

[14]  A. Stockselius,et al.  Phantom motor execution facilitated by machine learning and augmented reality as treatment for phantom limb pain: a single group, clinical trial in patients with chronic intractable phantom limb pain , 2016, The Lancet.

[15]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[16]  Claus Führer,et al.  Numerical Methods in Multibody Dynamics , 2013 .

[17]  Patrick M. Pilarski,et al.  Learning from demonstration: Teaching a myoelectric prosthesis with an intact limb via reinforcement learning , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[18]  Yanfeng Hu,et al.  Word-character attention model for Chinese text classification , 2019, Int. J. Mach. Learn. Cybern..

[19]  V. Ramachandran,et al.  The perception of phantom limbs. The D. O. Hebb lecture. , 1998, Brain : a journal of neurology.

[20]  Nigel H. Lovell,et al.  A review of tactile sensing technologies with applications in biomedical engineering , 2012 .

[21]  Alessandro Sperduti,et al.  Supervised neural networks for the classification of structures , 1997, IEEE Trans. Neural Networks.

[22]  Arend L. Schwab,et al.  Dynamics of Multibody Systems , 2007 .

[23]  Lui Sha,et al.  Cyber-Physical Systems: A New Frontier , 2008, 2008 IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (sutc 2008).

[24]  E S Grood,et al.  A joint coordinate system for the clinical description of three-dimensional motions: application to the knee. , 1983, Journal of biomechanical engineering.

[25]  Danielle S Bassett,et al.  Structure, function, and control of the human musculoskeletal network , 2018, PLoS biology.

[26]  Jorge Ambrósio,et al.  Multibody Dynamics of Biomechanical Models for Human Motion via Optimization , 2007 .

[27]  Daniel Jurafsky,et al.  A Hierarchical Neural Autoencoder for Paragraphs and Documents , 2015, ACL.

[28]  V. Ramachandran,et al.  The perception of phantom limbs , 1998 .

[29]  R. Farebrother,et al.  Matrix representation of quaternions , 2003 .