A Haptics Feedback Based-LSTM Predictive Model for Pericardiocentesis Therapy Using Public Introperative Data

Proposing a robust and fast real-time medical procedure, operating remotely is always a challenging task, due mainly to the effect of delay and dropping of the speed of networks, on operations. If a further stage of prediction is properly designed on remotely operated systems, many difficulties could be tackled. Hence, in this paper, an accurate predictive model, calculating haptics feedback in percutaneous heart biopsy is investigated. A one-layer Long Short-Term Memory based (LSTM-based) Recurrent Neural Network, which is a natural fit for understanding haptics time series data, is utilised. An offline learning procedure is proposed to build the model, followed by an online procedure to operate on new experiments, remotely fed to the system. Statistical analyses prove that the error variation of the model is significantly narrow, showing the robustness of the model. Moreover, regarding computational costs, it takes 0.7 ms to predict a time step further online, which is quick enough for real-time haptic interaction.

[1]  Yang Gao,et al.  Deep learning for tactile understanding from visual and haptic data , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Chee Peng Lim,et al.  A Wavelet Deep Belief Network-Based Classifier for Medical Images , 2016, ICONIP.

[4]  Ming C. Lin,et al.  Stable and responsive six-degree-of-freedom haptic manipulation using implicit integration , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[5]  John Kenneth Salisbury,et al.  Learning to represent haptic feedback for partially-observable tasks , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Saeid Nahavandi,et al.  A deep-structural medical image classification for a Radon-based image retrieval , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[7]  Hervé Delingette,et al.  Improving realism of a surgery simulator: linear anisotropic elasticity, complex interactions and force extrapolation , 2002, Comput. Animat. Virtual Worlds.

[8]  Aiguo Song,et al.  A Time Series Based Solution for the Difference Rate Sampling between Haptic Rendering and Visual Display , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[9]  N. Breslow A generalized Kruskal-Wallis test for comparing K samples subject to unequal patterns of censorship , 1970 .

[10]  Chee Peng Lim,et al.  A new PSO-based approach to fire flame detection using K-Medoids clustering , 2017, Expert Syst. Appl..

[11]  Chee Peng Lim,et al.  Medical image analysis using wavelet transform and deep belief networks , 2017, Expert Syst. Appl..

[12]  Michael Ortega-Binderberger,et al.  A Six Degree-of-Freedom God-Object Method for Haptic Display of Rigid Bodies with Surface Properties , 2007, IEEE Transactions on Visualization and Computer Graphics.

[13]  Christian Duriez,et al.  A multi-threaded approach for deformable/rigid contacts with haptic feedback , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[14]  Jean-Christophe Lombardo,et al.  Extrapolation: a solution for force feedback ? , 1999 .

[15]  Dan Morris,et al.  Standardized Evaluation of Haptic Rendering Systems , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.