Milling State Identification Based on Vibration Sense of a Robotic Surgical System

Milling is one of the most popular forms of hard tissue removal process, it is sometimes high-risk because there may be very small distance between the milling trajectory and vital anatomy. This paper introduces a vibration signal acquiring and processing method to identify different types of milling states in robot-assisted orthopedics. During milling process, the tissue vibration signal measured by a laser displacement sensor, and the acceleration signal of the operation power device recorded by an accelerometer, are decomposed by the lifting wavelet packet transform, so the harmonic component whose frequency is an integer times of the spindle frequency of the operation power device is extracted. In consideration of that the tissue vibration amplitude varies with the milling force, the relative magnitude of the force is estimated from the acceleration signal, and then the wavelet energy of the tissue vibration signal is divided by that of the acceleration signal to reduce the influence of the force disturbance. The compensated wavelet energy is subsequently used as input vector to a support vector machine for discriminating different milling states. Experimental results on porcine spines demonstrate that the proposed method can successfully discriminate the tissues in the operation field: the success rate achieves 100% for the vertebra being milled and the spinal cord, for the adjacent bony structure and the muscle the success rate is about 90%.

[1]  Paolo Gastaldo,et al.  A Tensor-Based Pattern-Recognition Framework for the Interpretation of Touch Modality in Artificial Skin Systems , 2014, IEEE Sensors Journal.

[2]  Kaddour Bouazza-Marouf,et al.  The detection of drill bit break-through for the enhancement of safety in mechatronic assisted orthopaedic drilling , 1999 .

[3]  Yuan Xue,et al.  Noncontact Vibration Measurement Based Thoracic Spine Condition Monitoring During Pedicle Drilling , 2014, IEEE/ASME Transactions on Mechatronics.

[4]  Toshiyuki Tsuchiya,et al.  Micromachined Tactile Sensor for Soft-Tissue Compliance Detection , 2012 .

[5]  Yuan Xue,et al.  Use of wavelet energy for spinal cord vibration analysis during spinal surgery , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[6]  I. Daubechies,et al.  Factoring wavelet transforms into lifting steps , 1998 .

[7]  Alireza Mirbagheri,et al.  A triple‐jaw actuated and sensorized instrument for grasping large organs during minimally invasive robotic surgery , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[8]  Takahiro Nozaki,et al.  Heartbeat Synchronization With Haptic Feedback for Telesurgical Robot , 2014, IEEE Transactions on Industrial Electronics.

[9]  Xiao Han,et al.  A Robot-Assisted Surgical System Using a Force-Image Control Method for Pedicle Screw Insertion , 2014, PloS one.

[10]  Veronica J. Santos,et al.  Spatial Asymmetry in Tactile Sensor Skin Deformation Aids Perception of Edge Orientation During Haptic Exploration , 2014, IEEE Transactions on Haptics.

[11]  M. Shimojo,et al.  A system for simultaneously measuring grasping posture and pressure distribution , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[12]  Dominiek Reynaerts,et al.  Featureless classification of tactile contacts in a gripper using neural networks , 1996 .

[13]  Gexiang Zhang,et al.  A Hybrid Classifier Based on Rough Set Theory and Support Vector Machines , 2005, FSKD.

[14]  Jivko Sinapov,et al.  Vibrotactile Recognition and Categorization of Surfaces by a Humanoid Robot , 2011, IEEE Transactions on Robotics.

[15]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[16]  Yang Qing,et al.  An Artificial Neural Network Approach to the Predictive Modeling of Tensile Force during Renal Suturing , 2012, Annals of Biomedical Engineering.

[17]  Kouhei Ohnishi,et al.  Telerobotic-assisted bone-drilling system using bilateral control with feed operation scaling and cutting force scaling , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[18]  Gregory Dudek,et al.  A Simple Tactile Probe for Surface Identification by Mobile Robots , 2011, IEEE Transactions on Robotics.

[19]  Rajnikant V. Patel,et al.  Integration of Force Reflection with Tactile Sensing for Minimally Invasive Robotics-Assisted Tumor Localization , 2013, IEEE Transactions on Haptics.

[20]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[21]  Kouhei Ohnishi,et al.  Improvement of Performances in Bilateral Teleoperation by Using FPGA , 2007, IEEE Transactions on Industrial Electronics.

[22]  R. T. Verrillo,et al.  Effect of Contactor Area on the Vibrotactile Threshold , 1963 .

[23]  Kit Yan Chan,et al.  A study of neural-network-based classifiers for material classification , 2014, Neurocomputing.

[24]  Zhang Jian-xun,et al.  Reduction of 1/ f noise in semiconductor devices based on wavelet transform and Wiener filter , 2011 .

[25]  Kaspar Althoefer,et al.  Air-float Palpation Probe for Tissue Abnormality Identification During Minimally Invasive Surgery , 2013, IEEE Transactions on Biomedical Engineering.

[26]  Maurizio Valle,et al.  Tactile-Data Classification of Contact Materials Using Computational Intelligence , 2011, IEEE Transactions on Robotics.

[27]  Blake Hannaford,et al.  The Effect of Interaction Force Estimation on Performance in Bilateral Teleoperation , 2012, IEEE Transactions on Haptics.

[28]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[29]  Jianwei Zhang,et al.  State Recognition of Pedicle Drilling With Force Sensing in a Robotic Spinal Surgical System , 2014, IEEE/ASME Transactions on Mechatronics.

[30]  Tao Mei,et al.  Online Condition Monitoring in Micromilling: A Force Waveform Shape Analysis Approach , 2015, IEEE Transactions on Industrial Electronics.

[31]  Mamun Bin Ibne Reaz,et al.  Advances in Bio-Tactile Sensors for Minimally Invasive Surgery Using the Fibre Bragg Grating Force Sensor Technique:A Survey , 2014, Sensors.

[32]  Sunita Chauhan,et al.  Spring-based tactile array for assistive robotic surgical applications , 2014 .

[33]  Marcos Louredo,et al.  DRIBON: A mechatronic bone drilling tool , 2012 .

[34]  G. J. Verkerke,et al.  Comparative anatomical dimensions of the complete human and porcine spine , 2010, European Spine Journal.

[35]  Mark Lee,et al.  Review Article Tactile sensing for mechatronics—a state of the art survey , 1999 .

[36]  Jianwei Zhang,et al.  Safety analysis and control of a robotic spinal surgical system , 2014 .

[37]  Man Bok Hong,et al.  Design and Evaluation of 2-DOF Compliant Forceps With Force-Sensing Capability for Minimally Invasive Robot Surgery , 2012, IEEE Transactions on Robotics.

[38]  Rajesh Rajamani,et al.  Flexible Microtactile Sensor for Normal and Shear Elasticity Measurements , 2012, IEEE Transactions on Industrial Electronics.

[39]  Doo Yong Lee,et al.  Estimation of environmental force for the haptic interface of robotic surgery , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[40]  Corneliu Rablau,et al.  Providing haptic feedback in robot-assisted minimally invasive surgery: A direct optical force-sensing solution for haptic rendering of deformable bodies , 2013, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[41]  David I. Lee,et al.  In vivo validation of a system for haptic feedback of tool vibrations in robotic surgery , 2013, Surgical Endoscopy.

[42]  Shih-Tseng Lee,et al.  Force control and breakthrough detection of a bone-drilling system , 2004 .

[43]  J. Thonnard,et al.  Tactile roughness discrimination of the finger pad relies primarily on vibration sensitive afferents not necessarily located in the hand , 2012, Behavioural Brain Research.

[44]  Kiyoshi Ohishi,et al.  Fine Force Reproduction Based on Motion-Copying System Using Acceleration Observer , 2014, IEEE Transactions on Industrial Electronics.