Active tremor compensation in handheld instrument for microsurgery

Human's ability to perform precise micromanipulation is limited by small involuntary movements inherent to normal hand motion. Microsurgery is one area where the surgeons' performance is hampered by this manual imprecision. Not only that it complicates many delicate surgical procedures, it also makes certain types of intervention impossible. The most familiar type of erroneous movement affecting a healthy person is physiological tremor. Instead of going with the more familiar approach of using a teleoperated robotic system, we adopted a less obtrusive and much cheaper approach of implementing accuracy enhancement within a completely handheld tool. This device senses its own motion, distinguishes the erroneous motion from the intended motion, and manipulates its own tip in real time to compensate the erroneous motion. This dissertation focuses on the sensing and compensation of the erroneous motion, while tremor modeling and estimation is performed by a previously developed weighted-frequency Fourier linear combiner (WFLC) algorithm. Instantaneous motion of the instrument is sensed by a new magnetometer-aided all-accelerometer inertial measurement unit (IMU). The sensing system consists of three dual-axis miniature accelerometers and a three-axis magnetometer. The redundancy in sensing provides two sources of orientation and position information. The angular motion information derived from the differential sensing kinematics algorithm has very high sensing resolution but suffers from integration drift; on the other hand, the orientation obtained from the gravity and magnetic North vectors is noisy but non-drifting. These two complementary sensing sources are fused via an augmented state quaternion-based Kalman filter to yield high quality sensing. The instrument tip is manipulated by a three DOF parallel manipulator driven by piezoelectric actuators. The hysteretic non-linearity of the piezoelectric actuator is modeled and linearized by a rate-dependent Prandtl-Ishlinskii operator. Based on the dynamic hysteresis model, an open-loop inverse feedfoward controller is implemented to accurately track dynamic motion profiles. While the targeted application of this dissertation is in microsurgery, the principles of the approach is universal and can be extended to other micromanipulation tasks, such as cell manipulation in the biotech industry, gun-sights or handheld military tracking equipment, and handheld video photography etc.

[1]  R. C. Harwell,et al.  Physiologic tremor and microsurgery , 1983, Microsurgery.

[2]  K. Furutani,et al.  Displacement control of piezoelectric element by feedback of induced charge , 1998 .

[3]  Ounaies Zoubeida,et al.  A model for rate-dependent hysteresis in piezoceramic materials operating at low frequencies , 2001 .

[4]  R. Mortensen Strapdown Guidance Error Analysis , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[5]  Drora Goshen-Meskin,et al.  Unified Approach to Inertial Navigation System Error Modeling , 1990 .

[6]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999, Int. J. Robotics Res..

[7]  Hugh F. Durrant-Whyte,et al.  A new method for the nonlinear transformation of means and covariances in filters and estimators , 2000, IEEE Trans. Autom. Control..

[8]  M. Shuster,et al.  Three-axis attitude determination from vector observations , 1981 .

[9]  Cameron N. Riviere,et al.  Design and implementation of active error canceling in hand-held microsurgical instrument , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[10]  Chen PeterJ.,et al.  A macroscopic theory for the existence of the hysteresis and butterfly loops in ferroelectricity , 1980 .

[11]  Xiaoming Hu,et al.  Drift-free attitude estimation for accelerated rigid bodies , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[12]  M. Gresty,et al.  A normative study of postural tremor of the hand. , 1982, Archives of neurology.

[13]  Mayergoyz,et al.  Mathematical models of hysteresis. , 1986, Physical review letters.

[14]  E. de Juan,et al.  Quantitative measurement of the effects of caffeine and propranolol on surgeon hand tremor. , 1997, Archives of ophthalmology.

[15]  M. Gresty,et al.  Spectral analysis of tremor: understanding the results. , 1990, Journal of neurology, neurosurgery, and psychiatry.

[16]  Christopher Verplaetse,et al.  Inertial Proprioceptive Devices: Self-Motion-Sensing Toys and Tools , 1996, IBM Syst. J..

[17]  Cameron N. Riviere,et al.  Physiological tremor amplitude during retinal microsurgery , 2002, Proceedings of the IEEE 28th Annual Northeast Bioengineering Conference (IEEE Cat. No.02CH37342).

[18]  Cameron N. Riviere,et al.  A study of instrument motion in retinal microsurgery , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[19]  N. Thakor,et al.  Adaptive Fourier estimation of time-varying evoked potentials , 1989, IEEE Transactions on Biomedical Engineering.

[20]  T Rahman,et al.  Tremor suppression through impedance control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[21]  N.V. Thakor,et al.  Adaptive cancelling of physiological tremor for improved precision in microsurgery , 1998, IEEE Transactions on Biomedical Engineering.

[22]  C. Newcomb,et al.  Improving the linearity of piezoelectric ceramic actuators , 1982 .

[23]  Tadahiro Hasegawa,et al.  Modeling of shape memory alloy actuator and tracking control system with the model , 2001, IEEE Trans. Control. Syst. Technol..

[24]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[25]  G. Schmidt,et al.  Inertial sensor technology trends , 2001 .

[26]  Michael Goldfarb,et al.  Modeling Piezoelectric Stack Actuators for Control of Mlcromanlpulatlon , 2022 .

[27]  Y. Stepanenko,et al.  Intelligent control of piezoelectric actuators , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[28]  Michael Goldfarb,et al.  Behavioral implications of piezoelectric stack actuators for control of micromanipulation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[29]  William H. Press,et al.  Numerical recipes in C , 2002 .

[30]  M J Rosen,et al.  Evaluating manual control devices for those with tremor disability. , 1987, Journal of rehabilitation research and development.

[31]  Gi Sang Choi,et al.  A study on position control of piezoelectric actuators , 1997, ISIE '97 Proceeding of the IEEE International Symposium on Industrial Electronics.

[32]  Vincent Hayward,et al.  Phase control approach to hysteresis reduction , 2001, IEEE Trans. Control. Syst. Technol..

[33]  Darryll J. Pines,et al.  Characterization of Ring Laser Gyro Performance Using the Allan Variance Method , 1997 .

[34]  A. Prochazka,et al.  Attenuation of pathological tremors by functional electrical stimulation I: Method , 2006, Annals of Biomedical Engineering.

[35]  J. Wen,et al.  Preisach modeling of piezoceramic and shape memory alloy hysteresis , 1995, Proceedings of International Conference on Control Applications.

[36]  Tariq Rahman,et al.  A new approach to suppressing abnormal tremor through signal equalization , 1995 .

[37]  I. Bar-Itzhack,et al.  Attitude Determination from Vector Observations: Quaternion Estimation , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[38]  Chih-Lyang Hwang,et al.  A reinforcement discrete neuro-adaptive control for unknown piezoelectric actuator systems with dominant hysteresis , 2003, IEEE Trans. Neural Networks.

[39]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999 .

[40]  Richard A. Brown,et al.  Introduction to random signals and applied kalman filtering (3rd ed , 2012 .

[41]  Dennis P. Han,et al.  A study of surgical approaches to retinal vascular occlusions. , 2000, Archives of ophthalmology.

[42]  Eric Foxlin,et al.  Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[43]  M. M. Tehrani,et al.  Ring Laser Gyro Data Analysis With Cluster Sampling Technique , 1983, Other Conferences.

[44]  Robert B. McGhee,et al.  An improved quaternion-based Kalman filter for real-time tracking of rigid body orientation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[45]  Hugh F. Durrant-Whyte,et al.  Inertial navigation systems for mobile robots , 1995, IEEE Trans. Robotics Autom..

[46]  M. Patkin Ergonomics applied to the practice of microsurgery. , 1977, The Australian and New Zealand journal of surgery.

[47]  K. Kuhnen,et al.  Inverse feedforward controller for complex hysteretic nonlinearities in smart-material systems , 2001 .

[48]  Sou-Chen Lee,et al.  Gyroscope Free Strapdown Inertial Measurement Unit by Six Linear Accelerometers , 1994 .

[49]  Yi Guo,et al.  An H∞ almost disturbance decoupling robust controller design for a piezoelectric bimorph actuator with hysteresis , 1999, IEEE Trans. Control. Syst. Technol..

[50]  P Jakeman,et al.  The effect of alcohol on physiological tremor , 1994, Experimental physiology.

[51]  Donald Benson,et al.  A Comparison of Two Approaches to Pure-Inertial and Doppler-Inertial Error Analysis , 1975, IEEE Transactions on Aerospace and Electronic Systems.

[52]  K. Kuhnen,et al.  Inverse control of systems with hysteresis and creep , 2001 .

[53]  Jang Gyu Lee,et al.  Equivalent ARMA model representation for RLG random errors , 2000, IEEE Trans. Aerosp. Electron. Syst..

[54]  Cameron N. Riviere,et al.  Assistive Human-Machine Interfaces via Artificial Neural Netwoks , 2002 .

[55]  B. S. Davis,et al.  Using low-cost MEMS accelerometers and gyroscopes as strapdown IMUs on rolling projectiles , 1998, IEEE 1998 Position Location and Navigation Symposium (Cat. No.98CH36153).

[56]  Hendrik Johannes Luinge,et al.  Inertial sensing of human movement , 2002 .

[57]  Michael Zyda,et al.  Design and implementation of MARG sensors for 3-DOF orientation measurement of rigid bodies , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[58]  Russell H. Taylor,et al.  Computer-Integrated Surgery: Technology and Clinical Applications , 1995 .

[59]  P. Mitchell,et al.  Prevalence and associations of retinal vein occlusion in Australia. The Blue Mountains Eye Study. , 1996, Archives of ophthalmology.

[60]  M. Patkin ERGONOMICS APPLIED TO THE PRACTICE OF MICROSURGERY1 , 1977 .

[61]  Peter C. Cheeseman,et al.  Estimating uncertain spatial relationships in robotics , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[62]  Liter Siek,et al.  Electrical modeling of MEMS sensor for integrated accelerometer applications , 1999, Proceedings 1999 IEEE Hong Kong Electron Devices Meeting (Cat. No.99TH8458).

[63]  Yangsheng Xu,et al.  Learning and validation of human control strategies , 1998 .

[64]  Jens Timmer,et al.  Analyzing the dynamics of hand tremor time series , 1992, Biological Cybernetics.

[65]  J. Weiss Treatment of central retinal vein occlusion by injection of tissue plasminogen activator into a retinal vein. , 1998, American journal of ophthalmology.

[66]  C. Riviere,et al.  Characteristics of hand motion of eye surgeons , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[67]  J. L. Weston,et al.  Modern inertial navigation technology and its application , 2000 .

[68]  E. J. Lefferts,et al.  Kalman Filtering for Spacecraft Attitude Estimation , 1982 .

[69]  Guillermo Rodriguez,et al.  Development of a telemanipulator for dexterity enhanced microsurgery , 1995 .

[70]  Sabri Cetinkunt,et al.  Design, fabrication, and real-time neural network control of a three-degrees-of-freedom nanopositioner , 2000 .

[71]  A. Hoogerwerf,et al.  Analytical modeling of squeeze film damping in accelerometers , 1997, Proceedings of International Solid State Sensors and Actuators Conference (Transducers '97).

[72]  Gang Tao,et al.  Adaptive control of plants with unknown hystereses , 1995 .

[73]  James C. Wilcox,et al.  A New Algorithm for Strapped-Down Inertial Navigation , 1967, IEEE Transactions on Aerospace and Electronic Systems.

[74]  M. Shibata Error analysis strapdown inertial navigation using quaternions , 1986 .

[75]  B. Friedland Analysis Strapdown Navigation Using Quaternions , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[76]  Ping Ge,et al.  Tracking control of a piezoceramic actuator , 1996, IEEE Trans. Control. Syst. Technol..

[77]  H. Janocha,et al.  Adaptive inverse control of piezoelectric actuators with hysteresis operators , 1999, 1999 European Control Conference (ECC).

[78]  Cameron N. Riviere,et al.  An Active Hand-Held Instrument for Enhanced Microsurgical Accuracy , 2000, MICCAI.

[79]  Lynette A. Jones,et al.  A Teleoperated Microsurgical Robot and Associated Virtual Environment for Eye Surgery , 1993, Presence: Teleoperators & Virtual Environments.

[80]  Michael Harrington,et al.  Miniature six-DOF inertial system for tracking HMDs , 1998, Defense, Security, and Sensing.

[81]  Nitish V. Thakor,et al.  An adaptive estimation of periodic signals using a Fourier linear combiner , 1994, IEEE Trans. Signal Process..

[82]  F. Markley,et al.  Quaternion Attitude Estimation Using Vector Observations , 2000 .

[83]  Yangsheng Xu,et al.  Human skill transfer: neural networks as learners and teachers , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[84]  Zhongwei Jiang,et al.  Nonlinear Hysteresis Compensation of Piezoelectric Ceramic Actuators , 1996 .

[85]  J. Pieper,et al.  Error analysis of direction cosines and quaternion parameters techniques for aircraft attitude determination , 1998 .

[86]  Cameron N. Riviere,et al.  Augmenting the human-machine interface: improving manual accuracy , 1997, Proceedings of International Conference on Robotics and Automation.

[87]  Kok-Meng Lee,et al.  Kinematic analysis of a three-degrees-of-freedom in-parallel actuated manipulator , 1988, IEEE J. Robotics Autom..

[88]  Kok-Meng Lee,et al.  Dynamic analysis of a three-degrees-of-freedom in-parallel actuated manipulator , 1988, IEEE J. Robotics Autom..

[89]  Patrick S. Jensen,et al.  Surgical Forces and Tactile Perception During Retinal Microsurgery , 1999, MICCAI.

[90]  John S. Baras,et al.  Control of Hysteresis in Smart Actuators. Part 1. Modeling, Parameter Identification, and Inverse Control , 2002 .

[91]  W. Galinaitis Two Methods for Modeling Scalar Hysteresis and their use in Controlling Actuators with Hysteresis , 1999 .

[92]  Chih-Lyang Hwang,et al.  Robust control design for a piezoelectric actuator system with dominant hysteresis , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[93]  Cameron N. Riviere,et al.  Precision measurement for microsurgical instrument evaluation , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[94]  P. Varaiya,et al.  Design of gyroscope-free navigation systems , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[95]  Demoz Gebre-Egziabher,et al.  A Non-linear , Two-step Estimation Algorithm for Calibrating Solid-state Strapdown Magnetometers , 2001 .

[96]  Jason J. Ford,et al.  On-line estimation of Allan variance parameters , 1999, 1999 Information, Decision and Control. Data and Information Fusion Symposium, Signal Processing and Communications Symposium and Decision and Control Symposium. Proceedings (Cat. No.99EX251).