Hybrid Kalman filter for improvement of camera-based position sensor

When using a camera as a position sensor, the measurement is limited in bandwidth, mainly due to the blur effects. The knowledge of an accurate model of the camera is then necessary to reconstruct the trajectory from the measurements given by the camera. This paper deals with the reconstruction of the continuous-time trajectory from the discrete-time measurements provided by the camera and shows the improvement obtained by using an accurate camera model. In the proposed methodology, a Kalman filter is used for the data fusion between the model and the measurement. The tuning and implementation of the filter are discussed in the specific context of the camera measurement. The system is evaluated in the context of a biomedical application: the reconstruction of the movement of a beating-heart.

[1]  Edouard Laroche,et al.  Motion Prediction for Computer-Assisted Beating Heart Surgery , 2009, IEEE Transactions on Biomedical Engineering.

[2]  Koichi Hashimoto,et al.  3,000-fps 3-D shape measurement using a high-speed camera-projector system , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Jacques Gangloff,et al.  Towards robotized beating heart TECABG: Assessment of the heart dynamics using high-speed vision , 2006, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[4]  Jos Vander Sloten,et al.  High Speed Visual Servoing with Ultrasonic Motors , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  Robert D. Howe,et al.  Quasiperiodic predictive filtering for robot-assisted beating heart surgery , 2008, 2008 IEEE International Conference on Robotics and Automation.

[6]  Tom Drummond,et al.  A Single-frame Visual Gyroscope , 2005, BMVC.

[7]  Giacomo Boracchi.  Estimating the 3D direction of a translating camera from a single motion-blurred image , 2009, Pattern Recognit. Lett..

[8]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[9]  Edouard Laroche,et al.  A cardiac motion compensation device based on gyroscopic effect , 2009 .

[10]  Edouard Laroche,et al.  Methodological Insights for Online Estimation of Induction Motor Parameters , 2008, IEEE Transactions on Control Systems Technology.

[11]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice Using MATLAB , 2001 .

[12]  Richard A. Brown,et al.  Introduction to random signals and applied kalman filtering (3rd ed , 2012 .

[13]  Ruigang Yang,et al.  Camera-based calibration techniques for seamless multiprojector displays , 2005, IEEE Transactions on Visualization and Computer Graphics.

[14]  Edouard Laroche,et al.  Dynamical models for position measurement with global shutter and rolling shutter cameras , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Edouard Laroche,et al.  Cardiolock: An active cardiac stabilizer. First in vivo experiments using a new robotized device , 2008, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[16]  José Luis Lázaro,et al.  Method to measure the rotation angles in vibrating systems , 2006, IEEE Transactions on Instrumentation and Measurement.

[17]  Luc Soler,et al.  Beating heart tracking in robotic surgery using 500 Hz visual servoing, model predictive control and an adaptive observer , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.