Kalman Filters in Constrained Model Based Tracking

Model-based vision allows the recovery and tracking of the 3D position and orientation of a known object from a sequence of images. A Kalman filter can be used to improve the tracking stability with three main benefits. Firstly it is an optimal filter in the least squares sense, with the added advantage that the physical dynamics and constraints of the tracking problem can easily be built into the system model. Secondly the measurement model allows for uncertainty in the measurement of the recovered model position. Thirdly, data on the empirical error are generated which can, for example, be used to control the model matching process used in the tracking.