Estimating the 3D orientation of the camera in a video sequence within a global frame of reference is useful for video stabilization when displaying the video in a virtual 3D environment, as well as for accurate navigation and other applications. This task requires the input of orientation sensors attached to the camera to provide absolute 3D orientation in a geographical frame of reference. However, high-frequency noise in the sensor readings makes it impossible to achieve accurate orientation estimates required for visually stable presentation of video sequences that were acquired with a camera subject to jitter, such as a handheld camera or a vehicle mounted camera. On the other hand, image alignment has proven successful for image stabilization, providing accurate frame-to-frame orientation estimates but drifting over time due to error and bias accumulation and lacking absolute orientation. In this paper we propose a practical method for generating high accuracy estimates of the 3D orientation of the camera within a global frame of reference by fusing orientation estimates from an efficient image-based alignment method, and the estimates from an orientation sensor, overcoming the limitations of the component methods.
[1]
Tyrone L. Vincent,et al.
Three-Dimensional Motion and Structure Estimation Using Inertial Sensors and Computer Vision for Augmented Reality
,
2002,
Presence: Teleoperators & Virtual Environments.
[2]
Ronald Azuma,et al.
Hybrid inertial and vision tracking for augmented reality registration
,
1999,
Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).
[3]
Jorge Dias,et al.
Inertial Sensed Ego-motion for 3D Vision
,
2004,
J. Field Robotics.
[4]
Dieter Schmalstieg,et al.
Global pose estimation using multi-sensor fusion for outdoor Augmented Reality
,
2009,
2009 8th IEEE International Symposium on Mixed and Augmented Reality.
[5]
Lin Chai,et al.
3-D Motion and Structure Estimation Using Inertial Sensors and Computer Vision for Augmented Reality
,
2000
.