Inertial sensors aided image alignment and stitching for panorama on mobile phones

In this paper, we propose using signals collected from inertial sensors on cameras to speed up image alignment for panorama construction. Inertial sensors including accelerometers and gyroscopes are first calibrated to improve sensing accuracy. These sensors are then used to estimate the position and orientation of each captured image frame. By knowing the relative displacement of image frames, alignment can be performed with good accuracy and computational efficiency. Through examples we illustrate the effectiveness of inertial-sensor assisted panorama.