Panoramic video using scale-invariant feature transform with embedded color-invariant values

The resolutions offered by today's multimedia vary significantly owing to the development of video technology. For example, there is a huge gap between the resolution of cellular phones as small input devices and beam projectors as large output devices. Thus, panoramic video technology is one method that can convert a small resolution into a large resolution to lend realism and wide vision to a scene. Yet, transforming the resolution of an image requires feature or object matching based on extracting important information from the image, where the scale-invariant feature transform (SIFT) is one of the most robust and widely used methods. However, identifying corresponding points becomes difficult in the case of changing illumination or two surfaces with a similar intensity, as SIFT extracts features using only gray information. Therefore, this paper proposes a method of image stitching based on color-invariant features for automated panoramic videos. Color-invariant features can discount the illumination, highlights, and shadows in a scene, as they include the property of the surface reflectance independent of illumination changes. The effectiveness and accuracy of the feature matching with the proposed algorithm are verified using objects and illuminations in a booth, followed by panoramic videos.

[1]  L. Álvarez,et al.  Morphological Corner Detection . Application to Camera Calibration , 2001 .

[2]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[3]  Hsien-Che Lee,et al.  Introduction to Color Imaging Science , 2005 .

[4]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[5]  Dani Lischinski,et al.  Dynamosaics: video mosaics with non-chronological time , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[7]  Hsien-Che Lee Introduction to Color Imaging Science: Eye optics , 2005 .

[8]  Wonpil Yu,et al.  Practical anti-vignetting methods for digital cameras , 2004, IEEE Trans. Consumer Electron..

[9]  Junhee Park,et al.  Lens distortion correction using ideal image coordinates , 2009, IEEE Transactions on Consumer Electronics.

[10]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Peter A. Rhodes,et al.  A study of digital camera colorimetric characterisation based on polynomial modelling , 2001 .

[13]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[14]  Jun-Wei Hsieh,et al.  Fast stitching algorithm for moving object detection and mosaic construction , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[15]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[16]  G D Finlayson,et al.  Color constancy at a pixel. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  S. M. Steve SUSAN - a new approach to low level image processing , 1997 .

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  Hsien-Che Lee Introduction to Color Imaging Science: Index , 2005 .

[21]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[22]  H. Opower Multiple view geometry in computer vision , 2002 .