Real-time and ultrahigh accuracy image synthesis algorithm for full field of view imaging system

In this paper, we propose a real time, ultrahigh accuracy and full-field-of-view (RUF) algorithm for full field of view (FOV) imaging system. The proposed algorithm combines rough matching and precise matching method to stitch multiple images with the whole FOV in short time and high imaging quality. In order to verify real-time imaging effect of RUF algorithm, we also fabricate a multi-camera imaging system which includes 19 independent cameras. And the experiment result practically illustrates that full-FOV system can achieve good performances under a near-limiting FOV of 360° × 240° with low distortion, meanwhile, optical resolution reaches up to 95 megapixels. 100% registration-accuracy RUF algorithm for imaging in one second can be widely applied to any optical imaging engineering field with large FOV, such as remote sensing imaging, microscopy imaging, monitoring system engineering fields and so on.

[1]  R N Beck,et al.  Nomenclature for Fourier transforms of spread functions of imaging systems used in nuclear medicine. , 1972, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[2]  N. Jalili,et al.  A review of atomic force microscopy imaging systems: application to molecular metrology and biological sciences , 2004 .

[3]  Roberto Sabatini,et al.  A novel approach to night vision imaging systems development, integration and verification in military aircraft , 2013 .

[4]  Michael R. Wang,et al.  Achromatic hybrid refractive-diffractive lens with extended depth of focus. , 2004, Applied optics.

[5]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Jun Tanida,et al.  Reconstruction of a high-resolution image on a compound-eye image-capturing system. , 2004, Applied optics.

[7]  Xiao-Wei Li,et al.  Copyright protection for elemental image array by hypercomplex Fourier transform and an adaptive texturized holographic algorithm. , 2017, Optics express.

[8]  Jun Tanida,et al.  Generalized sampling using a compound-eye imaging system for multi-dimensional object acquisition. , 2010, Optics express.

[9]  Yutaka Satoh,et al.  Moving object detection by mobile Stereo Omni-directional System (SOS) using spherical depth image , 2006, Pattern Analysis and Applications.

[10]  Moshe Rubin,et al.  Mo1517 Successful Deployment and Use of Third Eye Panoramic™ a Novel Side Viewing Video CAP Fitted on a Standard Colonoscope , 2014 .

[11]  David J. Brady,et al.  Multiscale gigapixel photography , 2012, Nature.

[12]  Damian Wierzbicki,et al.  Multi-Camera Imaging System for UAV Photogrammetry , 2018, Sensors.

[13]  Luke P. Lee,et al.  Biologically Inspired Artificial Compound Eyes , 2006, Science.

[14]  Andrew R Harvey,et al.  Super-resolution imaging using a camera array. , 2014, Optics letters.

[15]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[16]  Jigang Wu,et al.  Wide field of view multifocal scanning microscopy with sparse sampling , 2016, Journal of biomedical optics.

[17]  Mengchao Ma,et al.  Catadioptric planar compound eye with large field of view. , 2018, Optics express.

[18]  Jun Tanida,et al.  Compact compound-eye projector using superresolved projection. , 2011, Optics letters.

[19]  Man Zhang,et al.  Structural design and image processing of a spherical artificial compound eye , 2015 .

[20]  Keyi Wang,et al.  Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System , 2016, Sensors.