Hemispherical Multiple Camera System for High Resolution Omni-Directional Light Field Imaging

Inspiration from light field imaging concepts has led to the construction of multi-aperture imaging systems. Using multiple cameras as individual apertures is a topic of high relevance in the light field imaging domain. The need for wide field-of-view (FOV) and high-resolution video for applications in areas of surveillance, robotics and automotive systems has driven the idea of omni-directional vision. Recently, the Panoptic camera concept has been presented that mimics the eyes of flying insects using multiple imagers. The Panoptic camera utilizes a novel methodology for constructing a spherically arranged wide FOV plenoptic imaging system whereas omni-directional image quality is limited by low resolution sensors. In this paper, a very-high resolution light field imaging and recording system inspired from the Panoptic approach is presented. Major challenges consisting of managing the huge amount of data as well as maintaining a scalable system are addressed. The proposed system is capable of recording omni-directional video at 30 fps with a resolution exceeding 9000 2400 pixels. The system is capable of capturing the surrounding light field in a FOV. This important feature opens the door to various post processing techniques such as quality-enhanced 3D cinematography, very high resolution depth map estimation and high dynamic-range applications which are beyond standard stitching and panorama generation.

[1]  Laurent Jacques,et al.  The PANOPTIC Camera: A Plenoptic Sensor with Real-Time Omnidirectional Capability , 2013, J. Signal Process. Syst..

[2]  Takeo Kanade,et al.  Virtualized reality: constructing time-varying virtual worlds from real world events , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[3]  Yusuf Leblebici,et al.  A spherical multi-camera system with real-time omnidirectional video acquisition capability , 2012, IEEE Transactions on Consumer Electronics.

[4]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[5]  Gang Cheng,et al.  Real-Time FPGA-Based Panoramic Unrolling of High-Resolution Catadioptric Omnidirectional Images , 2009, 2009 International Conference on Measuring Technology and Mechatronics Automation.

[6]  Jong-Eun Ha,et al.  Simple method for calibrating omnidirectional stereo with multiple cameras , 2011 .

[7]  Pascal Frossard,et al.  Plenoptic based super-resolution for omnidirectional image sequences , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Peter Schreiber,et al.  Artificial compound eyes: different concepts and their application for ultraflat image acquisition sensors , 2004, SPIE MOEMS-MEMS.

[9]  Shree K. Nayar,et al.  Real-Time Omnidirectional and Panoramic Stereo , 1998 .

[10]  Pascal Fua,et al.  Multicamera People Tracking with a Probabilistic Occupancy Map , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Tao Liu,et al.  Wide Field of View CCD Camera Based on Multi-sensors Image Mosaics , 2008, 2008 Congress on Image and Signal Processing.

[12]  Ramesh Raskar,et al.  Krill-eye : Superposition compound eye for wide-angle imaging via GRIN lenses , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[13]  Tien-Tsin Wong,et al.  A system for real-time panorama generation and display in tele-immersive applications , 2005, IEEE Transactions on Multimedia.

[14]  Takeo Kanade,et al.  Virtual ized reality: constructing time-varying virtual worlds from real world events , 1997 .

[15]  Y. Leblebici,et al.  Real-time implementation of Gaussian image blending in a spherical light field camera , 2013, 2013 IEEE International Conference on Industrial Technology (ICIT).

[16]  Luigi Bagnato,et al.  Omnidirectional Light Field Analysis and Reconstruction , 2012 .

[17]  Laurent Jacques,et al.  Hardware implementation of an omnidirectional camerawith real-time 3D imaging capability , 2011, 2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[18]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[19]  David San Segundo Bello,et al.  An insect eye-based image sensor with very large field of view , 2010, Photonics Europe.

[20]  Yusuf Leblebici,et al.  Enhanced Omnidirectional Image Reconstruction Algorithm and Its Real-Time Hardware , 2012, 2012 15th Euromicro Conference on Digital System Design.