Multi-focal video fusion with a beam splitter prism

This paper addresses the feasibility of using inexpensive, compact consumer-oriented cameras to resolve fundamental issues in capturing video footage of biological interactions in the field for quantitative analysis. The strengths and weaknesses of using a multi-camera beam splitter system to capture closely align video footage and its applications for studying biological interactions are discussed. The strength of the approach is that the closely aligned video streams are readily focal stacked to increase spatial information in a frame. Weaknesses include the limitation of the system in low light conditions where the beam splitter reduces the light captured by the cameras. Our novel system lends itself to incorporation into a camera array to capture large amounts of biological information.

[1]  Yaron Caspi,et al.  Increasing Space-Time Resolution in Video , 2002, ECCV.

[2]  David C. O'Carroll,et al.  Contrast sensitivity and the detection of moving patterns and features , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[3]  Steven D. Wiederman,et al.  Selective Attention in an Insect Visual Neuron , 2013, Current Biology.

[4]  David C. O'Carroll,et al.  Quantifying asynchrony of multiple cameras using aliased optical devices , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[5]  Jingwen Yan,et al.  High quality multi-focus image fusion using self-similarity and depth information , 2015 .

[6]  Anthony Leonardo,et al.  Internal models direct dragonfly interception steering , 2014, Nature.

[7]  Andrea Fusiello,et al.  Generation of All-in-Focus Images by Noise-Robust Selective Fusion of Limited Depth-of-Field Images , 2013, IEEE Transactions on Image Processing.

[8]  Yingjie Zhang,et al.  Efficient fusion scheme for multi-focus images by using blurring measure , 2009, Digit. Signal Process..

[9]  Rick S. Blum,et al.  A hybrid image registration technique for a digital camera image fusion application , 2001, Inf. Fusion.

[10]  Gabriel Thomas,et al.  All-in-Focus Imaging Using a Series of Images on Different Focal Planes , 2005, ICIAR.

[11]  Marc Levoy,et al.  High-speed videography using a dense camera array , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  David C O'Carroll,et al.  Correlation between OFF and ON Channels Underlies Dark Target Selectivity in an Insect Visual System , 2013, The Journal of Neuroscience.

[13]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, ACM Trans. Graph..

[14]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.