Enhancing Moving Objects in light field videos using 5-D IIR adaptive depth-velocity filters

The spectrum of an object moving in 5-D light field videos (also known as plenoptic videos) with constant velocity and at non-constant depth is analyzed. Based on this analysis, a novel 5-D IIR adaptive depth-velocity filter is proposed for enhancing such objects. The time-variant coefficients of the proposed 5-D IIR adaptive depth-velocity filter are derived in closed form. Numerical simulation results confirm the effectiveness of the proposed filter compared to 3-D IIR adaptive velocity filters and 4-D IIR adaptive depth filters.

[1]  Leonard T. Bruton,et al.  A 4D frequency-planar IIR filter and its application to light field processing , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[2]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[3]  Leonard T. Bruton,et al.  A 5-D IIR depth-velocity filter for enhancing objects moving on linear-trajectories in light field videos , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[4]  Leonard T. Bruton,et al.  3-D IIR filtering using decimated DFT-polyphase filter bank structures , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[5]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[6]  Stefan B. Williams,et al.  Linear Volumetric Focus for Light Field Cameras , 2015, TOGS.

[7]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[8]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[9]  Leonard T. Bruton,et al.  Practical-BIBO stability of n-dimensional discrete systems , 1983 .

[10]  Anton Kummert,et al.  A multidimensional wave digital filter bank for video-based motion analysis , 2014, Multidimens. Syst. Signal Process..

[11]  Marc Levoy,et al.  Using plane + parallax for calibrating dense camera arrays , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  Amar Aggoun,et al.  Embedded FIR filter design for real-time refocusing using a standard plenoptic video camera , 2014, Electronic Imaging.

[13]  Soo-Chang Pei,et al.  Tracking moving objects in image sequences using 1-D trajectory filter , 2006, IEEE Signal Processing Letters.

[14]  Leonard T. Bruton,et al.  A 4-D Dual-Fan Filter Bank for Depth Filtering in Light Fields , 2007, IEEE Transactions on Signal Processing.

[15]  Leonard T. Bruton,et al.  Three-dimensional image processing using the concept of network resonance , 1985 .

[16]  Nozomu Hamada,et al.  Design of optimal filter for detecting linear trajectory signals utilizing object shape and velocity vector , 2000 .

[17]  Anton Kummert,et al.  Detection of Moving Objects in Image Sequences using 3D Velocity Filters , 2008, Int. J. Appl. Math. Comput. Sci..

[18]  Leonard T. Bruton,et al.  A low-complexity 3D spatio-temporal FIR filter for enhancing linear trajectory signals , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Leonard T. Bruton,et al.  Five-Dimensional Depth-Velocity Filtering for Enhancing Moving Objects in Light Field Videos , 2015, IEEE Transactions on Signal Processing.

[20]  Leonard T. Bruton,et al.  The enhancement and tracking of moving objects in digital images using adaptive three-dimensional recursive filters , 1986 .

[21]  Marc Levoy,et al.  Synthetic Aperture Focusing using a Shear-Warp Factorization of the Viewing Transform , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.