Motion Blur-Based State Estimation

Motion measurement increasingly deploys image sensors such as charge-coupled device and CMOS arrays, driven by their ever-improving resolution, response time, noise level, and cost. The typical usage is to operate an image sensor and the associated optics as a sampler, by taking a series of high-speed sharp pictures to infer motion. Image blur is treated as an undesirable artifact, to be removed using shorter exposure times or image processing techniques such as deblurring. We have previously shown that dynamic information embedded in image blur may be exploited for model identification in frequency ranges well beyond the Nyquist frequency. In this brief, we investigate the state estimation problem using motion blur. We pose the problem as a minimization, estimating the state at the start of each (slow) sampling period based on the observed motion blur. We show that the local convexity of the minimization corresponds to a generalized observability criterion. This method is compared with other techniques, including the conventional centroid-based method, and that based on the use of multiple image moments. The simulation and experimental results demonstrate the fast response and robustness of the proposed scheme in the presence of synthetic stray light.

[1]  D. Simon Kalman filtering with state constraints: a survey of linear and nonlinear algorithms , 2010 .

[2]  Sirish L. Shah,et al.  Nonlinear Bayesian state estimation: A review of recent developments , 2012 .

[3]  M. Araki,et al.  Multivariable multirate sampled-data systems: State-space description, transfer characteristics, and Nyquist criterion , 1986 .

[4]  Raghunathan Rengaswamy,et al.  Recursive estimation in constrained nonlinear dynamical systems , 2005 .

[5]  Worthy N. Martin,et al.  Image Motion Estimation From Motion Smear-A New Computational Model , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Robert Bregovic,et al.  Multirate Systems and Filter Banks , 2002 .

[7]  John T. Wen,et al.  On multirate control of a fast-rate beam steering system using slow-rate image sensor feedback , 2013, 52nd IEEE Conference on Decision and Control.

[8]  Chung Choo Chung,et al.  Multirate digital control system design , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[9]  FortunDenis,et al.  Optical flow modeling and computation , 2015 .

[10]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[11]  Anita Sellent,et al.  Motion Field Estimation from Alternate Exposure Images , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  J. Wen,et al.  Identification of Fast-Rate Systems Using Slow-Rate Image Sensor Measurements , 2014, IEEE/ASME Transactions on Mechatronics.

[13]  Patrick Bouthemy,et al.  Optical flow modeling and computation: A survey , 2015, Comput. Vis. Image Underst..

[14]  John T. Wen,et al.  Extracting dynamics from blur , 2011, IEEE Conference on Decision and Control and European Control Conference.

[15]  Johannes P. Schlöder,et al.  A real-time algorithm for moving horizon state and parameter estimation , 2011, Comput. Chem. Eng..

[16]  Michael V. Basin,et al.  Itô–Volterra Optimal State Estimation With Continuous, Multirate, Randomly Sampled, and Delayed Measurements , 2007, IEEE Transactions on Automatic Control.

[17]  Seungyong Lee,et al.  Recent advances in image deblurring , 2013, SA '13.

[18]  R. Mersereau,et al.  Iterative methods for image deblurring , 1990 .

[19]  James B. Rawlings,et al.  Particle filtering and moving horizon estimation , 2006, Comput. Chem. Eng..

[20]  H. Sorenson Least-squares estimation: from Gauss to Kalman , 1970, IEEE Spectrum.

[21]  Ioannis M. Rekleitis Optical flow recognition from the power spectrum of a single blurred image , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[22]  F. Daum Nonlinear filters: beyond the Kalman filter , 2005, IEEE Aerospace and Electronic Systems Magazine.

[23]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[24]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[25]  John T. Wen,et al.  State estimation of fast-rate systems using slow-rate image sensors , 2013, 2013 American Control Conference.

[26]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.