Navigation and SAR Auto-focusing in a Sensor Fusion Framework

Since its discovery, in the 1940's, radar (Radio Detection and Ranging) has become an important ranging sensor in many areas of technology and science. Most of the military and many civilian applications are unimaginable today without radar. With technology development, radar application areas have become larger and more available. One of these applications is Synthetic Aperture Radar (SAR), where an airborne radar is used to create high resolution images of the imaged scene. Although known since the 1950's, the SAR methods have been continuously developed and improved and new algorithms enabling real-time applications have emerged lately. Together with making the hardware components smaller and lighter, SAR has become an interesting sensor to be mounted on smaller unmanned aerial vehicles (UAV's). One important thing needed in the SAR algorithms is the estimate of the platform's motion, like position and velocity. Since this estimate is always corrupted with errors, particularly if lower grade navigation system, common in UAV applications, is used, the SAR images will be distorted. One of the most frequently appearing distortions caused by the unknown platform's motion is the image defocus. The process of correcting the image focus is called auto-focusing in SAR terminology. Traditionally, this problem was solved by methods that discard the platform's motion information, mostly due to the off-line processing approach, i.e. the images were created after the flight. Since the image (de)focus and the motion of the platform are related to each other, it is possible to utilise the information from the SAR images as a sensor and improve the estimate of the platform's motion. The auto-focusing problem can be cast as a sensor fusion problem. Sensor fusion is the process of fusing information from different sensors, in order to obtain best possible estimate of the states. Here, the information from sensors measuring platform's motion, mainly accelerometers, will be fused together with the information from the SAR images to estimate the motion of the flying platform. Two different methods based on this approach are tested on the simulated SAR data and the results are evaluated. One method is based on an optimisation based formulation of the sensor fusion problem, leading to batch processing, while the other method is based on the sequential processing of the radar data, leading to a filtering approach. The obtained results are promising for both methods and the obtained performance is comparable with the performance of a high precision navigation aid, such as Global Positioning System (GPS).

[1]  Predrag Pucar Segmentation of Laser Range Radar Images using Hidden Markov Field Models , 1993 .

[2]  Sören Andersson Sensor Array Processing : Application to Mobile Communication Systems and Dimension Reduction , 1990 .

[3]  T. McKelvey On State-Space Models in System Identification , 1994 .

[4]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[5]  T. Bayes An essay towards solving a problem in the doctrine of chances , 2003 .

[6]  David C. Munson,et al.  An experimental study of a new entropy-based SAR autofocus technique , 2002, Proceedings. International Conference on Image Processing.

[7]  J. Sjöberg Some Results On Optimal Control for Nonlinear Descriptor Systems , 2006 .

[8]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[9]  P. Nordlund Sequential Monte Carlo Filters and Integrated Navigation , 2002 .

[10]  P. Lindskog Algorithms and Tools for System Identification Using Prior Knowledge , 1994 .

[11]  Urban Forssell Properties and Usage of Closed-loop Identification Methods , 1997 .

[12]  Thomas B. Schön,et al.  A Nonlinear Least-Squares Approach to the SLAM Problem , 2011 .

[13]  I. Klein Planning for a Class of Sequential Control Problems , 1989 .

[14]  E. Leith,et al.  A High-Resolution Radar Combat-Surveillance System , 1961, IRE Transactions on Military Electronics.

[15]  Alf Isaksson Identification of Time Varying Systems and Application of System Identification to Signal Processing , 1986 .

[16]  B. Wahlberg On Model Simplification in System Identification , 1985 .

[17]  Fredrik Gustafsson,et al.  Statistical Sensor Fusion , 2013 .

[18]  M. Enqvist Some Results on Linear Models of Nonlinear Systems , 2003 .

[19]  F. Gustafsson Optimal Segmentation of Linear Regression Parameters , 1991 .

[20]  David Törnqvist,et al.  Statistical Fault Detection with Applications to IMU Disturbances , 2006 .

[21]  Matej Kristan,et al.  A Bayes-spectral-entropy-based measure of camera focus using a discrete cosine transform , 2006, Pattern Recognit. Lett..

[22]  J. Farrell,et al.  The global positioning system and inertial navigation , 1999 .

[23]  Christian Lundquist,et al.  Automotive Sensor Fusion for Situation Awareness , 2009 .

[24]  M. Jirstrand Algebraic Methods for Modeling and Design in Control , 1996 .

[25]  G. Hendeby,et al.  Fundamental Estimation and Detection Limits in Linear Non-Gaussian Systems , 2005 .

[26]  J. Kuipers Quaternions and Rotation Sequences , 1998 .

[27]  Fredrik Tjärnström,et al.  Quality Estimation of Approximate Models , 2000 .

[28]  Ingela Lind Regressor Selection in System Identification using ANOVA , 2001 .

[29]  Rickard Karlsson,et al.  Simulation Based Methods for Target Tracking , 2002 .

[30]  Magnus Larsson,et al.  On Modeling and Diagnosis of Discrete Event Dynamic Systems , 1997 .

[31]  K. Ståhl On the Frequency Domain Analysis of Nonlinear Systems , 1988 .

[32]  H Hellsten,et al.  An inverse method for the processing of synthetic aperture radar data , 1986 .

[33]  Thomas B. Schön,et al.  On computational methods for nonlinear estimation , 2003 .

[34]  Lennart Ljung,et al.  Direct prediction-error identification of unstable nonlinear systems applied to flight test data , 2009 .

[35]  M. Shuster A survey of attitude representation , 1993 .

[36]  Mikael Norrlöf,et al.  On Analysis and Implementation of Iterative Learning Control , 1998 .

[37]  J. Löfberg,et al.  Linear Model Predictive Control Stability and Robustness , 2001 .

[38]  Janne Harju Johansson,et al.  A Structure Utilizing Inexact Primal-Dual Interior-Point Method for Analysis of Linear Differential Inclusions , 2008 .

[39]  Ola Härkegård,et al.  Flight Control Design using Backstepping , 2001 .

[40]  Frida Gunnarsson On Modeling and Control of Network Queue Dynamics , 2003 .

[41]  Håkan Hjalmarsson On Estimation of Model Quality in System Identification , 1990 .

[42]  Malcolm D. Shuster Survey of attitude representations , 1993 .

[43]  Jeroen D. Hol,et al.  Pose Estimation and Calibration Algorithms for Vision and Inertial Sensors , 2008 .

[44]  J. Gunnarsson On Modeling of Discrete Event Dynamic Systems : Using Symbolic Algebraic Methods , 1995 .

[45]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[46]  Magnus Andersson Experimental Design and Updating of Finite Element Models , 1997 .

[47]  Jonas Gillberg,et al.  Methods for Frequency Domain Estimation of Continuous-Time Models , 2004 .

[48]  F. Rocca,et al.  SAR data focusing using seismic migration techniques , 1991 .

[49]  Weijie Li,et al.  ION , 2021, Proceedings of the 29th ACM International Conference on Multimedia.

[50]  Mats Viberg On the Adaptive Array Problem , 1987 .

[51]  F. Rocca,et al.  SYNTHETIC APERTURE RADAR:A NEW APPLICATION FOR WAVE EQUATION TECHNIQUES1 , 1989 .

[52]  J. Sjöberg Regularization Issues in Neural Network Models of Dynamical Systems , 1993 .

[53]  Andreas Eidehall,et al.  An Automotive Lane Guidance System , 2004 .

[54]  Daniel Ankelhed,et al.  On low order controller synthesis using rational constraints , 2009 .

[55]  D. J. Salmond,et al.  A particle filter for track-before-detect , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[56]  Lars M. H. Ulander,et al.  Synthetic-aperture radar processing using fast factorized back-projection , 2003 .

[57]  K. Forsman Applications of Constructive Algebra to Control Problems , 1990 .

[58]  N. Bergman Bayesian Inference in Terrain Navigation , 1997 .

[59]  Lina J. Karam,et al.  No-reference objective wavelet based noise immune image sharpness metric , 2005, IEEE International Conference on Image Processing 2005.

[60]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[61]  H. Fortell Volterra and Algebraic Approaches to the Zero Dynamics , 1994 .

[62]  Svante Björklund,et al.  A Survey and Comparison of Time-Delay Estimation Methods in Linear Systems , 2003 .

[63]  Anna Hagenblad,et al.  Aspects of the Identification of Wiener Models , 1999 .

[64]  Henrik Ohlsson,et al.  Regression on Manifolds with Implications for System Identification , 2008 .

[65]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[66]  James R. Fienup,et al.  Phase Error Correction by Shear Averaging , 1989, Signal Recovery and Synthesis III.

[67]  Claes Olsson,et al.  Active Engine Vibration Isolation using Feedback Control , 2002 .

[68]  Fredrik Gustafsson,et al.  Simultaneous navigation and SAR auto-focusing , 2010, 2010 13th International Conference on Information Fusion.

[69]  K. Chen Observability and Invertability of Nonlinear Systems : A Differential Algebraic Approach , 1991 .

[70]  Krister Edström,et al.  Simulation of Mode Switching Systems Using Switched Bond Graphs , 1996 .

[71]  Anders Skeppstedt Construction of composite models from large data-sets , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[72]  J. Plantin Algebraic Methods for Verification and Control of Discrete Event Dynamic Systems , 1995 .

[73]  Mille Millnert,et al.  Vehicle size and orientation estimation using geometric fitting , 2001 .

[74]  Per Skoglar,et al.  Planning Methods for Aerial Exploration and Ground Target Tracking , 2009 .

[75]  Peter Andersson Adaptive Forgetting through Multiple Models and Adaptive Control of Car Dynamics , 1983 .

[76]  Henrik Tidefelt Structural algorithms and perturbations in differential-algebraic equations , 2007 .

[77]  Daniel Petersson Nonlinear optimization approaches to H2-norm based LPV modelling and control , 2010 .

[78]  D. Lindgren Subspace Selection Techniques for Classification Problems , 2002 .

[79]  S. Quegan,et al.  Understanding Synthetic Aperture Radar Images , 1998 .

[80]  Jonas Jansson Tracking and decision making for automotive collision avoidance , 2002 .

[81]  Erik Geijer Lundin,et al.  Uplink Load in CDMA Cellular Systems , 2003 .

[82]  Erik Wernholt,et al.  On Multivariable and Nonlinear Identification of Industrial Robots , 2004 .

[83]  Li Xi,et al.  Autofocusing of ISAR images based on entropy minimization , 1999 .

[84]  Peter Peter MaMiS : A Programming Environment for Numerical/Symbolic Data Processing , 1988 .

[85]  Jan Palmqvist On Integrity Monitoring of Integrated Navigation Systems , 1997 .

[86]  Rikard Falkeborn Structure Exploitation in Semidefinite Programming for Control , 2010 .

[87]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[88]  Niclas Persson,et al.  Event Based Sampling with Application to Spectral Estimation , 2002 .

[89]  Mengdao Xing,et al.  Motion Compensation for UAV SAR Based on Raw Radar Data , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[90]  Gert Malmberg A Study of Adaptive Control of Missiles , 1986 .

[91]  Jonas Elbornsson,et al.  Equalization of Distortion in A/D Converters , 2001 .

[92]  Valur Einarsson On Verification of Switched Systems using Abstractions , 1998 .

[93]  John A. Fawcett,et al.  Inversion of N-dimensional spherical averages , 1985 .

[94]  Svante Gunnarsson On the Mean Square Error of Transfer Function Estimates with Applications to Control , 1986 .

[95]  Zhijie Xia,et al.  Modeling and control of flexible manipulators , 1992 .

[96]  A. Stenman Just-in-Time Models with Applications to Dynamical Systems , 1997 .

[97]  T. Andersson Concepts and Algorithms for Non-Linear System Identifiability , 1994 .

[98]  Johanna Wallén,et al.  On Kinematic Modelling and Iterative Learning Control of Industrial Robots , 2008 .

[99]  Christian Lyzell,et al.  Initialization Methods for System Identification , 2009 .

[100]  Jakob Roll Robust Verification and Identification of Piecewise Affine Systems , 2001 .

[101]  L. Andersson On the determination of a function from spherical averages , 1988 .

[102]  Charles V. Jakowatz,et al.  Phase gradient autofocus-a robust tool for high resolution SAR phase correction , 1994 .

[103]  Daniel Axehill,et al.  Applications of Integer Quadratic Programming in Control and Communication , 2005 .

[104]  Mille Millnert,et al.  Fast Power Control to Counteract Rayleigh Fading in Cellular Radio Systems , 1995 .