Solving Nonlinear Optimization Problems of Real Functions in Complex Variables by Complex-Valued Iterative Methods

Much research has been devoted to complex-variable optimization problems due to their engineering applications. However, the complex-valued optimization method for solving complex-variable optimization problems is still an active research area. This paper proposes two efficient complex-valued optimization methods for solving constrained nonlinear optimization problems of real functions in complex variables, respectively. One solves the complex-valued nonlinear programming problem with linear equality constraints. Another solves the complex-valued nonlinear programming problem with both linear equality constraints and an $\boldsymbol {\ell _{1}}$ -norm constraint. Theoretically, we prove the global convergence of the proposed two complex-valued optimization algorithms under mild conditions. The proposed two algorithms can solve the complex-valued optimization problem completely in the complex domain and significantly extend existing complex-valued optimization algorithms. Numerical results further show that the proposed two algorithms have a faster speed than several conventional real-valued optimization algorithms.

[1]  Gang Feng,et al.  A neural network for robust LCMP beamforming , 2006, Signal Process..

[2]  Wei Xing Zheng,et al.  A complex-valued neural dynamical optimization approach and its stability analysis , 2015, Neural Networks.

[3]  R. Remmert,et al.  Theory of Complex Functions , 1990 .

[4]  R. Dykstra,et al.  A Method for Finding Projections onto the Intersection of Convex Sets in Hilbert Spaces , 1986 .

[5]  Danilo P. Mandic,et al.  A fully adaptive normalized nonlinear gradient descent algorithm for complex-valued nonlinear adaptive filters , 2003, IEEE Trans. Signal Process..

[6]  Ying Zhang,et al.  Sidelobe suppression for adaptive beamforming with sparse constraint on beam pattern , 2008 .

[7]  Joachim H. G. Ender,et al.  On compressive sensing applied to radar , 2010, Signal Process..

[8]  Danilo P. Mandic,et al.  Complex Valued Nonlinear Adaptive Filters , 2009 .

[9]  M.P. Hayes,et al.  Synthetic Aperture Sonar: A Review of Current Status , 2009, IEEE Journal of Oceanic Engineering.

[10]  José Mario Martínez,et al.  Nonmonotone Spectral Projected Gradient Methods on Convex Sets , 1999, SIAM J. Optim..

[11]  Guizhong Liu,et al.  Localized Multiple Kernel Learning Via Sample-Wise Alternating Optimization , 2014, IEEE Transactions on Cybernetics.

[12]  B. A. D. H. Brandwood.  A complex gradient operator and its applica-tion in adaptive array theory , 1983 .

[13]  Junyan Wang,et al.  A Recurrent Neural Network for Solving Complex-Valued Quadratic Programming Problems with Equality Constraints , 2010, ICSI.

[14]  Jun Wang,et al.  A Complex-Valued Projection Neural Network for Constrained Optimization of Real Functions in Complex Variables , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[15]  R. Dykstra.  An Algorithm for Restricted Least Squares Regression , 1983 .

[16]  Davinder Bhatia,et al.  Nonlinear programming in complex space , 1969 .

[17]  Hualiang Li,et al.  Optimization in the Complex Domain for Nonlinear Adaptive Filtering , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[18]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[19]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[20]  Adi Ben-Israel,et al.  Nonlinear Programming in Complex Space: Necessary Conditions , 1971 .

[21]  D. Mandic,et al.  Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models , 2009 .

[22]  Ken Kreutz-Delgado,et al.  The Complex Gradient Operator and the CR-Calculus ECE275A - Lecture Supplement - Fall 2005 , 2009, 0906.4835.

[23]  P. Stoica,et al.  Robust Adaptive Beamforming , 2013 .

[24]  Michael P. Friedlander,et al.  Probing the Pareto Frontier for Basis Pursuit Solutions , 2008, SIAM J. Sci. Comput..

[25]  Jun Liu,et al.  Efficient Euclidean projections in linear time , 2009, ICML '09.

[26]  W. Clem Karl,et al.  Compressed Sensing of Monostatic and Multistatic SAR , 2013, IEEE Geoscience and Remote Sensing Letters.

[27]  M. A. Hanson,et al.  Symmetric duality for quadratic programming in complex space , 1968 .

[28]  Lieven De Lathauwer,et al.  Unconstrained Optimization of Real Functions in Complex Variables , 2012, SIAM J. Optim..

[29]  Fang Liu,et al.  Nonconvex Compressed Sensing by Nature-Inspired Optimization Algorithms , 2015, IEEE Transactions on Cybernetics.

[30]  N. Levinson,et al.  Linear programming in complex space , 1966 .

[31]  Songchuan Zhang,et al.  Two Fast Complex-Valued Algorithms for Solving Complex Quadratic Programming Problems , 2016, IEEE Transactions on Cybernetics.

[32]  Yoram Singer,et al.  Efficient projections onto the {\it l}$_{\mbox{1}}$-ball for learning in high dimensions , 2008, ICML 2008.

[33]  M. A. Hanson,et al.  Duality for nonlinear programming in complex space , 1969 .

[34]  C. M. Reeves,et al.  Function minimization by conjugate gradients , 1964, Comput. J..

[35]  Wen Xu,et al.  Fast estimation of sparse doubly spread acoustic channels. , 2012, The Journal of the Acoustical Society of America.

[36]  Shuai Li,et al.  Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation , 2014, IEEE Transactions on Cybernetics.

[37]  Xiaoli Chu,et al.  A Robust Beamformer Based on Weighted Sparse Constraint , 2010, ArXiv.

[38]  Vasilios N. Katsikis,et al.  An improved method for the computation of the Moore-Penrose inverse matrix , 2011, Appl. Math. Comput..

[39]  Faezeh Toutounian,et al.  A new method for computing Moore-Penrose inverse matrices , 2009 .

[40]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[41]  R. Abrams,et al.  Nonlinear programming in complex space: Sufficient conditions and duality , 1972 .

[42]  H. Howard Fan,et al.  A Newton-like algorithm for complex variables with applications in blind equalization , 2000, IEEE Trans. Signal Process..

[43]  Thia Kirubarajan,et al.  Robust sparse channel estimation and equalization in impulsive noise using linear programming , 2013, Signal Process..

[44]  Predrag S. Stanimirovic,et al.  Iterative Method for Computing Moore-penrose Inverse Based on Penrose Equations , 2022 .

[45]  Serge Luryi,et al.  Future Trends in Microelectronics: Up the Nano Creek , 2007 .