Convex Relaxation of Discrete Vector-Valued Optimization Problems

We consider a class of in nite-dimensional optimization problems in which a distributed vector-valued variable should pointwise almost everywhere take values from a given nite set M ⊂ R . Such hybrid discrete–continuous problems occur in, e.g., topology optimization or medical imaging and are challenging due to their lack of weak lower semicontinuity. To circumvent this di culty, we introduce as a regularization term a convex integral functional with an integrand that has a polyhedral epigraph with vertices corresponding to the values ofM; similar to the L1 norm in sparse regularization, this “vector multibang penalty” promotes solutions with the desired structure while allowing the use of tools from convex optimization for the analysis as well as the numerical solution of the resulting problem. We show well-posedness of the regularized problem and analyze stability properties of its solution in a general setting. We then illustrate the approach for three speci c model optimization problems of broader interest: optimal control of the Bloch equation, optimal control of an elastic deformation, and a multimaterial branched transport problem. In the rst two cases, we derive explicit characterizations of the penalty and its generalized derivatives for a concrete class of sets M. For the third case, we discuss the algorithmic computation of these derivatives for general sets. These derivatives are then used in a superlinearly convergent semismooth Newton method applied to a sequence of regularized optimization problems. We illustrate the behavior of this approach for the threemodel problemswith numerical examples.

[1]  Michael Ulbrich,et al.  Semismooth Newton Methods for Variational Inequalities and Constrained Optimization Problems in Function Spaces , 2011, MOS-SIAM Series on Optimization.

[2]  Rudolf Stollberger,et al.  Efficient high-resolution RF pulse design applied to simultaneous multi-slice excitation. , 2016, Journal of magnetic resonance.

[3]  Christian Clason,et al.  Convex regularization of discrete-valued inverse problems , 2017, 1707.01041.

[5]  Burkhard Luy,et al.  New strategies for designing robust universal rotation pulses: application to broadband refocusing at low power. , 2012, Journal of magnetic resonance.

[6]  Thomas M. Liebling,et al.  Analysis of Backtrack Algorithms for Listing All Vertices and All Faces of a Convex Polyhedron , 1997, Comput. Geom..

[7]  U. Haeberlen,et al.  The theoretical and practical limits of resolution in multiple-pulse high-resolution NMR of solids , 1996 .

[8]  Serge Nicaise,et al.  About the Lamé system in a polygonal or a polyhedral domain and a coupled problem between the Lamé system and the plate equation. II : exact controllability , 1993 .

[9]  Kazufumi Ito,et al.  Optimal Control with Lp(Ω), $p\in [0, 1)$, Control Cost , 2014, SIAM J. Control. Optim..

[10]  Kawin Setsompop,et al.  Advancing RF pulse design using an open‐competition format: Report from the 2015 ISMRM challenge , 2017, Magnetic resonance in medicine.

[11]  Fredi Tröltzsch,et al.  Optimality conditions and generalized bang—bang principle for a state—constrained semilinear parabolic problem , 1996 .

[12]  Hyunjoong Kim,et al.  Functional Analysis I , 2017 .

[13]  Stefan Ulbrich,et al.  Optimization with PDE Constraints , 2008, Mathematical modelling.

[14]  Roland Becker,et al.  Efficient numerical solution of parabolic optimization problems by finite element methods , 2007, Optim. Methods Softw..

[15]  K. Kunisch,et al.  Total variation regularization of multi-material topology optimization , 2017, 1708.06165.

[16]  Timo O. Reiss,et al.  Optimal control of coupled spin dynamics: design of NMR pulse sequences by gradient ascent algorithms. , 2005, Journal of magnetic resonance.

[17]  Discrete-valued-pulse optimal control algorithms: Application to spin systems , 2015, 1508.05787.

[18]  G. Mckinnon,et al.  Designing multichannel, multidimensional, arbitrary flip angle RF pulses using an optimal control approach , 2008, Magnetic resonance in medicine.

[19]  K. Kunisch,et al.  A convex analysis approach to multi-material topology optimization. , 2016, 1702.07525.

[20]  G. Fitzgerald,et al.  'I. , 2019, Australian journal of primary health.

[21]  Eric L. Miller,et al.  A novel reconstruction technique for two-dimensional Bragg scatter imaging , 2021, Anomaly Detection and Imaging with X-Rays (ADIX) VI.

[22]  K. Kunisch,et al.  Optimal Control of the Principal Coefficient in a Scalar Wave Equation , 2019, Applied Mathematics & Optimization.

[23]  Thi Bich Tram Do Discrete regularization for parameter identification problems , 2019 .

[24]  M. S. Vinding,et al.  Fast numerical design of spatial-selective rf pulses in MRI using Krotov and quasi-Newton based optimal control methods. , 2012, The Journal of chemical physics.

[25]  Georg Stadler,et al.  Elliptic optimal control problems with L1-control cost and applications for the placement of control devices , 2009, Comput. Optim. Appl..

[26]  David F. Miller,et al.  The design of excitation pulses for spin systems using optimal control theory: With application to NMR spectroscopy , 2009 .

[27]  Andrea Braides Γ-convergence for beginners , 2002 .

[28]  Christopher Kumar Anand,et al.  Designing optimal universal pulses using second-order, large-scale, non-linear optimization. , 2012, Journal of magnetic resonance.

[29]  Edouard Oudet,et al.  Numerical Calibration of Steiner trees , 2017, Applied Mathematics & Optimization.

[30]  Y. Zur,et al.  Design of adiabatic selective pulses using optimal control theory , 1996, Magnetic resonance in medicine.

[31]  Christian Clason,et al.  Error estimates for the approximation of multibang control problems , 2018, Computational Optimization and Applications.

[32]  V. Nistor,et al.  Well-posedness and Regularity for the Elasticity Equation with Mixed Boundary Conditions on Polyhedral Domains and Domains with Cracks , 2010 .

[33]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[34]  K. Kunisch,et al.  A convex analysis approach to optimal controls with switching structure for partial differential equations , 2016, 1702.07540.

[35]  J. Hogg Magnetic resonance imaging. , 1994, Journal of the Royal Naval Medical Service.

[36]  Ivan P. Gavrilyuk,et al.  Lagrange multiplier approach to variational problems and applications , 2010, Math. Comput..

[37]  F. Tröltzsch A Minimum Principle and a Generalized Bang‐Bang‐Principle for a Distributed Optimal Control Problem with Constraints on Control and State , 1979 .

[38]  Thomas de Quincey [C] , 2000, The Works of Thomas De Quincey, Vol. 1: Writings, 1799–1820.

[40]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[41]  Mathieu Claeys,et al.  Geometric and Numerical Methods in the Contrast Imaging Problem in Nuclear Magnetic Resonance , 2015 .

[42]  A. Macovski,et al.  Optimal Control Solutions to the Magnetic Resonance Selective Excitation Problem , 1986, IEEE Transactions on Medical Imaging.

[43]  Dan Tiba,et al.  Optimal Control of Nonsmooth Distributed Parameter Systems , 1990 .

[44]  Andrea Marchese,et al.  A Multimaterial Transport Problem and its Convex Relaxation via Rectifiable G-currents , 2017, SIAM J. Math. Anal..

[45]  Gary R. Consolazio,et al.  Finite Elements , 2007, Handbook of Dynamic System Modeling.

[46]  Roland Herzog,et al.  Optimality Conditions and Error Analysis of Semilinear Elliptic Control Problems with L1 Cost Functional , 2012, SIAM J. Optim..

[47]  Thomas H. Mareci,et al.  Selective inversion radiofrequency pulses by optimal control , 1986 .

[48]  Karl Kunisch,et al.  Multi-bang control of elliptic systems , 2014 .

[49]  Duncan A Robertson,et al.  A kilowatt pulsed 94 GHz electron paramagnetic resonance spectrometer with high concentration sensitivity, high instantaneous bandwidth, and low dead time. , 2009, The Review of scientific instruments.