A rigorous solution of the infinite time interval LQ problem with constant state tracking

A linear quadratic constant state tracking problem is considered over an infinite time horizon. It is shown that the solution cannot be obtained as a limit from a finite time horizon problem, as in general the limiting problem is ill-posed. To obtain a rigorous solution, the problem is split in two natural well-posed subproblems. One optimal control problem addresses the transient and the other optimal control problem concerns the steady state behavior. It is shown that the transient problem and the steady state problem are solved by the same control law.