On almost sure optimization for stochastic control systems

We consider stochastic control systems and study the existence of controls that are almost surely optimal. We demonstrate that, in general, there exist no such optimal controls for finite horizon systems. Two infinite horizon problems are considered the LQG regulation and tracking, and a controlled diffusion with reflections from the boundaries of a bounded domain. In both problems the existence of almost sure optimal controls is proved and they are characterized