Tools from Analysis

In order to prove existence of optimal policies, upper semicontinuous functions are important. For the following definition and properties we suppose that M is a metric space. We use the notation \( \bar{\mathbb{R}}=\mathbb{R}\cup{\{-\infty, \infty\}}.\)