Deriving Physical Diagnostics from Observations