Converse to the Parter-Wiener theorem: The case of non-trees