A converse to Gauss' theorem