On the converse of Pansu's Theorem