Constraining the Galactic potential via action-based distribution functions for mono-abundance stellar populations