FETA: Towards Specializing Foundation Models for Expert Task Applications