Covariant derivatives without gauge fields