On Higher-dimensional Carrollian and Galilean Conformal Field Theories