On the role of field theories in our physical conception of geometry