Constraints on the Hosts of UHECR Accelerators