When is holography consistent