The equivalence between pointwise Hardy inequalities and uniform fatness