Diagonal Nematicity in the Pseudogap Phase of HgBa$_2$CuO$_{4+\delta}$