Destruction of surface states of ($d_{zx}+id_{yz}$)-wave superconductor by surface roughness: application to Sr$_2$RuO$_4$