The stability of structures at a fluid interface