Ternary tetradymite compounds as topological insulators