Various types of growth instabilities in coherent epitaxy