Multiscale analysis of instabilities in heterogeneous materials using ANM and multilevel FEM