Quenching small quantum gases: Genesis of the orthogonality catastrophe