When Good Loadings Go Bad: Robustness in Factor Analysis