Rank-one multi-reference factor analysis