On the unsolvability of inverse singular value problems almost everywhere