Quantum state smoothing: why the types of observed and unobserved measurements matter