Trajectory Modeling with Latent Groups: Potentials and Pitfalls