The Right Mix of Visual and Mechanical Constraints to Guide the Relative Pose between Rigid Objects