Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Plans