On the Environmental Dependence of the Cluster Galaxy Assembly Timescale