The infancy of supernova remnants: evolving a supernova into its remnant in 3D