When strong correlations become weak: Consistent merging of $GW$ and DMFT