Diffuse-boundary Rayleigh-Taylor instability