Experimental study of the single-mode three-dimensional Rayleigh-Taylor instability