The purpose of this study is to clarify the effect of late arriving sound on listener envelopment (LEV). In our previous work, it was shown that late sounds from above and behind the listener as well as lateral significantly affected LEV when the ratio of early-to-late sound energy (C80) was constant. In this paper, a psychological experiment is performed with simulated sound fields in order to examine the relation between C80 and directional late energy ratios, and perceived LEV. The result shows that the contribution of C80 to LEV is the highest in the negative. This means that LEV increases as the late energy increases. Furthermore, late overhead and back energy ratios are definitely effective for LEV at the rate of approximately 35 to 62 percent of the effect of lateral energy ratio.