Embedded star clusters and the formation of the Oort cloud. III. Evolution of the inner cloud during the Galactic phase