Gradual Fermi-surface modification in orbitally ordered state of FeSe revealed by optical spectroscopy