Utilizing time-series measurements for entropy production estimation in partially observed systems