Time Resolved Single Dopant Charge Dynamics in Silicon