We analyse theoretically and experimentally the residence time distribution of bistable systems in the presence of noise and time-delayed feedback. The feedback provides a memory mechanism for the system which leads to non-Markovian dynamics. We demonstrate and explain various non-exponential features of the residence time distribution using a two-state as well as a continuous model. The experimental results are based on a Schmitt Trigger where the feedback is provided by a computer generated delay loop and on a semiconductor laser with opto-electronic feedback.