Why do we remember the past and not the future? The 'time oriented coarse graining' hypothesis