Random walks with short memory