Diurnal Yarkovsky effect as a source of mobility of meter-sized asteroidal fragments. I. Linear theory