PATMAT: Person Aware Tuning of Mask-Aware Transformer for Face Inpainting