MSA$^2$Net: Multi-scale Adaptive Attention-guided Network for Medical Image Segmentation