Revisiting Global Statistics Aggregation for Improving Image Restoration