Inter-scale energy transfer in turbulence from the viewpoint of subfilter scales