Temporally Resolution Decrement: Utilizing the Shape Consistency for Higher Computational Efficiency