Efficient use of peripheral information for temporal prediction