Efficient point selection using temporal coherency