Optimal witnessing of the quantum Fisher information with few measurements