On second-order optimality of the observed Fisher information