Rethinking biased estimation [Lecture Notes]

In this lecture note we discuss methods to improve the accuracy of unbiased estimators used in many signal processing problems. Our approach is based on introducing a bias as a means of reducing the mean-squared error (MSE). The important aspect of our framework is that the reduction in MSE is guaranteed for all values of the unknown parameter.