Optimal estimation with quantum optomechanical systems in the nonlinear regime