Modified gravity from the quantum part of the metric