Finetuning Offline World Models in the Real World