Ultralong relaxation times in bistable hybrid quantum systems