Consistent black-to-white hole bounces from matter collapse