The convex hull swampland distance conjecture and bounds on non-geodesics