Foundational aspects of singular integrals and initial value problems