Solving the Schwarzian via the conformal bootstrap