Beyond (and back to) Palatini quadratic gravity and inflation