Spiked but still exact harmonic oscillators