Spherical analysis on harmonic $A N$ groups