Unified description of low-order above-threshold ionization on and off axis