Signatures of atomic-scale structure in the energy dispersion and coherence of a Si quantum-dot qubit