Excited and exotic charmonium spectroscopy from lattice QCD