Photonic-dispersion neural networks for inverse scattering problems