Robot Program Parameter Inference via Differentiable Shadow Program Inversion