Semi-physical neural modeling for linear signal restoration