Multi-qubit circuit characterization through physics-based statistical inference