Characterizing boundary-layer instability at finite Reynolds numbers