Convergence map with action-angle variables based on square matrix for nonlinear lattice optimization