Unified theory of thermodynamics and stochastic thermodynamics for nonlinear Langevin systems driven by non-conservative forces