Fisher matrix for the one-loop galaxy power spectrum: measuring expansion and growth rates without assuming a cosmological model