CLT for fluctuations of $\beta$-ensembles with general potential