The evolution of AGN across cosmic time: what is downsizing?