Black hole growth and AGN feedback under clumpy accretion