Dark matter and dark energy accretion on to intermediate-mass black holes