Aggregation of solutes in bosonic versus fermionic quantum fluids