Microscopic model of a phononic refrigerator