Nanoscale mechanisms for the reduction of heat transport in bismuth