Where Is the Flux Going? The Long-term Photometric Variability of Boyajian’s Star