The Year-long Flux Variations in Boyajian's Star Are Asymmetric or Aperiodic