Properties and stability analysis of the sixth-order Boussinesq equations for Rossby waves