$C^*$-algebras with smooth dual