Joint semiparametric mean-covariance model in longitudinal study