Coleman-Gross height pairings and the $p$-adic sigma function