Heavy flavor relaxation in a hadronic medium