Regularity of the solutions for micro-macro models near equilibrium