Ultrafast refractive index control of gate-controlled graphene-metamaterial hybrid devices