Multimodal Reinforcement Learning for Robots Collaborating with Humans