Taking Action: A Cross-Modal Investigation of Discourse-Level Representations