Multimodal communication and learning in on-line instruction videos

This study analyzes the multimodal communication patterns within on-line instruction videos on such social media platforms as Youtube and Instagram raising such questions as: what does it mean to learn on-line and how can multimodal communication and analysis be used as a tool for learning? First, the focus of the analysis is drawing attention to the different modes (language, gesture, space) that are used to perform instruction. Second, the different modes that are foregrounded and backgrounded in terms of mode saliency are analyzed in accordance with Norris’ theory of modal density and multimodal interaction analysis. The role of mediated action – an individual social actor performing a mediated action with a mediational means – in instruction videos draws attention to the types of learning that take place when social actors engage in learning on-line. Findings indicate that the relationship between action, modes, and instructional texts forge instructional identities and/or expert status.