Video in applied cognitive research for human-centered design

Video constitutes one of the most direct and contextually rich means for capturing observable behavior in human-computer interaction. However, a major shortfall of this type of visual medium lies in its failure to directly capture those aspects of user behavior that can predictably be associated with human cognition. Goal-directed cognitive user processes such as those that occur in problem-solving, decision-making, and planning activities are by their nature not subject to recording on camera. Traditionally, cognitive researchers have inferred user planning and intent structures by abstracting from relatively long sequences of behavioral cues captured by video protocols.