ASR satisficing: the effects of ASR accuracy on speech retrieval

We examine how differences in the accuracy of Automatic Speech Recognition transcripts affect users’ ability to use these in tasks requiring the retrieval of speech “documents”. We compare performance measures, processing strategies, and preference data for subjects using transcripts and speech data to perform a series of relevance judgment and summary tasks on transcripts with different levels of accuracy. Results show effects for transcript quality on solution accuracy, time to solution, amount of speech played for the task, likelihood of subjects abandoning use of a transcript, and subject perceptions of task difficulty, transcript utility, readability, and comprehensibility.