Listen and Learn: What Makes the Difference?