Spatial Audio Feedback for Hand Gestures in Games

We use game prototypes to investigate different audio feedback designs for hand gestures for encouraging immersion. Replacing explicit audio instructions for hand positions and movements with responsive audio feedback, suggestive of interaction methods by using environmental story-related audio cues, leads to measurably higher immersion. We present the design of responsive audio feedback for hand gestures in the context of such a game. The spatial organization of diegetic environmental feedback before, during, and after gesture input is supported by a structured approach towards the design of audio cues.