Exploring Effects of Auditory Feedback on Menu Selection in Hand-Gesture Interface

Exploring Effects of Auditory Feedback on Menu Selection in Hand-Gesture Interface

 

With the increasing number of new motion-sensing hardware, improving the usability of gesture interfaces is becoming more important. However, people do not accept gesture interfaces as comfortably as traditional ones because they lack in tactile or haptic feedback that traditional input methods such as mice or keyboards provide. However, having tactile feedback in gesture interfaces is not possible unless users are wearing a device with actuators. Therefore, auditory feedback is an appropriate and unique alternative for assisting visual feedback in gesture interfaces. In this article, we propose various types of novel auditory feedback methods and explore their effects as secondary feedback on complementing visual feedback. We performed a user study for a menu selection task and experimental results show that the proposed auditory feedback is significantly more efficient and more effective than visual-only feedback or conventional auditory feedback in terms of time and accuracy.

 

::Menu Selection in Hand-Gesture Interface

 

::Feedback in Gesture Interface

1. Visual Only

 

2.Transitional Auditory Feedback (Conventional Auditory Feedback)

 

3. Proposed Auditory Feedback

3.1 Pre-emptive Auditory Feedback

 

3.2 Continuous Auditory Feedback

 

3.3 Depth Auditory Feedback