Do That, There: An Interaction Technique for Addressing In-Air Gesture
Systems
In-Air Gesture
/
Freeman, Euan
/
Brewster, Stephen
/
Lantz, Vuokko
Proceedings of the ACM CHI'16 Conference on Human Factors in Computing
Systems
2016-05-07
v.1
p.2319-2331
© Copyright 2016 ACM
Summary: When users want to interact with an in-air gesture system, they must first
address it. This involves finding where to gesture so that their actions can be
sensed, and how to direct their input towards that system so that they do not
also affect others or cause unwanted effects. This is an important problem
which lacks a practical solution. We present an interaction technique which
uses multimodal feedback to help users address in-air gesture systems. The
feedback tells them how ("do that") and where ("there") to gesture, using
light, audio and tactile displays. By doing that there, users can direct their
input to the system they wish to interact with, in a place where their gestures
can be sensed. We discuss the design of our technique and three experiments
investigating its use, finding that users can "do that" well (93.2%-99.9%)
while accurately (51mm-80mm) and quickly (3.7s) finding "there".