EMPress: Practical Hand Gesture Classification with Wrist-Mounted EMG and
Pressure Sensing
In-Air Gesture
/
McIntosh, Jess
/
McNeill, Charlie
/
Fraser, Mike
/
Kerber, Frederic
/
Löchtefeld, Markus
/
Krüger, Antonio
Proceedings of the ACM CHI'16 Conference on Human Factors in Computing
Systems
2016-05-07
v.1
p.2332-2342
© Copyright 2016 ACM
Summary: Practical wearable gesture tracking requires that sensors align with
existing ergonomic device forms. We show that combining EMG and pressure data
sensed only at the wrist can support accurate classification of hand gestures.
A pilot study with unintended EMG electrode pressure variability led to
exploration of the approach in greater depth. The EMPress technique senses both
finger movements and rotations around the wrist and forearm, covering a wide
range of gestures, with an overall 10-fold cross validation classification
accuracy of 96%. We show that EMG is especially suited to sensing finger
movements, that pressure is suited to sensing wrist and forearm rotations, and
their combination is significantly more accurate for a range of gestures than
either technique alone. The technique is well suited to existing wearable
device forms such as smart watches that are already mounted on the wrist.
Dynamir: Optical Manipulations Using Dynamic Mirror Brushes
Session 3: Fingers, Handprints and Dynamic Mirrors
/
Berthaut, Florent
/
Sahoo, Deepak Ranjan
/
McIntosh, Jess
/
Das, Diptesh
/
Subramanian, Sriram
Proceedings of the 2015 ACM International Conference on Interactive
Tabletops and Surfaces
2015-11-15
p.55-58
© Copyright 2015 ACM
Summary: Mirror surfaces are part of our everyday life. Among them, curved mirrors
are used to enhance our perception of the physical space, e.g., convex mirrors
are used to increase our field of view in the street, and concave mirrors are
used to zoom in on parts our face in the bathroom. In this paper, we
investigate the opportunities opened when these mirrors are made dynamic, so
that their effects can be modulated to adapt to the environment or to a user's
actions. We introduce the concept of dynamic mirror brushes that can be moved
around a mirror surface. We describe how these brushes can be used for various
optical manipulations of the physical space. We also present an implementation
using a flexible mirror sheet and three scenarios that demonstrate some of the
interaction opportunities.
Ghost Touch: Turning Surfaces into Interactive Tangible Canvases with
Focused Ultrasound
Session 6: Artistic Sand & Biking
/
Marzo, Asier
/
McGeehan, Richard
/
McIntosh, Jess
/
Seah, Sue Ann
/
Subramanian, Sriram
Proceedings of the 2015 ACM International Conference on Interactive
Tabletops and Surfaces
2015-11-15
p.137-140
© Copyright 2015 ACM
Summary: Digital art technologies take advantage of the input, output and processing
capabilities of modern computers. However, full digital systems lack the
tangibility and expressiveness of their traditional counterparts. We present
Ghost Touch, a system that remotely actuate the artistic medium with an
ultrasound phased array. Ghost Touch transforms a normal surface into an
interactive tangible canvas in which the users and the system collaborate in
real-time to produce an artistic piece. Ghost Touch is able to detect traces
and reproduce them, therefore enabling common digital operations such as copy,
paste, save or load whilst maintaining the tangibility of the traditional
medium. Ghost Touch has enhanced expressivity since it uses a novel algorithm
to generate multiple ultrasound focal points with specific intensity levels.
Different artistic effects can be performed on sand, milk&ink or liquid
soap.
