%M C.UIST.10.1
%T Intimacy versus privacy
%S Keynote
%A Minsky, Marvin
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 1-2
%K privacy
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866030
%X When you talk to a person, it's safe to assume that you both share large
bodies of "common sense knowledge." But when you converse with a programmed
computer, neither of you is likely to know much about what the other one knows.
   Indeed, in some respects this is desirable -- as when we're concerned with
our privacy. We don't want strangers to know our most personal goals, or all
the resources that we may control.
   However, when we turn to our computers for help, we'll want that
relationship to change -- because now it is in our interest for those systems
to understand our aims and goals, as well as our fears and phobias. Indeed, the
extents to which those processes "know us as individuals".
   Issues like these will always arise whenever we need a new interface -- and
as one of my teachers wrote long ago, "The hope is that, in not too many years,
human brains and computing machines will be coupled together very tightly, and
that the resulting partnership will think as no human brain has ever thought
and process data in a way not approached by the information-handling machines
we know today."
   Indeed, the '60s and '70s saw substantial advances towards this but it seems
to me that then progress slowed down. If so, perhaps this was partly because
the AI community moved from semantic and heuristic methods towards more formal
(but less flexible) statistical schemes. So now I'd like to see more
researchers remedy this by developing systems that use more commonsense
knowledge.

%M C.UIST.10.3
%T Imaginary interfaces: spatial interaction with empty hands and without
visual feedback
%S Freeform input
%A Gustafson, Sean
%A Bierwirth, Daniel
%A Baudisch, Patrick
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 3-12
%K bimanual, computer vision, gesture, memory, mobile, screen-less, spatial,
wearable
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866033
%X Screen-less wearable devices allow for the smallest form factor and thus the
maximum mobility. However, current screen-less devices only support buttons and
gestures. Pointing is not supported because users have nothing to point at.
However, we challenge the notion that spatial interaction requires a screen and
propose a method for bringing spatial interaction to screen-less devices.
   We present Imaginary Interfaces, screen-less devices that allow users to
perform spatial interaction with empty hands and without visual feedback.
Unlike projection-based solutions, such as Sixth Sense, all visual "feedback"
takes place in the user's imagination. Users define the origin of an imaginary
space by forming an L-shaped coordinate cross with their non-dominant hand.
Users then point and draw with their dominant hand in the resulting space.
   With three user studies we investigate the question: To what extent can
users interact spatially with a user interface that exists only in their
imagination? Participants created simple drawings, annotated existing drawings,
and pointed at locations described in imaginary space. Our findings suggest
that users' visual short-term memory can, in part, replace the feedback
conventionally displayed on a screen.

%M C.UIST.10.13
%T PhoneTouch: a technique for direct phone interaction on surfaces
%S Freeform input
%A Schmidt, Dominik
%A Chehimi, Fadi
%A Rukzio, Enrico
%A Gellersen, Hans
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 13-16
%K interaction techniques, interactive tabletops, mobile phones, personal
devices, surface computing
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866034
%X PhoneTouch is a novel technique for integration of mobile phones and
interactive surfaces. The technique enables use of phones to select targets on
the surface by direct touch, facilitating for instance pick&drop-style
transfer of objects between phone and surface. The technique is based on
separate detection of phone touch events by the surface, which determines
location of the touch, and by the phone, which contributes device identity. The
device-level observations are merged based on correlation in time. We describe
a proof-of-concept implementation of the technique, using vision for touch
detection on the surface (including discrimination of finger versus phone
touch) and acceleration features for detection by the phone.

%M C.UIST.10.17
%T Hands-on math: a page-based multi-touch and pen desktop for technical work
and problem solving
%S Freeform input
%A Zeleznik, Robert
%A Bragdon, Andrew
%A Adeputra, Ferdi
%A Ko, Hsu-Sheng
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 17-26
%K gestures, math, multi-touch, pages, paper, stylus
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866035
%X Students, scientists and engineers have to choose between the flexible,
free-form input of pencil and paper and the computational power of Computer
Algebra Systems (CAS) when solving mathematical problems. Hands-On Math is a
multi-touch and pen-based system which attempts to unify these approaches by
providing virtual paper that is enhanced to recognize mathematical notations as
a means of providing in situ access to CAS functionality. Pages can be created
and organized on a large pannable desktop, and mathematical expressions can be
computed, graphed and manipulated using a set of uni- and bi-manual
interactions which facilitate rapid exploration by eliminating tedious and
error prone transcription tasks. Analysis of a qualitative pilot evaluation
indicates the potential of our approach and highlights usability issues with
the novel techniques used.

%M C.UIST.10.27
%T Pen + touch = new tools
%S Freeform input
%A Hinckley, Ken
%A Yatani, Koji
%A Pahud, Michel
%A Coddington, Nicole
%A Rodenhouse, Jenny
%A Wilson, Andy
%A Benko, Hrvoje
%A Buxton, Bill
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 27-36
%K bimanual, gestures, pen, systems, tabletop, tablets, touch
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866036
%X We describe techniques for direct pen+touch input. We observe people's
manual behaviors with physical paper and notebooks. These serve as the
foundation for a prototype Microsoft Surface application, centered on
note-taking and scrapbooking of materials. Based on our explorations we
advocate a division of labor between pen and touch: the pen writes, touch
manipulates, and the combination of pen + touch yields new tools. This
articulates how our system interprets unimodal pen, unimodal touch, and
multimodal pen+touch inputs, respectively. For example, the user can hold a
photo and drag off with the pen to create and place a copy; hold a photo and
cross it in a freeform path with the pen to slice it in two; or hold selected
photos and tap one with the pen to staple them all together. Touch thus unifies
object selection with mode switching of the pen, while the muscular tension of
holding touch serves as the "glue" that phrases together all the inputs into a
unitary multimodal gesture. This helps the UI designer to avoid encumbrances
such as physical buttons, persistent modes, or widgets that detract from the
user's focus on the workspace.

%M C.UIST.10.37
%T Gestalt: integrated support for implementation and analysis in machine
learning
%S AI and toolkits
%A Patel, Kayur
%A Bancroft, Naomi
%A Drucker, Steven M.
%A Fogarty, James
%A Ko, Andrew J.
%A Landay, James
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 37-46
%K gestalt, machine learning, software development
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866038
%X We present Gestalt, a development environment designed to support the
process of applying machine learning. While traditional programming
environments focus on source code, we explicitly support both code and data.
Gestalt allows developers to implement a classification pipeline, analyze data
as it moves through that pipeline, and easily transition between implementation
and analysis. An experiment shows this significantly improves the ability of
developers to find and fix bugs in machine learning systems. Our discussion of
Gestalt and our experimental observations provide new insight into
general-purpose support for the machine learning process.

%M C.UIST.10.47
%T A framework for robust and flexible handling of inputs with uncertainty
%S AI and toolkits
%A Schwarz, Julia
%A Hudson, Scott
%A Mankoff, Jennifer
%A Wilson, Andrew D.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 47-56
%K ambiguity, input handling, recognition
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866039
%X New input technologies (such as touch), recognition based input (such as pen
gestures) and next-generation interactions (such as inexact interaction) all
hold the promise of more natural user interfaces. However, these techniques all
create inputs with some uncertainty. Unfortunately, conventional infrastructure
lacks a method for easily handling uncertainty, and as a result input produced
by these technologies is often converted to conventional events as quickly as
possible, leading to a stunted interactive experience. We present a framework
for handling input with uncertainty in a systematic, extensible, and easy to
manipulate fashion. To illustrate this framework, we present several
traditional interactors which have been extended to provide feedback about
uncertain inputs and to allow for the possibility that in the end that input
will be judged wrong (or end up going to a different interactor). Our six
demonstrations include tiny buttons that are manipulable using touch input, a
text box that can handle multiple interpretations of spoken input, a scrollbar
that can respond to inexactly placed input, and buttons which are easier to
click for people with motor impairments. Our framework supports all of these
interactions by carrying uncertainty forward all the way through selection of
possible target interactors, interpretation by interactors, generation of
(uncertain) candidate actions to take, and a mediation process that decides (in
a lazy fashion) which actions should become final.

%M C.UIST.10.57
%T TurKit: human computation algorithms on mechanical turk
%S AI and toolkits
%A Little, Greg
%A Chilton, Lydia B.
%A Goldman, Max
%A Miller, Robert C.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 57-66
%K human computation, mturk, toolkit
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866040
%X Mechanical Turk (MTurk) provides an on-demand source of human computation.
This provides a tremendous opportunity to explore algorithms which incorporate
human computation as a function call. However, various systems challenges make
this difficult in practice, and most uses of MTurk post large numbers of
independent tasks. TurKit is a toolkit for prototyping and exploring
algorithmic human computation, while maintaining a straight-forward imperative
programming style. We present the crash-and-rerun programming model that makes
TurKit possible, along with a variety of applications for human computation
algorithms. We also present case studies of TurKit used for real experiments
across different fields.

%M C.UIST.10.67
%T Mixture model based label association techniques for web accessibility
%S AI and toolkits
%A Islam, Muhammad Asiful
%A Borodin, Yevgen
%A Ramakrishnan, I. V.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 67-76
%K aural web browser, blind user, context, mixture models, screen reader, web
accessibility, web forms
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866041
%X An important aspect of making the Web accessible to blind users is ensuring
that all important web page elements such as links, clickable buttons, and form
fields have explicitly assigned labels. Properly labeled content is then
correctly read out by screen readers, a dominant assistive technology used by
blind users. In particular, improperly labeled form fields can critically
impede online transactions such as shopping, paying bills, etc. with screen
readers. Very often labels are not associated with form fields or are missing
altogether, making form filling a challenge for blind users. Algorithms for
associating a form element with one of several candidate labels in its vicinity
must cope with the variability of the element's features including label's
location relative to the element, distance to the element, etc. Probabilistic
models provide a natural machinery to reason with such uncertainties. In this
paper we present a Finite Mixture Model (FMM) formulation of the label
association problem. The variability of feature values are captured in the FMM
by a mixture of random variables that are drawn from parameterized
distributions. Then, the most likely label to be paired with a form element is
computed by maximizing the log-likelihood of the feature data using the
Expectation-Maximization algorithm. We also adapt the FMM approach for two
related problems: assigning labels (from an external Knowledge Base) to form
elements that have no candidate labels in their vicinity and for quickly
identifying clickable elements such as add-to-cart, checkout, etc., used in
online transactions even when these elements do not have textual captions
(e.g., image buttons w/o alternative text). We provide a quantitative
evaluation of our techniques, as well as a user study with two blind subjects
who used an aural web browser implementing our approach.

%M C.UIST.10.77
%T Performance optimizations of virtual keyboards for stroke-based text entry
on a touch-based tabletop
%S Input
%A Rick, Jochen
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 77-86
%K Fitts's law, interactive tabletops, keyboard layout, shape writing, touch
input, virtual keyboard
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866043
%X Efficiently entering text on interactive surfaces, such as touch-based
tabletops, is an important concern. One novel solution is shape writing -- the
user strokes through all the letters in the word on a virtual keyboard without
lifting his or her finger. While this technique can be used with any keyboard
layout, the layout does impact the expected performance. In this paper, I
investigate the influence of keyboard layout on expert text-entry performance
for stroke-based text entry. Based on empirical data, I create a model of
stroking through a series of points based on Fitts's law. I then use that model
to evaluate various keyboard layouts for both tapping and stroking input. While
the stroke-based technique seems promising by itself (i.e., there is a
predicted gain of 17.3% for a Qwerty layout), significant additional gains can
be made by using a more-suitable keyboard layout (e.g., the OPTI II layout is
predicted to be 29.5% faster than Qwerty).

%M C.UIST.10.87
%T Gesture search: a tool for fast mobile data access
%S Input
%A Li, Yang
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 87-96
%K gesture-based interaction, hidden Markov models, mobile computing, search,
shortcuts
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866044
%X Modern mobile phones can store a large amount of data, such as contacts,
applications and music. However, it is difficult to access specific data items
via existing mobile user interfaces. In this paper, we present Gesture Search,
a tool that allows a user to quickly access various data items on a mobile
phone by drawing gestures on its touch screen. Gesture Search contributes a
unique way of combining gesture-based interaction and search for fast mobile
data access. It also demonstrates a novel approach for coupling gestures with
standard GUI interaction. A real world deployment with mobile phone users
showed that Gesture Search enabled fast, easy access to mobile data in their
day-to-day lives. Gesture Search has been released to public and is currently
in use by hundreds of thousands of mobile users. It was rated positively by
users, with a mean of 4.5 out of 5 for over 5000 ratings.

%M C.UIST.10.97
%T MAI painting brush: an interactive device that realizes the feeling of real
painting
%S Input
%A Otsuki, Mai
%A Sugihara, Kenji
%A Kimura, Asako
%A Shibata, Fumihisa
%A Tamura, Hideyuki
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 97-100
%K brush model, brush stroke, input device, mixed reality, paint brush,
painting system
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866045
%X Many digital painting systems have been proposed and their quality is
improving. In these systems, graphics tablets are widely used as input devices.
However, because of its rigid nib and indirect manipulation, the operational
feeling of a graphics tablet is different from that of real paint brush. We
solved this problem by developing the MR-based Artistic Interactive (MAI)
Painting Brush, which imitates a real paint brush, and constructed a mixed
reality (MR) painting system that enables direct painting on physical objects
in the real world.

%M C.UIST.10.101
%T SqueezeBlock: using virtual springs in mobile devices for eyes-free
interaction
%S Input
%A Gupta, Sidhant
%A Campbell, Tim
%A Hightower, Jeffrey R.
%A Patel, Shwetak N.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 101-104
%K eyes free interaction, haptics, springs
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866046
%X Haptic feedback provides an additional interaction channel when auditory and
visual feedback may not be appropriate. We present a novel haptic feedback
system that changes its elasticity to convey information for eyes-free
interaction. SqueezeBlock is an electro-mechanical system that can realize a
virtual spring having a programmatically controlled spring constant. It also
allows for additional haptic modalities by altering the Hooke's Law
linear-elastic force-displacement equation, such as non-linear springs, size
changes, and spring length (range of motion) variations. This ability to
program arbitrarily spring constants also allows for "click" and button-like
feedback. We present several potential applications along with results from a
study showing how well participants can distinguish between several levels of
stiffness, size, and range of motion. We conclude with implications for
interaction design.

%M C.UIST.10.105
%T Bringing the field into the lab: supporting capture and replay of contextual
data for the design of context-aware applications
%S Frameworks
%A Newman, Mark W.
%A Ackerman, Mark S.
%A Kim, Jungwoo
%A Prakash, Atul
%A Hong, Zhenan
%A Mandel, Jacob
%A Dong, Tao
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 105-108
%K context-aware, data capture, design tools
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866048
%X When designing context-aware applications, it is difficult to for designers
in the studio or lab to envision the contextual conditions that will be
encountered at runtime. Designers need a tool that can create/re-create
naturalistic contextual states and transitions, so that they can evaluate an
application under expected contexts. We have designed and developed RePlay: a
system for capturing and playing back sensor traces representing scenarios of
use. RePlay contributes to research on ubicomp design tools by embodying a
structured approach to the capture and playback of contextual data. In
particular, RePlay supports: capturing naturalistic data through Capture
Probes, encapsulating scenarios of use through Episodes, and supporting
exploratory manipulation of scenarios through Transforms. Our experiences using
RePlay in internal design projects illustrate its potential benefits for
ubicomp design.

%M C.UIST.10.109
%T Eden: supporting home network management through interactive visual tools
%S Frameworks
%A Yang, Jeonghwa
%A Edwards, W. Keith
%A Haslem, David
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 109-118
%K home network, home-network interaction
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866049
%X As networking moves into the home, home users are increasingly being faced
with complex network management chores. Previous research, however, has
demonstrated the difficulty many users have in managing their networks. This
difficulty is compounded by the fact that advanced network management tools --
such as those developed for the enterprise -- are generally too complex for
home users, do not support the common tasks they face, and are not a good fit
for the technical peculiarities of the home. This paper presents Eden, an
interactive, direct manipulation home network management system aimed at end
users. Eden supports a range of common tasks, and provides a simple conceptual
model that can help users understand key aspects of networking better. The
system leverages a novel home network router that acts as a "dropin"
replacement for users' current router. We demonstrate that Eden not only
improves the user experience of networking, but also aids users in forming
workable conceptual models of how the network works.

%M C.UIST.10.119
%T TwinSpace: an infrastructure for cross-reality team spaces
%S Frameworks
%A Reilly, Derek F.
%A Rouzati, Hafez
%A Wu, Andy
%A Hwang, Jee Yeon
%A Brudvik, Jeremy
%A Edwards, W. Keith
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 119-128
%K collaborative virtual environment, cross-reality, interactive room,
ontology, RDF, smart room, tuplespace, virtual world
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866050
%X We introduce TwinSpace, a flexible software infrastructure for combining
interactive workspaces and collaborative virtual worlds. Its design is grounded
in the need to support deep connectivity and flexible mappings between virtual
and real spaces to effectively support collaboration. This is achieved through
a robust connectivity layer linking heterogeneous collections of physical and
virtual devices and services, and a centralized service to manage and control
mappings between physical and virtual. In this paper we motivate and present
the architecture of TwinSpace, discuss our experiences and lessons learned in
building a generic framework for collaborative cross-reality, and illustrate
the architecture using two implemented examples that highlight its flexibility
and range, and its support for rapid prototyping.

%M C.UIST.10.129
%T D-Macs: building multi-device user interfaces by demonstrating, sharing and
replaying design actions
%S Frameworks
%A Meskens, Jan
%A Luyten, Kris
%A Coninx, Karin
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 129-138
%K design tools, multi-device UI design
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866051
%X Multi-device user interface design mostly implies creating suitable
interface for each targeted device, using a diverse set of design tools and
toolkits. This is a time consuming activity, concerning a lot of repetitive
design actions without support for reusing this effort in later designs. In
this paper, we propose D-Macs: a design tool that allows designers to record
their design actions across devices, to share these actions with other
designers and to replay their own design actions and those of others. D-Macs
lowers the burden in multi-device user interface design and can reduce the
necessity for manually repeating design actions.

%M C.UIST.10.139
%T Content-aware dynamic timeline for video browsing
%S Space and time
%A Pongnumkul, Suporn
%A Wang, Jue
%A Ramos, Gonzalo
%A Cohen, Michael
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 139-142
%K dynamic video skims, slider, timeline
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866053
%X When browsing a long video using a traditional timeline slider control, its
effectiveness and precision degrade as a video's length grows. When browsing
videos with more frames than pixels in the slider, aside from some frames being
inaccessible, scrolling actions cause sudden jumps in a video's continuity as
well as video frames to flash by too fast for one to assess the content. We
propose a content-aware dynamic timeline control that is designed to overcome
these limitations. Our timeline control decouples video speed and playback
speed, and leverages video content analysis to allow salient shots to be
presented at an intelligible speed. Our control also takes advantage of
previous work on elastic sliders, which allows us to produce an accurate
navigation control.

%M C.UIST.10.143
%T Chronicle: capture, exploration, and playback of document workflow histories
%S Space and time
%A Grossman, Tovi
%A Matejka, Justin
%A Fitzmaurice, George
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 143-152
%K chronicle, history, timeline, video, workflow
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866054
%X We describe Chronicle, a new system that allows users to explore document
workflow histories. Chronicle captures the entire video history of a graphical
document, and provides links between the content and the relevant areas of the
history. Users can indicate specific content of interest, and see the
workflows, tools, and settings needed to reproduce the associated results, or
to better understand how it was constructed to allow for informed modification.
Thus, by storing the rich information regarding the document's history
workflow, Chronicle makes any working document a potentially powerful learning
tool. We outline some of the challenges surrounding the development of such a
system, and then describe our implementation within an image editing
application. A qualitative user study produced extremely encouraging results,
as users unanimously found the system both useful and easy to use.

%M C.UIST.10.153
%T Enhanced area cursors: reducing fine pointing demands for people with motor
impairments
%S Space and time
%A Findlater, Leah
%A Jansen, Alex
%A Shinohara, Kristen
%A Dixon, Morgan
%A Kamb, Peter
%A Rakita, Joshua
%A Wobbrock, Jacob O.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 153-162
%K accessibility, area cursors, bubble cursor, goal crossing, magnification,
motor space, visual space
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866055
%X Computer users with motor impairments face major challenges with
conventional mouse pointing. These challenges are mostly due to fine pointing
corrections at the final stages of target acquisition. To reduce the need for
correction-phase pointing and to lessen the effects of small target size on
acquisition difficulty, we introduce four enhanced area cursors, two of which
rely on magnification and two of which use goal crossing. In a study with
motor-impaired and able-bodied users, we compared the new designs to the point
and Bubble cursors, the latter of which had not been evaluated for users with
motor impairments. Two enhanced area cursors, the Visual-Motor-Magnifier and
Click-and-Cross, were the most successful new designs for users with motor
impairments, reducing selection time for small targets by 19%, corrective
submovements by 45%, and error rate by up to 82% compared to the point cursor.
Although the Bubble cursor also improved performance, participants with motor
impairments unanimously preferred the enhanced area cursors.

%M C.UIST.10.163
%T The satellite cursor: achieving MAGIC pointing without gaze tracking using
multiple cursors
%S Space and time
%A Yu, Chun
%A Shi, Yuanchun
%A Balakrishnan, Ravin
%A Meng, Xiangliang
%A Suo, Yue
%A Fan, Mingming
%A Qin, Yongqiang
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 163-172
%K magic pointing, multiple cursor, reducing a
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866056
%X We present the satellite cursor -- a novel technique that uses multiple
cursors to improve pointing performance by reducing input movement. The
satellite cursor associates every target with a separate cursor in its vicinity
for pointing, which realizes the MAGIC (manual and gaze input cascade) pointing
method without gaze tracking. We discuss the problem of visual clutter caused
by multiple cursors and propose several designs to mitigate it. Two controlled
experiments were conducted to evaluate satellite cursor performance in a simple
reciprocal pointing task and a complex task with multiple targets of varying
layout densities. Results show the satellite cursor can save significant mouse
movement and consequently pointing time, especially for sparse target layouts,
and that satellite cursor performance can be accurately modeled by Fitts' Law.

%M C.UIST.10.173
%T UIMarks: quick graphical interaction with specific targets
%S Space and time
%A Chapuis, Olivier
%A Roussel, Nicolas
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 173-182
%K direct manipulation, macros, pointing
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866057
%X This paper reports on the design and evaluation of UIMarks, a system that
lets users specify on-screen targets and associated actions by means of a
graphical marking language. UIMarks supplements traditional pointing by
providing an alternative mode in which users can quickly activate these marks.
Associated actions can range from basic pointing facilitation to complex
sequences possibly involving user interaction: one can leave a mark on a
palette to make it more reachable, but the mark can also be configured to wait
for a click and then automatically move the pointer back to its original
location, for example. The system has been implemented on two different
platforms, Metisse and OS X. We compared it to traditional pointing on a set of
elementary and composite tasks in an abstract setting. Although pure pointing
was not improved, the programmable automation supported by the system proved
very effective.

%M C.UIST.10.183
%T Connected environments
%S Artist talk
%A Jeremijenko, Natalie
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 183-184
%K ethical and sustainable interfaces, social and environmental improvement
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866059
%X Can new interfaces contribute to social and environmental improvement? For
all the care, wit and brilliance that UIST innovations can contribute, can they
actually make things better -- better in the sense of public good -- not merely
lead to easier to use or more efficient consumer goods? This talk will explore
the impact of interface technology on society and the environment, and examine
engineered systems that invite participation, document change over time, and
suggest alternative courses of action that are ethical and sustainable, drawing
on examples from a diverse series of experimental designs and site-specific
work Natalie has created throughout her career.

%M C.UIST.10.185
%T Gilded gait: reshaping the urban experience with augmented footsteps
%S Feet or TOE CHI
%A Takeuchi, Yuichiro
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 185-188
%K augmented reality, ground texture, haptic interface, urban navigation,
vibrotactile feedback
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866061
%X In this paper we describe Gilded Gait, a system that changes the perceived
physical texture of the ground, as felt through the soles of users' feet.
Ground texture, in spite of its potential as an effective channel of peripheral
information display, has so far been paid little attention in HCI research. The
system is designed as a pair of insoles with embedded actuators, and utilizes
vibrotactile feedback to simulate the perceptions of a range of different
ground textures. The discreet, low-key nature of the interface makes it
particularly suited for outdoor use, and its capacity to alter how people
experience the built environment may open new possibilities in urban design.

%M C.UIST.10.189
%T Jogging over a distance between Europe and Australia
%S Feet or TOE CHI
%A Mueller, Florian
%A Vetere, Frank
%A Gibbs, Martin R.
%A Edge, Darren
%A Agamanolis, Stefan
%A Sheridan, Jennifer G.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 189-198
%K audio, exergame, exergaming, exertion interface, heart rate, mobile phone,
physiological data, running, spatialization, sports, whole-body interaction
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866062
%X Exertion activities, such as jogging, require users to invest intense
physical effort and are associated with physical and social health benefits.
Despite the benefits, our understanding of exertion activities is limited,
especially when it comes to social experiences. In order to begin understanding
how to design for technologically augmented social exertion experiences, we
present "Jogging over a Distance", a system in which spatialized audio based on
heart rate allowed runners as far apart as Europe and Australia to run
together. Our analysis revealed how certain aspects of the design facilitated a
social experience, and consequently we describe a framework for designing
augmented exertion activities. We make recommendations as to how designers
could use this framework to aid the development of future social systems that
aim to utilize the benefits of exertion.

%M C.UIST.10.199
%T Sensing foot gestures from the pocket
%S Feet or TOE CHI
%A Scott, Jeremy
%A Dearman, David
%A Yatani, Koji
%A Truong, Khai N.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 199-208
%K eyes-free interaction, foot-based gestures, hands-free interaction, mobile
devices
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866063
%X Visually demanding interfaces on a mobile phone can diminish the user
experience by monopolizing the user's attention when they are focusing on
another task and impede accessibility for visually impaired users. Because
mobile devices are often located in pockets when users are mobile, explicit
foot movements can be defined as eyes-and-hands-free input gestures for
interacting with the device. In this work, we study the human capability
associated with performing foot-based interactions which involve lifting and
rotation of the foot when pivoting on the toe and heel. Building upon these
results, we then developed a system to learn and recognize foot gestures using
a single commodity mobile phone placed in the user's pocket or in a holster on
their hip. Our system uses acceleration data recorded by a built-in
accelerometer on the mobile device and a machine learning approach to
recognizing gestures. Through a lab study, we demonstrate that our system can
classify ten different foot gestures at approximately 86% accuracy.

%M C.UIST.10.209
%T Multitoe: high-precision interaction with back-projected floors based on
high-resolution multi-touch input
%S Feet or TOE CHI
%A Augsten, Thomas
%A Kaefer, Konstantin
%A Meusel, René
%A Fetzer, Caroline
%A Kanitz, Dorian
%A Stoff, Thomas
%A Becker, Torsten
%A Holz, Christian
%A Baudisch, Patrick
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 209-218
%K direct manipulation, front diffuse illumination, FTIR, interactive floor,
multi-touch, projection, tabletop
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866064
%X Tabletop applications cannot display more than a few dozen on-screen
objects. The reason is their limited size: tables cannot become larger than
arm's length without giving up direct touch. We propose creating direct touch
surfaces that are orders of magnitude larger. We approach this challenge by
integrating high-resolution multitouch input into a back-projected floor. As
the same time, we maintain the purpose and interaction concepts of tabletop
computers, namely direct manipulation.
   We base our hardware design on frustrated total internal reflection. Its
ability to sense per-pixel pressure allows the floor to locate and analyze
users' soles. We demonstrate how this allows the floor to recognize foot
postures and identify users. These two functions form the basis of our system.
They allow the floor to ignore users unless they interact explicitly, identify
and track users based on their shoes, enable high-precision interaction, invoke
menus, track heads, and allow users to control high-degree of freedom
interactions using their feet. While we base our designs on a series of simple
user studies, the primary contribution on this paper is in the engineering
domain.

%M C.UIST.10.219
%T Cosaliency: where people look when comparing images
%S Intelligence
%A Jacobs, David E.
%A Goldman, Dan B.
%A Shechtman, Eli
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 219-228
%K automated thumbnailing, collection-aware cropping, cosaliency, saliency
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866066
%X Image triage is a common task in digital photography. Determining which
photos are worth processing for sharing with friends and family and which
should be deleted to make room for new ones can be a challenge, especially on a
device with a small screen like a mobile phone or camera. In this work we
explore the importance of local structure changes?e.g. human pose, appearance
changes, object orientation, etc.?to the photographic triage task. We perform a
user study in which subjects are asked to mark regions of image pairs most
useful in making triage decisions. From this data, we train a model for image
saliency in the context of other images that we call cosaliency. This allows us
to create collection-aware crops that can augment the information provided by
existing thumbnailing techniques for the image triage task.

%M C.UIST.10.229
%T A conversational interface to web automation
%S Intelligence
%A Lau, Tessa
%A Cerruti, Julian
%A Manzato, Guillermo
%A Bengualid, Mateo
%A Bigham, Jeffrey P.
%A Nichols, Jeffrey
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 229-238
%K automation, intelligent assistants, natural language interfaces
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866067
%X This paper presents CoCo, a system that automates web tasks on a user's
behalf through an interactive conversational interface. Given a short command
such as "get road conditions for highway 88," CoCo synthesizes a plan to
accomplish the task, executes it on the web, extracts an informative response,
and returns the result to the user as a snippet of text. A novel aspect of our
approach is that we leverage a repository of previously recorded web scripts
and the user's personal web browsing history to determine how to complete each
requested task. This paper describes the design and implementation of our
system, along with the results of a brief user study that evaluates how likely
users are to understand what CoCo does for them.

%M C.UIST.10.239
%T Designing adaptive feedback for improving data entry accuracy
%S Intelligence
%A Chen, Kuang
%A Hellerstein, Joseph M.
%A Parikh, Tapan S.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 239-248
%K adaptive interface, data entry, data quality, form design, repetitive task
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866068
%X Data quality is critical for many information-intensive applications. One of
the best opportunities to improve data quality is during entry. Usher provides
a theoretical, data-driven foundation for improving data quality during entry.
Based on prior data, Usher learns a probabilistic model of the dependencies
between form questions and values. Using this information, Usher maximizes
information gain. By asking the most unpredictable questions first, Usher is
better able to predict answers for the remaining questions. In this paper, we
use Usher's predictive ability to design a number of intelligent user interface
adaptations that improve data entry accuracy and efficiency. Based on an
underlying cognitive model of data entry, we apply these modifications before,
during and after committing an answer. We evaluated these mechanisms with
professional data entry clerks working with real patient data from six clinics
in rural Uganda. The results show that our adaptations have the potential to
reduce error (by up to 78%), with limited effect on entry time (varying between
-14% and +6%). We believe this approach has wide applicability for improving
the quality and availability of data, which is increasingly important for
decision-making and resource allocation.

%M C.UIST.10.249
%T Creating collections with automatic suggestions and example-based refinement
%S Intelligence
%A Secord, Adrian
%A Winnemoeller, Holger
%A Li, Wilmot
%A Dontcheva, Mira
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 249-258
%K collections, constraint solver, keyword search
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866069
%X To create collections, like music playlists from personal media libraries,
users today typically do one of two things. They either manually select items
one-by-one, which can be time consuming, or they use an example-based
recommendation system to automatically generate a collection. While such
automatic engines are convenient, they offer the user limited control over how
items are selected. Based on prior research and our own observations of
existing practices, we propose a semi-automatic interface for creating
collections that combines automatic suggestions with manual refinement tools.
Our system includes a keyword query interface for specifying high-level
collection preferences (e.g., "some rock, no Madonna, lots of U2,") as well as
three example-based collection refinement techniques: 1) a suggestion widget
for adding new items in-place in the context of the collection; 2) a mechanism
for exploring alternatives for one or more collection items; and 3) a two-pane
linked interface that helps users browse their libraries based on any selected
collection item. We demonstrate our approach with two applications. SongSelect
helps users create music playlists, and PhotoSelect helps users select photos
for sharing. Initial user feedback is positive and confirms the need for
semi-automated tools that give users control over automatically created
collections.

%M C.UIST.10.259
%T The IR ring: authenticating users' touches on a multi-touch display
%S Surface
%A Roth, Volker
%A Schmidt, Philipp
%A Güldenring, Benjamin
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 259-262
%K authentication, multi-touch
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866071
%X Multi-touch displays are particularly attractive for collaborative work
because multiple users can interact with applications simultaneously. However,
unfettered access can lead to loss of data confidentiality and integrity. For
example, one user can open or alter files of a second user, or impersonate the
second user, while the second user is absent or not looking. Towards preventing
these attacks, we explore means to associate the touches of a user with the
user's identity in a fashion that is cryptographically sound as well as easy to
use. We describe our current solution, which relies on a ring-like device that
transmits a continuous pseudorandom bit sequence in the form of infrared light
pulses. The multi-touch display receives and localizes the sequence, and
verifies its authenticity. Each sequence is bound to a particular user, and all
touches in the direct vicinity of the location of the sequence on the display
are associated with that user.

%M C.UIST.10.263
%T Enabling beyond-surface interactions for interactive surface with an
invisible projection
%S Surface
%A Chan, Li-Wei
%A Wu, Hsiang-Tao
%A Kao, Hui-Shan
%A Ko, Ju-Chun
%A Lin, Home-Ru
%A Chen, Mike Y.
%A Hsu, Jane
%A Hung, Yi-Ping
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 263-272
%K beyond-surface, infra-red projection, invisible marker, multi-display,
multi-resolution, multi-touch, pico-projector, tabletop
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866072
%X This paper presents a programmable infrared (IR) technique that utilizes
invisible, programmable markers to support interaction beyond the surface of a
diffused-illumination (DI) multi-touch system. We combine an IR projector and a
standard color projector to simultaneously project visible content and
invisible markers. Mobile devices outfitted with IR cameras can compute their
3D positions based on the markers perceived. Markers are selectively turned off
to support multi-touch and direct on-surface tangible input. The proposed
techniques enable a collaborative multi-display multi-touch tabletop system. We
also present three interactive tools: i-m-View, i-m-Lamp, and i-m-Flashlight,
which consist of a mobile tablet and projectors that users can freely interact
with beyond the main display surface. Early user feedback shows that these
interactive devices, combined with a large interactive display, allow more
intuitive navigation and are reportedly enjoyable to use.

%M C.UIST.10.273
%T Combining multiple depth cameras and projectors for interactions on, above
and between surfaces
%S Surface
%A Wilson, Andrew D.
%A Benko, Hrvoje
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 273-282
%K augmented reality, depth cameras, interactive spaces, surface computing,
ubiquitous computing
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866073
%X Instrumented with multiple depth cameras and projectors, LightSpace is a
small room installation designed to explore a variety of interactions and
computational strategies related to interactive displays and the space that
they inhabit. LightSpace cameras and projectors are calibrated to 3D real world
coordinates, allowing for projection of graphics correctly onto any surface
visible by both camera and projector. Selective projection of the depth camera
data enables emulation of interactive displays on un-instrumented surfaces
(such as a standard table or office desk), as well as facilitates mid-air
interactions between and around these displays. For example, after performing
multi-touch interactions on a virtual object on the tabletop, the user may
transfer the object to another display by simultaneously touching the object
and the destination display. Or the user may "pick up" the object by sweeping
it into their hand, see it sitting in their hand as they walk over to an
interactive wall display, and "drop" the object onto the wall by touching it
with their other hand. We detail the interactions and algorithms unique to
LightSpace, discuss some initial observations of use and suggest future
directions.

%M C.UIST.10.283
%T TeslaTouch: electrovibration for touch surfaces
%S Surface
%A Bau, Olivier
%A Poupyrev, Ivan
%A Israr, Ali
%A Harrison, Chris
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 283-292
%K multitouch, tactile feedback, touch screens
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866074
%X We present a new technology for enhancing touch interfaces with tactile
feedback. The proposed technology is based on the electrovibration principle,
does not use any moving parts and provides a wide range of tactile feedback
sensations to fingers moving across a touch surface. When combined with an
interactive display and touch input, it enables the design of a wide variety of
interfaces that allow the user to feel virtual elements through touch. We
present the principles of operation and an implementation of the technology. We
also report the results of three controlled psychophysical experiments and a
subjective user evaluation that describe and characterize users' perception of
this technology. We conclude with an exploration of the design space of tactile
touch screens using two comparable setups, one based on electrovibration and
another on mechanical vibrotactile actuation.

%M C.UIST.10.293
%T Madgets: actuating widgets on interactive tabletops
%S Surface
%A Weiss, Malte
%A Schwarz, Florian
%A Jakubowski, Simon
%A Borchers, Jan
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 293-302
%K actuation, multi-touch, tabletop interaction, tangible user interfaces,
widgets
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866075
%X We present a system for the actuation of tangible magnetic widgets (Madgets)
on interactive tabletops. Our system combines electromagnetic actuation with
fiber optic tracking to move and operate physical controls. The presented
mechanism supports actuating complex tangibles that consist of multiple parts.
A grid of optical fibers transmits marker positions past our actuation hardware
to cameras below the table. We introduce a visual tracking algorithm that is
able to detect objects and touches from the strongly sub-sampled video input of
that grid. Six sample Madgets illustrate the capabilities of our approach,
ranging from tangential movement and height actuation to inductive power
transfer. Madgets combine the benefits of passive, untethered, and translucent
tangibles with the ability to actuate them with multiple degrees of freedom.

%M C.UIST.10.303
%T Eddi: interactive topic-based browsing of social status streams
%S Social
%A Bernstein, Michael S.
%A Suh, Bongwon
%A Hong, Lichan
%A Chen, Jilin
%A Kairam, Sanjay
%A Chi, Ed H.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 303-312
%K social streams, topic clustering, twitter
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866077
%X Twitter streams are on overload: active users receive hundreds of items per
day, and existing interfaces force us to march through a
chronologically-ordered morass to find tweets of interest. We present an
approach to organizing a user's own feed into coherently clustered trending
topics for more directed exploration. Our Twitter client, called Eddi, groups
tweets in a user's feed into topics mentioned explicitly or implicitly, which
users can then browse for items of interest. To implement this topic
clustering, we have developed a novel algorithm for discovering topics in short
status updates powered by linguistic syntactic transformation and callouts to a
search engine. An algorithm evaluation reveals that search engine callouts
outperform other approaches when they employ simple syntactic transformation
and backoff strategies. Active Twitter users evaluated Eddi and found it to be
a more efficient and enjoyable way to browse an overwhelming status update feed
than the standard chronological interface.

%M C.UIST.10.313
%T Soylent: a word processor with a crowd inside
%S Social
%A Bernstein, Michael S.
%A Little, Greg
%A Miller, Robert C.
%A Hartmann, Björn
%A Ackerman, Mark S.
%A Karger, David R.
%A Crowell, David
%A Panovich, Katrina
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 313-322
%K crowdsourcing, mechanical turk, outsourcing
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866078
%X This paper introduces architectural and interaction patterns for integrating
crowdsourced human contributions directly into user interfaces. We focus on
writing and editing, complex endeavors that span many levels of conceptual and
pragmatic activity. Authoring tools offer help with pragmatics, but for
higher-level help, writers commonly turn to other people. We thus present
Soylent, a word processing interface that enables writers to call on Mechanical
Turk workers to shorten, proofread, and otherwise edit parts of their documents
on demand. To improve worker quality, we introduce the Find-Fix-Verify crowd
programming pattern, which splits tasks into a series of generation and review
stages. Evaluation studies demonstrate the feasibility of crowdsourced editing
and investigate questions of reliability, cost, wait time, and work time for
edits.

%M C.UIST.10.323
%T Tag expression: tagging with feeling
%S Social
%A Vig, Jesse
%A Soukup, Matthew
%A Sen, Shilad
%A Riedl, John
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 323-332
%K community, ratings, tagging, user preference
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866079
%X In this paper we introduce tag expression, a novel form of preference
elicitation that combines elements from tagging and rating systems. Tag
expression enables users to apply affect to tags to indicate whether the tag
describes a reason they like, dislike, or are neutral about a particular item.
We present a user interface for applying affect to tags, as well as a technique
for visualizing the overall community's affect. By analyzing 27,773 tag
expressions from 553 users entered in a 3-month period, we empirically evaluate
our design choices. We also present results of a survey of 97 users that
explores users' motivations in tagging and measures user satisfaction with tag
expression.

%M C.UIST.10.333
%T VizWiz: nearly real-time answers to visual questions
%S Social
%A Bigham, Jeffrey P.
%A Jayant, Chandrika
%A Ji, Hanjie
%A Little, Greg
%A Miller, Andrew
%A Miller, Robert C.
%A Miller, Robin
%A Tatarowicz, Aubrey
%A White, Brandyn
%A White, Samual
%A Yeh, Tom
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 333-342
%K blind users, non-visual interfaces, real-time human computation
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866080
%X The lack of access to visual information like text labels, icons, and colors
can cause frustration and decrease independence for blind people. Current
access technology uses automatic approaches to address some problems in this
space, but the technology is error-prone, limited in scope, and quite
expensive. In this paper, we introduce VizWiz, a talking application for mobile
phones that offers a new alternative to answering visual questions in nearly
real-time -- asking multiple people on the web. To support answering questions
quickly, we introduce a general approach for intelligently recruiting human
workers in advance called quikTurkit so that workers are available when new
questions arrive. A field deployment with 11 blind participants illustrates
that blind people can effectively use VizWiz to cheaply answer questions in
their everyday lives, highlighting issues that automatic approaches will need
to address to be useful. Finally, we illustrate the potential of using VizWiz
as part of the participatory design of advanced tools by using it to build and
evaluate VizWiz::LocateIt, an interactive mobile tool that helps blind people
solve general visual search problems.

%M C.UIST.10.343
%T The engineering of personhood
%S Keynote
%A Lanier, Jaron
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 343-346
%K applied philosophy, applied spirituality, reality
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866029.1866031
%X Any subset of reality can potentially be interpreted as a computer, so when
we speak about a particular computer, we are merely speaking about a portion of
reality we can understand computationally. That means that computation is only
identifiable through the human experience of it. User interface is ultimately
the only grounding for the abstractions of computation, in the same way that
the measurement of physical phenomena provides the only legitimate basis for
physics. But user interface also changes humans. As computation is perceived,
the natures of self and personhood are transformed. This process, when
designers are aware of it, can be understood as an emerging form of applied
philosophy or even applied spirituality.

%M C.UIST.10.347
%T Crowd-powered interfaces
%S Doctoral consortium
%A Bernstein, Michael S.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 347-350
%K crowdsourcing, outsourcing, social computing
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866220
%X We investigate crowd-powered interfaces: interfaces that embed human
activity to support high-level conceptual activities such as writing, editing
and question-answering. For example, a crowd-powered interface using paid crowd
workers can compute a series of textual cuts and edits to a paragraph, then
provide the user with an interface to condense his or her writing. We map out
the design space of interfaces that depend on outsourced, friendsourced, and
data mined resources, and report on designs for each of these. We discuss
technical and motivational challenges inherent in human-powered interfaces.

%M C.UIST.10.351
%T Supporting self-expression for informal communication
%S Doctoral consortium
%A Cowan, Lisa G.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 351-354
%K communication, mobile, self-expression
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866221
%X Mobile phones are becoming the central tools for communicating and can help
us keep in touch with friends and family on-the-go. However, they can also
place high demands on attention and constrain interaction. My research concerns
how to design communication mechanisms that mitigate these problems to support
self-expression for informal communication on mobile phones. I will study how
people communicate with camera-phone photos, paper-based sketches, and
projected information and how this communication impacts social practices.

%M C.UIST.10.355
%T Lowering the barrier to applying machine learning
%S Doctoral consortium
%A Patel, Kayur
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 355-358
%K gestalt, integrated development environments, machine learning
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866222
%X Machine learning algorithms are key components in many cutting edge
applications of computation. However, the full potential of machine learning
has not been realized because using machine learning is hard, even for
otherwise tech-savvy developers. This is because developing with machine
learning is different than normal programming. My thesis is that developers
applying machine learning need new general-purpose tools that provide structure
for common processes and common pipelines while remaining flexible to account
for variability in problems. In this paper, I describe my efforts to
understanding the difficulties that developers face when applying machine
learning. I then describe Gestalt, a general-purpose integrated development
environment designed the application of machine learning. Finally, I describe
work on developing a pattern language for building machine learning systems and
creating new techniques that help developers understand the interaction between
their data and learning algorithms.

%M C.UIST.10.359
%T User interface models for the cloud
%S Doctoral consortium
%A Pham, Hubert
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 359-362
%K cloud, desktop, groups, model
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866223
%X The current desktop metaphor is unsuitable for the coming age of cloud-based
applications. The desktop was developed in an era that was focused on local
resources, and consequently its gestures, semantics, and security model reflect
heavy reliance on hierarchy and physical locations. This paper proposes a new
user interface model that accounts for cloud applications, incorporating
representations of people and new gestures for sharing and access, while
minimizing the prominence of location. The model's key feature is a lightweight
mechanism to group objects for resource organization, sharing, and access
control, towards the goal of providing simple semantics for a wide range of
tasks, while also achieving security through greater usability.

%M C.UIST.10.363
%T Towards personalized surface computing
%S Doctoral consortium
%A Schmidt, Dominik
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 363-366
%K mobile devices, surface computing, user identification
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866224
%X With recent progress in the field of surface computing it becomes
foreseeable that interactive surfaces will turn into a commodity in the future,
ubiquitously integrated into our everyday environments. At the same time, we
can observe a trend towards personal data and whole applications being
accessible over the Internet, anytime from anywhere. We envision a future where
interactive surfaces surrounding us serve as powerful portals to access these
kinds of data and services. In this paper, we contribute two novel interaction
techniques supporting parts of this vision: First, HandsDown, a biometric user
identification approach based on hand contours and, second, PhoneTouch, a novel
technique for using mobile phones in conjunction with interactive surfaces.

%M C.UIST.10.367
%T Towards a unified framework for modeling, dispatching, and interpreting
uncertain input
%S Doctoral consortium
%A Schwarz, Julia
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 367-370
%K ambiguity, input handling, recognition
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866225
%X Many new input technologies (such as touch and voice) hold the promise of
more natural user interfaces. However, many of these technologies create inputs
with some uncertainty. Unfortunately, conventional infrastructure lacks a
method for easily handling uncertainty, and as a result input produced by these
technologies is often converted to conventional events as quickly as possible,
leading to a stunted interactive experience. Our ongoing work aims to design a
unified framework for modeling uncertain input and dispatching it to
interactors. This should allow developers to easily create interactors which
can interpret uncertain input, give the user appropriate feedback, and
accurately resolve any ambiguity. This abstract presents an overview of the
design of a framework for handling input with uncertainty and describes topics
we hope to pursue in future work. We also give an example of how we built
highly accurate touch buttons using our framework. For examples of what
interactors can be built and a more detailed description of our framework we
refer the reader to [8].

%M C.UIST.10.371
%T Intelligent tagging interfaces: beyond folksonomy
%S Doctoral consortium
%A Vig, Jesse
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 371-374
%K conversational recommenders, explanations, recommender systems, tagging
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866226
%X This paper summarizes our work on using tags to broaden the dialog between a
recommender system and its users. We present two tagging applications that
enrich this dialog: tagsplanations are tag-based explanations of
recommendations provided by a system to its users, and Movie Tuner is a
conversational recommender system that enables users to provide feedback on
movie recommendations using tags. We discuss the design of both systems and the
experimental methodology used to evaluate the design choices.

%M C.UIST.10.375
%T Bringing everyday applications to interactive surfaces
%S Doctoral consortium
%A Weiss, Malte
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 375-378
%K actuation, applications, curved surface, haptic feedback, interactive
tabletops, tangible user interfaces
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866227
%X This paper presents ongoing work that intends to simplify the introduction
of everyday applications to interactive tabletops. SLAP Widgets bring tangible
general-purpose widgets to tabletops while providing the flexibility of
on-screen controls. Madgets maintain consistency between physical controls and
their digital state. BendDesk represents our vision of a multi-touch enabled
office environment. Our pattern language captures knowledge for the design of
interactive tabletops. For each project, we describe its technical background,
present the current state of research, and discuss future work.

%M C.UIST.10.379
%T OnObject: gestural play with tagged everyday objects
%S Demonstrations
%A Chung, Keywon
%A Shilman, Michael
%A Merrill, Chris
%A Ishii, Hiroshi
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 379-380
%K end user programming, gestural object interfaces, tangible interfaces,
ubiquitous computing
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866229
%X Many Tangible User Interface (TUI) systems employ sensor-equipped physical
objects. However they do not easily scale to users' actual environments; most
everyday objects lack the necessary hardware, and modification requires
hardware and software development by skilled individuals. This limits TUI
creation by end users, resulting in inflexible interfaces in which the mapping
of sensor input and output events cannot be easily modified reflecting the end
user's wishes and circumstances. We introduce OnObject, a small device worn on
the hand, which can program physical objects to respond to a set of gestural
triggers. Users attach RFID tags to situated objects, grab them by the tag, and
program their responses to grab, release, shake, swing, and thrust gestures
using a built-in button and a microphone. In this paper, we demonstrate how
novice end users including preschool children can instantly create engaging
gestural object interfaces with sound feedback from toys, drawings, or clay.

%M C.UIST.10.381
%T CopyCAD: remixing physical objects with copy and paste from the real world
%S Demonstrations
%A Follmer, Sean
%A Carr, David
%A Lovell, Emily
%A Ishii, Hiroshi
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 381-382
%K design tools, fabrication, prototyping, TUI
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866230
%X This paper introduces a novel technique for integrating geometry from
physical objects into computer aided design (CAD) software. We allow users to
copy arbitrary real world object geometry into 2D CAD designs at scale through
the use of a camera/projector system. This paper also introduces a system,
CopyCAD, that uses this technique, and augments a Computer Controlled (CNC)
milling machine. CopyCAD gathers input from physical objects, sketches and
interactions directly on a milling machine, allowing novice users to copy parts
of real world objects, modify them and then create a new physical part.

%M C.UIST.10.383
%T Reflective haptics: haptic augmentation of GUIs through frictional actuation
of stylus-based interactions
%S Demonstrations
%A Hemmert, Fabian
%A Müller, Alexander
%A Jagodzinski, Ron
%A Wintergerst, Götz
%A Joost, Gesche
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 383-384
%K friction, haptic display, physicality, stylus, touch screen
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866231
%X In this paper, we present a novel system for stylus-based GUI interactions:
Simulated physics through actuated frictional properties of a touch screen
stylus. We present a prototype that implements a series of principles which we
propose for the design of frictionally augmented GUIs. It is discussed how such
actuation could be a potential addition of value for stylus-controlled GUIs,
through enabling prioritized content, allowing for inherent confirmation, and
leveraging on manual dexterity.

%M C.UIST.10.385
%T MudPad: localized tactile feedback on touch surfaces
%S Demonstrations
%A Jansen, Yvonne
%A Karrer, Thorsten
%A Borchers, Jan
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 385-386
%K haptic i/o, multitouch, tactile feedback
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866232
%X We present MudPad, a system that is capable of localized active haptic
feedback on multitouch surfaces. An array of electromagnets locally actuates a
tablet-sized overlay containing magnetorheological (MR) fluid. The reaction
time of the fluid is fast enough for realtime feedback ranging from static
levels of surface softness to a broad set of dynamically changeable textures.
As each area can be addressed individually, the entire visual interface can be
enriched with a multi-touch haptic layer that conveys semantic information as
the appropriate counterpart to multi-touch input.

%M C.UIST.10.387
%T Surfboard: keyboard with microphone as a low-cost interactive surface
%S Demonstrations
%A Kato, Jun
%A Sakamoto, Daisuke
%A Igarashi, Takeo
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 387-388
%K interactive surface, keyboard, low-cost, microphone
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866233
%X We introduce a technique to detect simple gestures of "surfing" (moving a
hand horizontally) on a standard keyboard by analyzing recorded sounds in
real-time with a microphone attached close to the keyboard. This technique
allows the user to maintain a focus on the screen while surfing on the
keyboard. Since this technique uses a standard keyboard without any
modification, the user can take full advantage of the input functionality and
tactile quality of his favorite keyboard supplemented with our interface.

%M C.UIST.10.389
%T Animated paper: a moving prototyping platform
%S Demonstrations
%A Koizumi, Naoya
%A Yasu, Kentaro
%A Liu, Angela
%A Sugimoto, Maki
%A Inami, Masahiko
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 389-390
%K flexible structure, organic user interfaces, paper, SMA
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866234
%X We have developed a novel prototyping method that utilizes animated paper, a
versatile platform created from paper and shape memory alloy (SMA), which is
easy to control using a range of different energy sources from sunlight to
lasers. We have further designed a laser point tracking system to improve the
precision of the wireless control system by embedding retro-reflective material
on the paper to act as light markers. It is possible to change the movement of
paper prototypes by varying where to mount the SMA or how to heat it, creating
a wide range of applications.

%M C.UIST.10.391
%T A support to multi-devices web application
%S Demonstrations
%A Pallec, Xaiver Le
%A Marvie, Raphaël
%A Rouillard, José
%A Tarby, Jean-Claude
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 391-392
%K interactive devices, toolkit, web application
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866235
%X Programming an application which uses interactive devices located on
different terminals is not easy. Programming such applications with standard
Web technologies (HTTP, Javascript, Web browser) is even more difficult.
However, Web applications have interesting properties like running on very
different terminals, the lack of a specific installation step, the ability to
evolve the application code at runtime. Our demonstration presents a support
for designing multi-devices Web applications. After introducing the context of
this work, we briefly describe some problems related to the design of
multi-devices web application. Then, we present the toolkit we have implemented
to help the development of applications based upon distant interactive devices.

%M C.UIST.10.393
%T Beyond: collapsible input device for direct 3D manipulation beyond the
screen
%S Demonstrations
%A Lee, Jinha
%A Teerapittayanon, Surat
%A Ishii, Hiroshi
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 393-394
%K 3d interaction, augmented reality, input and interaction technologies,
interaction design, pen and tactile input, pen-based UIs, tabletop UIs, user
interface design, virtual reality
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866236
%X What would it be like to reach into a screen and manipulate or design
virtual objects as in real world? We present Beyond, a collapsible input device
for direct 3D manipulation. When pressed against a screen, Beyond collapses in
the physical world and extends into the digital space of the screen, such that
users can perceive that they are inserting the tool into the virtual space.
Beyond allows users to directly interact with 3D media, avoiding separation
between the users' input and the displayed 3D graphics without requiring
special glasses or wearables, thereby enabling users to select, draw, and
sculpt in 3D virtual space unfettered. We describe detailed interaction
techniques, implementation and application scenarios focused on 3D geometric
design and prototyping.

%M C.UIST.10.395
%T LuminAR: portable robotic augmented reality interface design and prototype
%S Demonstrations
%A Linder, Natan
%A Maes, Pattie
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 395-396
%K actuated UI, augmented reality, gestural interfaces, human robot
interaction, multi-touch interfaces, robotic lamp
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866237
%X In this paper we introduce LuminAR: a prototype for a new portable and
compact projector-camera system designed to use the traditional incandescent
bulb interface as a power source, and a robotic desk lamp that carries it,
enabling it with dynamic motion capabilities. We are exploring how the LuminAR
system embodied in a familiar form factor of a classic Angle Poise lamp may
evolve into a new class of robotic, digital information devices.

%M C.UIST.10.397
%T Blinkbot: look at, blink and move
%S Demonstrations
%A Mistry, Pranav
%A Ishii, Kentaro
%A Inami, Masahiko
%A Igarashi, Takeo
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 397-398
%K blink aware interaction, hands free interaction, human-robot interaction,
robot
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866238
%X In this paper we present BlinkBot -- a hands free input interface to control
and command a robot. BlinkBot explores the natural modality of gaze and blink
to direct a robot to move an object from a location to another. The paper also
explains detailed hardware and software implementation of the prototype system.

%M C.UIST.10.399
%T RoboJockey: real-time, simultaneous, and continuous creation of robot
actions for everyone
%S Demonstrations
%A Shirokura, Takumi
%A Sakamoto, Daisuke
%A Sugiura, Yuta
%A Ono, Tetsuo
%A Inami, Masahiko
%A Igarashi, Takeo
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 399-400
%K creation of robot action, multi-touch interface, robot jockey interface,
visual language
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866239
%X We developed a RoboJockey (Robot Jockey) interface for coordinating robot
actions, such as dancing -- similar to "Disc jockey" and "Video jockey". The
system enables a user to choreograph a dance for a robot to perform by using a
simple visual language. Users can coordinate humanoid robot actions with a
combination of arm and leg movements. Every action is automatically performed
to background music and beat. The RoboJockey will give a new entertainment
experience with robots to the end-users.

%M C.UIST.10.401
%T ARmonica: a collaborative sonic environment
%S Demonstrations
%A Sukan, Mengu
%A Oda, Ohan
%A Shi, Xiang
%A Entrena, Manuel
%A Sadalgi, Shrenik
%A Qi, Jie
%A Feiner, Steven
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 401-402
%K augmented reality, sound
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866240
%X ARmonica is a 3D audiovisual augmented reality environment in which players
can position and edit virtual bars that play sounds when struck by virtual
balls launched under the influence of physics. Players experience ARmonica
through head-tracked head-worn displays and tracked hand-held ultramobile
personal computers, and interact through tracked Wii remotes and touch-screen
taps. The goal is for players to collaborate in the creation and editing of an
evolving sonic environment. Research challenges include supporting walk-up
usability without sacrificing deeper functionality.

%M C.UIST.10.403
%T IODisk: disk-type i/o interface for browsing digital contents
%S Demonstrations
%A Tsukada, Koji
%A Kambara, Keisuke
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 403-404
%K disk, force feedback, i/o device, tangible interface
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866241
%X We propose a disk-type I/O interface, IODisk, which helps users browse
various digital contents intuitively in their living environment. IODisk mainly
consists of a forcefeedback mechanism integrated in the rotation axis of a
disk. Users can control the playing speed/direction contents (e.g., videos or
picture slideshows) in proportion to the rotational speed/direction of the
disk. We developed a prototype system and some applications.

%M C.UIST.10.405
%T Enabling social interactions through real-time sketch-based communication
%S Demonstrations
%A Weibel, Nadir
%A Cowan, Lisa G.
%A Pina, Laura R.
%A Griswold, William G.
%A Hollan, James D.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 405-406
%K communication, digital pen, interactive paper, mobile phone, sketching,
social networks
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866242
%X We present UbiSketch, a tool for ubiquitous real-time sketch-based
communication. We describe the UbiSketch system, which enables people to create
doodles, drawings, and notes with digital pens and paper and publish them
quickly and easily via their mobile phones to social communication channels,
such as Facebook, Twitter, and email. The natural paper-based social
interaction enabled by UbiSketch has the potential to enrich current mobile
communication practices.

%M C.UIST.10.407
%T HIPerPaper: introducing pen and paper interfaces for ultra-scale wall
displays
%S Demonstrations
%A Weibel, Nadir
%A Piper, Anne Marie
%A Hollan, James D.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 407-408
%K interfaces, pen and paper, wall display
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866243
%X While recent advances in graphics, display, and computer hardware support
ultra-scale visualizations of a tremendous amount of data sets, mechanisms for
interacting with this information on large high-resolution wall displays are
still under investigation. Different issues in terms of user interface,
ergonomics, multi-user interaction, and system flexibility arise while facing
ultra-scale wall displays and none of the introduced approaches fully address
them. We introduce HIPerPaper, a novel digital pen and paper interface that
enables natural interaction with the HIPerSpace wall, a 31.8 by 7.5 foot tiled
wall display of 268,720,000 pixels. HIPerPaper provides a flexible, portable,
and inexpensive medium for interacting with large high-resolution wall
displays.

%M C.UIST.10.409
%T EasySnap: real-time audio feedback for blind photography
%S Demonstrations
%A White, Samuel
%A Ji, Hanjie
%A Bigham, Jeffrey P.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 409-410
%K blind users, non-visual interfaces, photography
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866244
%X This demonstration presents EasySnap, an application that enables blind and
low-vision users to take high-quality photos by providing real-time audio
feedback as they point their existing camera phones. Users can readily follow
the audio instructions to adjust their framing, zoom level and subject lighting
appropriately. Real-time feedback is achieved on current hardware using
computer vision in conjunction with use patterns drawn from current blind
photographers.

%M C.UIST.10.411
%T ImpAct: enabling direct touch and manipulation for surface computing
%S Demonstrations
%A Withana, Anusha
%A Kondo, Makoto
%A Kakehi, Gota
%A Makino, Yasutoshi
%A Sugimoto, Maki
%A Inami, Masahiko
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 411-412
%K 6-dof input, direct touch, force feedback, haptic display, simulated
projection rendering, touch screen
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866245
%X This paper explores direct touch and manipulation techniques for surface
computing platforms using a special force feedback stylus named ImpAct
(Immersive Haptic Augmentation for Direct Touch). Proposed haptic stylus can
change its length when it is pushed against a display surface. Correspondingly,
a virtual stem is rendered inside the display area so that user perceives the
stylus immersed through to the digital space below the screen. We propose
ImpAct as a tool to probe and manipulate digital objects in the shallow region
beneath display surface. ImpAct creates a direct touch interface by providing
kinesthetic haptic sensations along with continuous visual contact to digital
objects below the screen surface.

%M C.UIST.10.413
%T The multiplayer: multi-perspective social video navigation
%S Demonstrations
%A Yu, Zihao
%A Diakopoulos, Nicholas
%A Naaman, Mor
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 413-414
%K multi-perspective, social media, video
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866246
%X We present a multi-perspective video "multiplayer" designed to organize
social video aggregated from online sites like YouTube. Our system
automatically time-aligns videos using audio fingerprinting, thus bringing them
into a unified temporal frame. The interface utilizes social metadata to
visually aid navigation and cue users to more interesting portions of an event.
We provide details about the visual and interaction design rationale of the
multiplayer.

%M C.UIST.10.415
%T The enhancement of hearing using a combination of sound and skin sensation
to the pinna
%S Posters
%A Aou, Kanako
%A Ishii, Asuka
%A Furukawa, Masahiro
%A Fukushima, Shogo
%A Kajimoto, Hiroyuki
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 415-416
%K crossmodal displays, emotion, emotional amplification, pinna, skin sensation
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866248
%X Recent development in sound technologies has enabled the realistic replay of
real-life sounds. Thanks to these technologies, we can experience a virtual
real sound environment. However, there are other types of sound technologies
that enhance reality, such as acoustic filters, sound effects, and background
music. They are quite effective if carefully prepared, but they also alter the
sound itself. Consequently, sound is simultaneously used to reconstruct
realistic environments and to enhance emotions, which are actually incompatible
functions.
   With this background, we focused on using tactile modality to enhance
emotions and propose a method that enhances the sound experience by a
combination of sound and skin sensation to the pinna (earlobe). In this paper,
we evaluate the effectiveness of this method.

%M C.UIST.10.417
%T What can internet search engines "suggest" about the usage and usability of
popular desktop applications?
%S Posters
%A Fourney, Adam
%A Mann, Richard
%A Terry, Michael
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 417-418
%K internet search, query log analysis
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866249
%X In this paper, we show how Internet search query logs can yield rich,
ecologically valid data sets describing the common tasks and issues that people
encounter when using software on a day-to-day basis. These data sets can feed
directly into standard usability practices. We address challenges in
collecting, filtering, and summarizing queries, and show how data can be
collected at very low cost, even without direct access to raw query logs.

%M C.UIST.10.419
%T Interacting with live preview frames: in-picture cues for a digital camera
interface
%S Posters
%A Gomez, Steven R.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 419-420
%K computer vision, digital photography, interaction
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866250
%X We present a new interaction paradigm for digital cameras aimed at making
interactive imaging algorithms accessible on these devices. In our system, the
user creates visual cues in front of the lens during the live preview frames
that are continuously processed before the snapshot is taken. These cues are
recognized by the camera's image processor to control the lens or other
settings. We design and analyze vision-based camera interactions, including
focus and zoom controls, and argue that the vision-based paradigm offers a new
level of photographer control needed for the next generation of digital
cameras.

%M C.UIST.10.421
%T HyperSource: bridging the gap between source and code-related web sites
%S Posters
%A Hartmann, Björn
%A Dhillon, Mark
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 421-422
%K augmented source code, browsing history
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866251
%X Programmers frequently use the Web while writing code: they search for
libraries, code examples, tutorials, documentation, and engage in discussions
on Q&A forums. This link between code and visited Web pages largely remains
implicit today. Connecting source code and (selective) browsing history can
help programmers maintain context, reduce the cost of Web content re-retrieval,
and enhance understanding when code is shared. This paper introduces
HyperSource, an IDE augmentation that associates browsing histories with source
code edits. HyperSource comprises a browser extension that logs visited pages;
a novel source document format that maps visited pages to individual
characters; and a user interface that enables interaction with these histories.

%M C.UIST.10.423
%T Shoe-shaped i/o interface
%S Posters
%A Higuchi, Hideaki
%A Nojima, Takuya
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 423-424
%K projectors, shoe-shaped interface, wearable devices
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866252
%X In this research, we propose a shoe-shaped I/O interface. The benefits to
users of wearable devices are significantly reduced if they are aware of them.
Wearable devices should have the ability to be worn without requiring any
attention from the user. However, previous wearable systems required users to
be careful and be aware of wearing or carrying them. To solve this problem, we
propose a shoe-shaped I/O interface. By wearing the shoes throughout the day,
users soon cease to be conscious of them. Electromechanical devices are
potentially easy to install in shoes. This report describes the concept of a
shoe-shaped I/O interface, the development of a prototype system, and possible
applications.

%M C.UIST.10.425
%T Development of the motion-controllable ball
%S Posters
%A Ichikawa, Takashi
%A Nojima, Takuya
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 425-426
%K air pressure, augmented sports, ball interface
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866253
%X In this report, we propose a novel ball type interactive interface device.
Balls are one of the most important pieces of equipment used for entertainment
and sports. Their motion guides a player's response in terms of, for example, a
feint or similar movement. Many kinds of breaking ball throws have been
developed for various sports (e.g. baseball). However, acquiring the skill to
appropriately react to these breaking balls is often hard to achieve and
requires long-term training. Many researchers focus on the ball itself and have
developed interactive balls with visual and acoustic feedbacks. However, these
balls do not have the ability for motion control. In this paper, we introduce a
ball-type motion control interface device. It is composed of a ball and an
air-pressure tank to change its vector using gas ejection. We conducted an
experiment that measures the ball's flight path while subjected to gas ejection
and the results showed that the prototype system had enough power to change the
ball's vector while flying.

%M C.UIST.10.427
%T PETALS: a visual interface for landmine detection
%S Posters
%A Jayatilaka, Lahiru G.
%A Bertuccelli, Luca F.
%A Staszewski, James
%A Gajos, Krzysztof Z.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 427-428
%K assistive visual interface, humanitarian demining, landmine detection,
petals, spatial patterns representation
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866254
%X Post-conflict landmines have serious humanitarian repercussions: landmines
cost lives, limbs and land. The primary method used to locate these buried
devices relies on the inherently dangerous and difficult task of a human
listening to audio feedback from a metal detector. Researchers have previously
hypothesized that expert operators respond to these challenges by building
mental patterns with metal detectors through the identification of
object-dependent spatially distributed metallic fields. This paper presents the
preliminary stages of a novel interface -- Pattern Enhancement Tool for
Assisting Landmine Sensing (PETALS) -- that aims to assist with building and
visualizing these patterns, rather than relying on memory alone. Simulated
demining experiments show that the experimental interface decreases
classification error from 23% to 5% and reduces localization error by 54%,
demonstrating the potential for PETALS to improve novice deminer safety and
efficiency.

%M C.UIST.10.429
%T Pinstripe: eyes-free continuous input anywhere on interactive clothing
%S Posters
%A Karrer, Thorsten
%A Wittenhagen, Moritz
%A Heller, Florian
%A Borchers, Jan
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 429-430
%K continuous input, eyes-free interaction, smart textiles, wearable computing
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866255
%X We present Pinstripe, a textile user interface element for eyes-free,
continuous value input on smart garments that uses pinching and rolling a piece
of cloth between your fingers. Input granularity can be controlled by the
amount of cloth pinched. Pinstripe input elements are invisible, and can be
included across large areas of a garment. Pinstripe thus addresses several
problems previously identified in the placement and operation of textile UI
elements on smart clothing.

%M C.UIST.10.431
%T Kinetic tiles: modular construction units for interactive kinetic surfaces
%S Posters
%A Kim, Hyunjung
%A Lee, Woohun
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 431-432
%K interactive kinetic surface, kinetic design material, kinetic organic
interfaces
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866256
%X We propose and demonstrate Kinetic Tiles, modular construction units for
Interactive Kinetic Surfaces (IKSs). We aimed to design Kinetic Tiles to be
accessible and available so that users can construct IKSs easily and rapidly.
The components of Kinetic Tiles are inexpensive and easily available. In
addition, the use of magnetic force enables the separation of the surface
material and actuators so that users only interact with the tile modules as if
constructing a tile mosaic. Kinetic Tiles can be utilized as a new design and
architectural material that allows the surfaces of everyday objects and spaces
to convey ambient and pleasurable kinetic expressions.

%M C.UIST.10.433
%T Stacksplorer: understanding dynamic program behavior
%S Posters
%A Krämer, Jan-Peter
%A Karrer, Thorsten
%A Diehl, Jonathan
%A Borchers, Jan
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 433-434
%K IDE, navigation, programming
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866257
%X To thoroughly comprehend application behavior, programmers need to
understand the interactions of objects at runtime. Today, these interactions
are often poorly visualized in common IDEs except during debugging.
Stacksplorer allows visualizing and traversing potential call stacks in an
application even when it is not running by showing callers and called methods
in two columns next to the code editor. The relevant information is gathered
from the source code automatically.

%M C.UIST.10.435
%T Memento: unifying content and context to aid webpage re-visitation
%S Posters
%A Kulkarni, Chinmay E.
%A Raju, Santosh
%A Udupa, Raghavendra
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 435-436
%K browsing history, internet search, topic phrases
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866258
%X While users often revisit pages on the Web, tool support for such
re-visitation is still lacking. Current tools (such as browser histories) only
provide users with basic information such as the date of the last visit and
title of the page visited. In this paper, we describe a system that provides
users with descriptive topic-phrases that aid re-finding. Unlike prior work,
our system considers both the content of a webpage and the context in which the
page was visited. Preliminary evaluation of this system suggests users find
this approach of combining content with context useful.

%M C.UIST.10.437
%T Interactive calibration of a multi-projector system in a video-wall
multi-touch environment
%S Posters
%A Lai, Alessandro
%A Soro, Alessandro
%A Scateni, Riccardo
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 437-438
%K multi-touch, video-walls
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866259
%X Wall-sized interactive displays gain more and more attention as a valuable
tool for multiuser applications, but typically require the adoption of
projectors tiles. Projectors tend to display deformed images, due to lens
distortion and/or imperfection, and because they are almost never perfectly
aligned to the projection surface. Multi-projector video-walls are typically
bounded to the video architecture and to the specific application to be
displayed. This makes it harder to develop interactive applications, in which a
fine grained control of the coordinate transformations (to and from user space
and model space) is required. This paper presents a solution to such issues:
implementing the blending functionalities at an application level allows
seamless development of multi-display interactive applications with multi-touch
capabilities. The description of the multi-touch interaction, guaranteed by an
array of cameras on the baseline of the wall, is beyond the scope of this work
which focuses on calibration.

%M C.UIST.10.439
%T CodeGraffiti: communication by sketching for pair programmers
%S Posters
%A Lichtschlag, Leonhard
%A Borchers, Jan
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 439-440
%K code annotation, pair programming, pen input
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866260
%X In pair programming, two software developers work on their code together in
front of a single workstation, one typing, the other commenting. This
frequently involves pointing to code on the screen, annotating it verbally, or
sketching on paper or a nearby whiteboard, little of which is captured in the
source code for later reference. CodeGraffiti lets pair programmers
simultaneously write their code, and annotate it with ephemeral and persistent
sketches on screen using touch or pen input. We integrated CodeGraffiti into
the Xcode software development environment, to study how these techniques may
improve the pair programming workflow.

%M C.UIST.10.441
%T Mouseless
%S Posters
%A Mistry, Pranav
%A Maes, Patricia
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 441-442
%K desktop computing, gestural interaction, input device, mouse, multi-touch
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866261
%X In this short paper we present Mouseless -- a novel input device that
provides the familiarity of interaction of a physical computer mouse without
actually requiring a real hardware mouse. The paper also briefly describes
hardware and software implementation of the prototype system and discusses
interactions supported.

%M C.UIST.10.443
%T Anywhere touchtyping: text input on arbitrary surface using depth sensing
%S Posters
%A Mujibiya, Adiyan
%A Miyaki, Takashi
%A Rekimoto, Jun
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 443-444
%K depth sensing, touch typing, virtual keyboard
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866262
%X In this paper, touch typing enabled virtual keyboard system using depth
sensing on arbitrary surface is proposed. Keystroke event detection is
conducted using 3-dimensional hand appearance database matching combined with
fingertip's surface touch sensing. Our prototype system acquired hand posture
depth map by implementing phase shift algorithm for Digital Light Processor
(DLP) fringe projection on arbitrary flat surface. The system robustly detects
hand postures on the sensible surface with no requirement of hand position
alignment on virtual keyboard frame. The keystroke feedback is the physical
touch to the surface, thus no specific hardware must be worn. The system works
real-time in average of 20 frames per second.

%M C.UIST.10.445
%T Using temporal video annotation as a navigational aid for video browsing
%S Posters
%A Müller, Stefanie
%A Miller, Gregor
%A Fels, Sidney
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 445-446
%K video annotation, video browsing, video navigation, video search
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866263
%X Video is a complex information space that requires advanced navigational
aids for effective browsing. The increasing number of temporal video
annotations offers new opportunities to provide video navigation according to a
user's needs. We present a novel video browsing interface called TAV (Temporal
Annotation Viewing) that provides the user with a visual overview of temporal
video annotations. TAV enables the user to quickly determine the general
content of a video, the location of scenes of interest and the type of
annotations that are displayed while watching the video. An ongoing user study
will evaluate our novel approach.

%M C.UIST.10.447
%T Tweeting halo: clothing that tweets
%S Posters
%A Ng, Wai Shan (Florence)
%A Sharlin, Ehud
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 447-448
%K microblogging, personal halo, personal projector, social networking,
wearable interfaces
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866264
%X People often like to express their unique personalities, interests, and
opinions. This poster explores new ways that allow a user to express her
feelings in both physical and virtual settings. With our Tweeting Halo, we
demonstrate how a wearable lightweight projector can be used for
self-expression very much like a hairstyle, makeup or a T-shirt imprint. Our
current prototype allows a user to post a message physically above their head
and virtually on Twitter at the same time. We also explore simple ways that
will allow physical followers of the Tweeting Halo user to easily become
virtual followers by simply taking a snapshot of her projected tweet with a
mobile device such as a camera phone. In this extended abstract we present our
current prototype, and the results of a design critique we performed using it.

%M C.UIST.10.449
%T DoubleFlip: a motion gesture delimiter for interaction
%S Posters
%A Ruiz, Jaime
%A Li, Yang
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 449-450
%K mobile interaction, motion gestures, sensors
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866265
%X In order to use motion gestures with mobile devices it is imperative that
the device be able to distinguish between input motion and everyday motion. In
this abstract we present DoubleFlip, a unique motion gesture designed to act as
an input delimiter for mobile motion gestures. We demonstrate that the
DoubleFlip gesture is extremely resistant to false positive conditions, while
still achieving high recognition accuracy. Since DoubleFlip is easy to perform
and less likely to be accidentally invoked, it provides an always-active input
event for mobile interaction.

%M C.UIST.10.451
%T QWIC: performance heuristics for large scale exploratory user interfaces
%S Posters
%A Smith, Daniel A.
%A Lambert, Joe
%A schraefel, mc
%A Bretherton, David
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 451-452
%K faceted browsing, performance, scalability
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866266
%X Faceted browsers offer an effective way to explore relationships and build
new knowledge across data sets. So far, web-based faceted browsers have been
hampered by limited feature performance and scale. QWIC, Quick Web Interface
Control, describes a set of design heuristics to address performance speed both
at the interface and the backend to operate on large-scale sources.

%M C.UIST.10.453
%T What interfaces mean: a history and sociology of computer windows
%S Posters
%A Teitelbaum, Louis-Jean
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 453-454
%K activity, history, sociology, windows
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866267
%X This poster presents a cursory look at the history of windows in Graphical
User Interfaces. It examines the controversy between tiling and overlapping
window managers and explains that controversy's sociological importance:
windows are control devices, enabling their users to manage their activity and
attention. It then explores a few possible reasons for the relative
disappearance of windowing in recent computing devices. It concludes with a
recapitulative typology.

%M C.UIST.10.455
%T Exploring pen and paper interaction with high-resolution wall displays
%S Posters
%A Weibel, Nadir
%A Piper, Anne Marie
%A Hollan, James D.
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 455-456
%K digital pen, paper, wall display
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866268
%X We introduce HIPerPaper, a novel digital pen and paper interface that
enables natural interaction with a 31.8 by 7.5 foot tiled wall display of
268,720,000 pixels. HIPerPaper provides a flexible, portable, and inexpensive
medium for interacting with large high-resolution wall displays. While the size
and resolution of such displays allow visualization of data sets of a scale not
previously possible, mechanisms for interacting with wall displays remain
challenging. HIPerPaper enables multiple concurrent users to select, move,
scale, and rotate objects on a high-dimension wall display.

%M C.UIST.10.457
%T Enabling tangible interaction on capacitive touch panels
%S Posters
%A Yu, Neng-Hao
%A Chan, Li-Wei
%A Cheng, Lung-Pan
%A Chen, Mike Y.
%A Hung, Yi-Ping
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 457-458
%K interactive surface, markers, physical interaction, tangible
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866269
%X We propose two approaches to sense tangible objects on capacitive touch
screens, which are used in off-the-shelf multi-touch devices such as Apple
iPad, iPhone, and 3M's multi-touch displays. We seek for the approaches that do
not require modifications to the panels: spatial tag and frequency tag. Spatial
tag is similar to fiducial tag used by tangible tabletop surface interaction,
and uses multi-point, geometric patterns to encode object IDs. Frequency tag
simulates high-frequency touches in the time domain to encode object IDs, using
modulation circuits embedded inside tangible objects to simulate high-speed
touches in varying frequency. We will show several demo applications. The first
combines simultaneous tangible + touch input system. This explores how tangible
inputs (e.g., pen, easer, etc.) and some simple gestures work together on
capacitive touch panels.

%M C.UIST.10.459
%T MobileSurface: interaction in the air for mobile computing
%S Posters
%A Zhao, Ji
%A Liu, Hujia
%A Zhang, Chunhui
%A Zhang, Zhengyou
%B Proceedings of the 2010 ACM Symposium on User Interface Software and
Technology
%D 2010-10-03
%P 459-460
%K anywhere interaction, mobile, pico-projector, projector-camera system
%* (c) Copyright 2010 ACM
%W http://doi.acm.org/10.1145/1866218.1866270
%X We describe a virtual interactive surface technology based on a
projector-camera system connected to a mobile device. This system, named mobile
surface, can project images on any free surfaces and enable interaction in the
air within the projection area. The projector used in the system scans a laser
beam very quickly across the projection area to produce a stable image at 60
fps. The camera-projector synchronization is applied to obtain the image of the
appointed scanning line. So our system can project what is perceived as a
stable image onto the display surface, while simultaneously working as a
structured light 3D scanning system.