[1]
Treemaps to visualise and navigate speech audio
Audio and speech
/
Abdulhamid, Fahmi
/
Marshall, Stuart
Proceedings of the 2013 Australian Computer-Human Interaction Conference
2013-11-25
2013-11-25
p.555-564
© Copyright 2013 ACM
Summary: Audio recordings are usually treated as one unbreakable and sequential
document. Most interfaces only support basic audio navigation controls such as
play, pause, forward, and rewind. However, by extracting meaningful information
from audio, such as the spoken words and acoustic noise, we have created a
Treemap-based interface which makes the task of finding the important
information in audio simple. When applied to lecture audio, our interface
allows students to easily consume lecture recordings by only listening to the
parts they are interested in. A user study shows that our interface can
successfully help users to find content in lecture recordings.
[2]
Interaction Science and the Aging User: Techniques to Assist in Design and
Evaluation
Age-Related Issues
/
Marshall, Sandra P.
UAHCI 2013: 7th International Conference on Universal Access in
Human-Computer Interaction, Part II: User and Context Diversity
2013-07-21
v.2
p.133-141
Keywords: Aging; Cognitive Workload; Eye Tracking; Interface Design
© Copyright 2013 Springer-Verlag
Summary: The aging user presents unique challenges to designers of new technologies,
in part because of physical changes in the user's visual system. This paper
reviews a number of these changes and shows how eye tracking can assist
interaction science studies, both through traditional eye-movement metrics as
well as with pupil-based estimates of cognitive workload. Three studies of
older and younger participants are described.
[3]
Measuring cognitive workload across different eye tracking hardware
platforms
Eye tracking systems issues I
/
Bartels, Michael
/
Marshall, Sandra P.
Proceedings of the 2012 Symposium on Eye Tracking Research &
Applications
2012-03-28
p.161-164
© Copyright 2012 ACM
Summary: As pertinent technologies continue to evolve, eye tracking hardware options
grow more diverse. Consequently, it is important that researchers verify that
new systems and parameters used in testing meet data collection quality
standards. The current study evaluated hardware from four manufacturers: SR
Research, Seeing Machines, SensoMotoric Instruments and Tobii Technology. The
eye trackers included different system types and different sampling rates. The
purpose of this research was to determine whether or not the pupil recording of
each system was precise enough to effectively utilize the Index of Cognitive
Activity, a validated cognitive workload metric. Results indicated that each
system effectively captured Index of Cognitive Activity data. System factors
such as system type sampling rate did not affect the metric. To maintain the
integrity of data collected by succeeding generations of eye tracker, it is
important that this type of quality-control research continues.
[4]
Designing games to educate diabetic children
/
Chen, Gang
/
Baghaei, Nilufar
/
Sarrafzadeh, Abdolhossein
/
Manford, Chris
/
Marshall, Steve
/
Court, Gudrun
Proceedings of the 2011 Australian Computer-Human Interaction Conference
2011-11-28
p.72-75
© Copyright 2011 ACM
Summary: The use of computer games as common vehicles for education, as opposed to
pure entertainment, has gained popularity in recent years. Traditional method
for diabetes education relies heavily on written materials and there is only a
limited amount of resources targeted at educating diabetic children. In this
paper, we present a novel approach for designing computer games aimed for
educating children with diabetes. Our game design was applied to an existing
open source game (Mario Brothers). The results of a pilot study showed that
participants enjoyed playing the game and found it valuable for educating
diabetic patients.
[5]
SourceVis: a tool for multi-touch software visualization
Multi-surface
/
Anslow, Craig
/
Marshall, Stuart
/
Noble, James
/
Biddle, Robert
Proceedings of the 2011 ACM International Conference on Interactive
Tabletops and Surfaces
2011-11-13
p.264-265
© Copyright 2011 ACM
Summary: Most software visualization systems and tools are designed from a
single-user perspective and are bound to the desktop and Integrated Development
Environments (IDEs). These design decisions do not allow users to easily
navigate through software visualizations or to analyse software
collaboratively. We have developed SourceVis, a collaborative multi-touch
software visualization prototype for multi-touch tables. In this paper we
describe the visualizations and interaction capabilities of our prototype.
[6]
Eye Tracking and Universal Access: Three Applications and Practical Examples
Eye Tracking, Gestures and Brain Interfaces
/
Bartels, Michael
/
Marshall, Sandra P.
UAHCI 2011: 6th International Conference on Universal Access in
Human-Computer Interaction, Part II: Users Diversity
2011-07-09
v.2
p.525-534
Keywords: eye tracking; HCI; Universal access
Copyright © 2011 Springer-Verlag
Summary: The human eye is an essential component in the communication between
computers and their operators. For this reason, eye tracking technology
provides a valuable perspective into HCI. This paper discusses three
applications of eye tracking technology to the challenge of universal access.
The first is the use of gaze-controlled systems that allow disabled users to
operate computers and other modern technology. The second is the use of eye
tracking as a research methodology to be used in designing interfaces that help
to bridge the digital divide. The third is the use of eye data to examine
cognitive attributes (i.e., workload, fatigue, etc.) of operators of complex
systems as they complete critical tasks. Practical examples of each of the
three applications are provided.
[7]
Lessons learnt from collaboratively creating maps on a touch table
/
Tran, Hien
/
Anslow, Craig
/
Marshall, Stuart
/
Potanin, Alex
/
de Róiste, Mairéad
Proceedings of CHINZ'11, the ACM SIGCHI New Zealand Chapter's International
Conference on Computer-Human Interaction
2011-07-04
p.105-108
© Copyright 2011 ACM
Summary: While touch tables have improved support for creative, co-located,
collaborative tasks, the very act of studying what groups create on such tables
(and how) remains non-trivially difficult. We developed an experimental tool to
study what map designs would be created by pairs of users collaborating around
a touch table, however to paraphrase the German military strategist Helmuth von
Moltke: "no experimental tool survives contact with the table". While running
our experiments, we made a series of observations around issues with table
interaction, and our initial expectations on how the users would be able to
interact with the tool. In this paper, we contribute these observations to
assist other researchers considering undertaking a similar course of action.
[8]
User evaluation of polymetric views using a large visualization wall
New visualization and interaction techniques
/
Anslow, Craig
/
Marshall, Stuart
/
Noble, James
/
Tempero, Ewan
/
Biddle, Robert
Proceedings of the ACM Symposium on Software Visualization
2010-10-25
p.25-34
© Copyright 2010 ACM
Summary: There are few visualization techniques for displaying complex software
systems with large numbers of packages and classes. One visualization technique
is the System Hotspots View, whose effectiveness has yet to be validated by any
empirical studies. We have conducted a user evaluation to see whether
participants of our modified System Hotspots View using a large visualization
wall can accurately identify key measurements and comparisons in the underlying
software system. The results of our user evaluation indicate that participants
were able to effectively use our modified System Hotspots View to explore the
example domain: version 1.6 of the Java API. Our observations also indicate
that there are issues around interacting with the visualization wall.
[9]
Exploring the inventor's paradox: applying jigsaw to software visualization
Visualization for program comprehension and maintenance
/
Ruan, Haowei
/
Anslow, Craig
/
Marshall, Stuart
/
Noble, James
Proceedings of the ACM Symposium on Software Visualization
2010-10-25
p.83-92
© Copyright 2010 ACM
Summary: Software visualization research has typically focussed on domain specific
tools and techniques. In this paper, we evaluate applying a general purpose
visual analytics tool Jigsaw to visualize the JHotDraw open source software
system. We describe how Jigsaw can be applied to visualize software, and show
how it can support some program comprehension tasks.
[10]
Balancing acts: walking the Agile tightrope
/
Hoda, Rashina
/
Noble, James
/
Marshall, Stuart
Proceedings of the 2010 International Workshop on Cooperative and Human
Aspects of Software Engineering
2010-05-02
p.5-12
© Copyright 2010 ACM
Summary: Self-organizing teams are one of the critical success factors on Agile
projects -- and yet, little is known about the self-organizing nature of Agile
teams and the challenges they face in industrial practice. Based on a Grounded
Theory study of 40 Agile practitioners across 16 software development
organizations in New Zealand and India, we describe how self-organizing Agile
teams perform balancing acts between (a) freedom and responsibility (b)
cross-functionality and specialization, and (c) continuous learning and
iteration pressure, in an effort to maintain their self-organizing nature. We
discuss the relationship between these three balancing acts and the fundamental
conditions of self-organizing teams -- autonomy, cross-fertilization, and
self-transcendence.
[11]
The effect of user interface delay in thin client mobile games
Contributed papers
/
Delwadia, Vipul
/
Marshall, Stuart
/
Welch, Ian
Proceedings of AUIC'10, Australasian User Interface Conference
2010-01-20
p.5-13
© Copyright 2010 Australian Computer Society
Summary: Thin-client computing may be a solution to such problems as providing
sophisticated applications on devices with low computational power, or
providing reasonable access to digital artifacts whose distribution the
copyright owner still wishes to protect. However, certain application domains
have tight constraints around user interface response times, and the network
aspect of thin-client computing may cause issues in this regard. We have
conducted an experiment to identify how various delays added to mobile games
affect players' performance and perceptions of the gameplay. By studying the
effects of these delays, we aim to identify time-based performance parameters
within which our future thin-client computing systems should work if they are
to support all application domains.
[12]
What the Eyes Reveal: Measuring the Cognitive Workload of Teams
Modeling Behavior, Emotion and Cognition
/
Marshall, Sandra P.
DHM 2009: 2nd International Conference on Digital Human Modeling
2009-07-19
p.265-274
Keywords: eye tracking; pupil dilation; cognitive workload; team assessment
Copyright © 2009 Springer-Verlag
Summary: This paper describes the measurement of cognitive workload using the
Networked Evaluation System (NES). NES is a unique network of coordinated
eye-tracking systems that allows monitoring of groups of decision makers
working together in a single environment. Two implementations are described.
The first is a military application with teams of officers working together on
a simulated joint relief mission, and the second is a fatigue study with teams
of individuals working together in a simulated lunar search and recovery
mission.
[13]
Remotely shooting asteroids on our mobile phone
/
Delwadia, Vipul
/
Marshall, Stuart
/
Welch, Ian
Proceedings of CHINZ'09, the ACM SIGCHI New Zealand Chapter's International
Conference on Computer-Human Interaction
2009-07-02
p.45-52
Keywords: games preservation, remote mobile gaming
© Copyright 2009 ACM
Summary: The New Zealand software industry developed numerous games and applications
during the last decades of the twentieth century. These games and applications
-- our digital culture -- are now becoming inaccessible and lost due to
preservation and copyright problems. Providing remote access on standard mobile
phones to centrally controlled and protected archives of old games and
applications may be one approach to overcoming some of the preservation and
copyright problems. However, remote access over wireless poses performance
problems that could negatively impact the experience of using the preserved
software, especially if the software is a computer game requiring immediate
responses to player actions. In this paper, we attempt to discover what time
performance requirements such a remote access system would need to satisfy by
experimenting with various time delays to see how players' scores and
perceptions of the game deteriorate.
[14]
A theory-based framework for evaluating exergames as persuasive technology
Design & evaluation of persuasive systems
/
Adams, Marc A.
/
Marshall, Simon J.
/
Dillon, Lindsay
/
Caparosa, Susan
/
Ramirez, Ernesto
/
Phillips, Justin
/
Norman, Greg J.
Proceedings of the 2009 International Conference on Persuasive Technology
2009-04-26
p.45
© Copyright 2009 ACM
Summary: Exergames are video games that use exertion-based interfaces to promote
physical activity, fitness, and gross motor skill development. The purpose of
this paper is to describe the development of an organizing framework based on
principles of learning theory to classify and rank exergames according to
embedded behavior change principles. Behavioral contingencies represent a key
theory-based game design principle that can be objectively measured, evaluated,
and manipulated to help explain and change the frequency and duration of game
play. Case examples are presented that demonstrate how to code dimensions of
behavior, consequences of behavior, and antecedents of behavior. Our framework
may be used to identify game principles which, in the future, might be used to
predict which games are most likely to promote adoption and maintenance of
leisure time physical activity.
[15]
Using remotely executing software via a mobile device
/
Delwadia, Vipul
/
Marshall, Stuart
/
Welch, Ian
Proceedings of AUIC'09, Australasian User Interface Conference
2009
p.3-8
Copyright © 2009 Australian Computer Society
Summary: There are scenarios in mobile computing that may benefit from separating
presentation from computation. Traditionally this separation can be achieved
via tools such as VNC. However such factors as network latency and additional
communication overhead can slow down the presentation of a remotely executing
mobile application below acceptable performance levels, especially for domains
like gaming where responses may need to appear to be instantaneous. We present
RemoteMe, an architecture and Java-based prototype for mobile-client / server
communication that only requires a very thin mobile client. We hypothesise that
RemoteMe will support faster response times to user input than existing
software solutions such as VNC. This paper presents a preliminary analysis of
our first prototype, and experimentally compares it to an open-source
mobile-based VNC system.
[16]
The Evaluation of Structured Communication Tools in Healthcare
HEALTH CARE: HC5 - Improving Communication and Teamwork in Health Care
Settings
/
Marshall, Stuart
/
Harrison, Julia
/
Flanagan, Brendan
Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting
2008-09-22
v.52
p.860-864
© Copyright 2008 HFES
Summary: Suboptimal communication between health professionals has been identified as
a significant causative factor in incidents compromising patient safety. The
use of a structured method of communication has been suggested to improve the
quality of information exchange, particularly with inexperienced practitioners.
One structure that has been suggested to improve communication is the
situational briefing tool SBAR. This tool was developed by the US Navy for
standardizing important and urgent communication in nuclear submarines. Despite
its widespread uptake in some areas of healthcare, its effectiveness has until
recently been unproven. This paper describes the benefits and pitfalls of
methods we have used to prove the effectiveness of these communication tools.
[17]
Web software visualization using extensible 3D (X3D) graphics
Posters
/
Anslow, Craig
/
Noble, James
/
Marshall, Stuart
/
Biddle, Robert
Proceedings of the ACM Symposium on Software Visualization
2008-09-16
p.213-214
Keywords: extensible 3D graphics, software visualization
© Copyright 2008 ACM
Summary: 3D web software visualization has always been expensive, special purpose,
and hard to program. Most of the technologies used require large amounts of
scripting, are not reliable on all platforms, are binary formats, or no longer
maintained. We can make web software visualization of object-oriented programs
cheap, portable, and easy by using Extensible (X3D) 3D Graphics, which is a
free open standard. In this paper we outline our experience with X3D and
discuss the suitability of X3D as an output format for software visualization.
[18]
Annotating UI architecture with actual use
Contributed papers: user interface analysis
/
Ramsay, Neil
/
Marshall, Stuart
/
Potanin, Alex
Proceedings of AUIC'08, Australasian User Interface Conference
2008
p.75-78
Copyright © 2008 Australian Computer Society
Summary: Developing an appropriate user interface architecture for supporting a
system's tasks is critical to the system's overall usability. While there are
principles to guide architectural design, confirming that the correct decisions
are made can involve the collection and analysis of lots of test data. We are
developing a testing environment that will automatically compare and contrast
the actual user interaction data against the existing user interface
architectural models. This can help a designer more clearly understand how the
actual tasks performed relate to the proposed architecture, and enhances
feedback between different design artifacts.
[19]
Development of Team Coordination and Performance Measures in a Trauma
Setting
HEALTH CARE: Collaboration, Communication, and Task Support in Medical
Contexts
/
Marshall, Stuart
/
Miller, Anne
/
Xiao, Yan
Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting
2007-10-01
v.51
p.717-721
© Copyright 2007 HFES
Summary: The paucity of reliable measures of team coordination and performance
significantly obstructs the assessment of the effects of any technology on
teams to improve decision making in health care. A pilot study was conducted to
determine if measures of coordination and performance could be developed for
teams involved in trauma resuscitation. A video assisted review of cases
enabled evaluation of the use of the tools. Descriptors of coordination were
derived from Klein's five-stage model of team coordination. A scoring system of
team performance was developed from the University of Maryland Team Observable
Performance Metric (UMTOP). After some modification both coordination and
performance could be described. However, four defined stages of resuscitation
were observed which greatly improved coding. More rigorous assessments of these
tools will be required before firm conclusions can be drawn about the effects
of a decision support tool recently introduced into the environment.
[20]
Evaluating X3D for use in software visualization
Poster abstracts
/
Anslow, Craig
/
Marshall, Stuart
/
Noble, James
/
Biddle, Robert
Proceedings of the ACM Symposium on Software Visualization
2006-09-04
p.161-162
Keywords: X3D, evaluation, software visualization, web-based 3D graphics
© Copyright 2006 ACM
Summary: There are many technologies that have varying capabilities that could be
used to help understand software through visualizations. Determining which
technology is best suited for the development and delivery of a particular type
of software visualization can be a complex task. We have evaluated the Web3D
Consortium's X3D specification -- the open standard for web-based 3D graphics
-- against some taxonomies of the types of graphical representations for
software visualization. Our evaluation shows that X3D can support the
development and delivery of visualizations that people use to understand the
structure and behaviour of software.
[21]
Eye tracking insights into cognitive modeling
Comprehension and cognition
/
Bartels, Mike
/
Marshall, Sandra P.
Proceedings of the 2006 Symposium on Eye Tracking Research &
Applications
2006-03-27
p.141-147
Keywords: AMBR, eye tracking, human performance modeling
© Copyright 2006 ACM
Summary: The original 2000 AMBR project sought to evaluate how well four human
performance models simulated behavior of human participants. Participants and
models completed a modified version of an air traffic control task and were
compared on the dimensions of performance, reaction time and subjective
workload ratings. The current study replicated the human performance findings
of the previous phase of AMBR and added eye tracking analysis to enhance
understanding of participants' behavior. Examination of gaze position and
patterns of eye movement provided evidence that participants adopted different
visual strategies to complete the task in different display conditions and at
different levels of demand. Applicability of eye tracking analyses to cognitive
models is discussed.
[22]
Visualisations of execution traces (VET): an interactive plugin-based
visualisation tool
/
McGavin, Mike
/
Wright, Tim
/
Marshall, Stuart
Proceedings of AUIC'06, Australasian User Interface Conference
2006
p.153-160
Copyright © 2006 Australian Computer Society
Summary: An execution trace contains a description of everything that happened during
an execution of a program. Execution traces are useful, because they can help
software engineers understand code, resulting in a variety of applications such
as debugging software, or more effective software reuse. Unfortunately,
execution traces are also complex, typically containing hundreds of thousands
of events for medium size computer programs, and more for large scale programs.
We have developed an execution trace visualisation tool, called VET, that helps
programmers manage the complexity of execution traces. VET is also plugin
based. Expert users of VET can add new visualisations and new filters, without
changing VET's main code base.
[23]
A Web user interface for an interactive software repository
/
Marshall, Stuart
/
Biddle, Robert
/
Noble, James
Proceedings of AUIC'04, Australasian User Interface Conference
2004
p.57-64
Copyright © 2004 Australian Computer Society
Summary: Using tools aimed at promoting the reuse of existing components costs the
user in the time and effort needed to install and understand the tool. These
costs could counteract or subsume the benefits of reuse argued for by reuse
practitioners, rendering the activity worthless. One approach to reducing these
costs is to deploy the tools in an environment that the user is already
familiar with, and has easy access to. We have chosen the web as just such an
environment, and this choice can have a significant impact on the usability and
utility of the tool. This paper discusses the difficulties that arise from our
use of the web, and the manner in which we have partly overcome these
difficulties.
[24]
New techniques for evaluating innovative interfaces with eye tracking
Keynote
/
Marshall, Sandra
Proceedings of the 2003 International Conference on Multimodal Interfaces
2003-11-05
p.2
© Copyright 2003 ACM
Summary: Computer interfaces are changing rapidly, as are the cognitive demands on
the operators using them. Innovative applications of new technologies such as
multimodal and multimedia displays, haptic and pen-based interfaces, and
natural language exchanges bring exciting changes to conventional interface
usage. At the same time, their complexity may place overwhelming cognitive
demands on the user. As novel interfaces and software applications are
introduced into operational settings, it is imperative to evaluate them from a
number of different perspectives. One important perspective examines the extent
to which a new interface changes the cognitive requirements for the operator.
This presentation describes a new approach to measuring cognitive effort
using metrics based on eye movements and pupil dilation. It is well known that
effortful cognitive processing is accompanied by increases in pupil dilation,
but measurement techniques were not previously available that could supply
results in real time or deal with data collected in long-lasting interactions.
We now have a metric-the Index of Cognitive Activity-that is computed in real
time as the operator interacts with the interface. The Index can be used to
examine extended periods of usage or to assess critical events on an
individual-by-individual basis.
While dilation reveals when cognitive effort is highest, eye movements
provide evidence of why. Especially during critical events, one wants to know
whether the operator is confused by the presentation or location of specific
information, whether he is attending to key information when necessary, or
whether he is distracted by irrelevant features of the display. Important
details of confusion, attention, and distraction are revealed by traces of his
eye movements and statistical analyses of time spent looking at various
features during critical event.
Together, the Index of Cognitive Activity and the various analyses of eye
movements provide essential information about how users interact with new
interface technologies. Their use can aid designers of innovative hardware and
software products by highlighting those features that increase rather than
decrease users' cognitive effort.
In the presentation, the underlying mathematical basis of the Index of
Cognitive Activity will be described together with validating research results
from a number of experiments. Eye movement analyses from the same studies give
clues to the sources of increase in cognitive workload. To illustrate interface
evaluation with the ICA and eye movement analysis, several extended examples
will be presented using commercial and military displays. [NOTE: Dr. Marshall's
eye tracking system will be available to view at Tuesday evening's joint
UIST-ICMI demo reception.
[25]
How (not) to help people test drive code
/
Marshall, Stuart
/
Biddle, Robert
/
Tempero, Ewan
Proceedings of AUIC'02, Australasian User Interface Conference
2002
p.39-42
Copyright © 2002 Australian Computer Society
Summary: This paper discusses the results of usability testing on the interface of
Dyno. Dyno is a tool designed to support code reuse by helping software
developers understand what a specified piece of code does. The tool does this
by allowing a programmer to undertake a process we call test driving. This
paper looks at the deficiencies uncovered in the initial interface, and the
implications this has for a tool aimed at helping software developers better
understand code fragments so as to be able to reuse them.
