[1]
Meet the HFES Journal Editors
General Sessions: GS8 -- Meet the HFES Journal Editors
/
Carswell, C. Melody
/
DeLucia, Patricia R.
/
Pritchett, Amy R.
/
Stuart-Buttle, Carol
Proceedings of the Human Factors and Ergonomics Society 2014 Annual Meeting
2014-10-27
p.596
doi 10.1177/1541931214581127
© Copyright 2014 HFES
Summary: The three outstanding HFES journals serve to publish the results of human
factors/ergonomics research, case studies, and applications to design. During
this panel, each of the HFES journals editors in chief (EIC) will present a
brief overview summarizing the unique features and objectives of his or her
journal. Attendees will come away with (a) an appreciation for the journal that
would be most appropriate for their work, (b) an understanding of the
manuscript review process, (c) an awareness of the most common mistakes that
authors make when submitting to each of the journals, and (d) tips for
increasing the likelihood that a manuscript will ultimately be published.
Following the presentations, the EICs will answer questions from the audience.
[2]
Development of a Hybrid Reality Display for Welders through Applied
Cognitive Task Analysis
Interactive Posters & Demos: POS1 -- Interactive Posters & Demos
/
Seidelman, Will
/
Lee, Michael
/
Kent, Travis M.
/
Carswell, C. Melody
/
Fu, Bo
/
Yang, Ruigang
Proceedings of the Human Factors and Ergonomics Society 2014 Annual Meeting
2014-10-27
p.1174-1178
doi 10.1177/1541931214581245
© Copyright 2014 HFES
Summary: With the current trend toward semi-autonomous welding systems, the typical
duties of a skilled welder are likely to transition from that of manual
operator to a more supervisory role. The shifting demands on welders
necessitates novel welding displays to support an increased variety of tasks.
The current work utilizes applied cognitive task analysis to identify the needs
of expert welders, specifically in regards to the identification of important
sensory cues useful when monitoring the welding process in real-time. Results
are presented in a cognitive demands table in a manner intended to be useful to
multidisciplinary teams engaged in the development of future welding platforms.
[3]
Can Incongruencies Between Prospective and Retrospective Ease-of-Use
Perceptions Affect Post-Use Satisfaction Ratings?
Interactive Posters & Demos: POS2 -- Interactive Posters & Demos
/
Sublette, M. A.
/
Carswell, C. M.
/
Seidelman, W.
/
Lee, M.
/
Kent, T.
Proceedings of the Human Factors and Ergonomics Society 2014 Annual Meeting
2014-10-27
p.1314-1317
doi 10.1177/1541931214581274
© Copyright 2014 HFES
Summary: Consumers' expectations about the usability of products may be an important
contributor to their overall satisfaction with a design. The purpose of this
study was to explore how incongruencies between predicted usability and actual
usability of a design affect a user's post-use satisfaction ratings for a
design. Participants predicted the usability of two stove designs and then used
the designs to perform a task. Interactive stoves had varying degrees of
burner-knob s-r compatibility. In general, the relative dissatisfaction
associated with the 'hard' design compared to the 'easy' design was dependent
on the initial usability prediction of the participant. Participants who
initially predicted the design would be difficult-to-use had lower satisfaction
ratings for easy-to-use designs than participants who initially predicted the
same designs would be easy-to-use. These finding suggests that making a product
look easy-to-use may be as important as actually making it easy-to-use,
therefore designers should consider designing for both initial impressions of
usability as well as actual usability.
[4]
Zebra-Striping: Visual Flow in Grid-based Graphic Design
Interactive Posters & Demos: POS2 -- Interactive Posters & Demos
/
Lee, Michael
/
Kent, Travis
/
Carswell, C. Melody
/
Seidelman, Will
/
Sublette, Michelle
Proceedings of the Human Factors and Ergonomics Society 2014 Annual Meeting
2014-10-27
p.1318-1322
doi 10.1177/1541931214581275
© Copyright 2014 HFES
Summary: Grids, matrices, and tables are commonly used to organize information. A
number of design techniques and psychological principles address how viewers'
eyes can be guided through a visual work. Designers refer to such objectives as
"creating visual flow." One common technique, 'zebra-shading,' is intended to
guide eyes through the grid by alternating shaded and unshaded rows or columns.
However, the effects of these manipulations have largely not been explored
experimentally. We will review the techniques designers use to guide the eyes
of their audience, associated psychological foundations, and outline some
research done on the graphic design of a specific type of grid: tables. Then,
we will describe an experiment wherein participants conducted a visual search
task in grids with different shading manipulations. The analysis showed data
trending toward improved response time when the target followed the shading.
[5]
User centered design of a hybrid-reality display for weld monitoring
Works-in-progress
/
Seidelman, Will
/
Lee, Michael
/
Carswell, C. Melody
/
Kent, Travis
/
Fu, Bo
/
Yang, Ruigang
Proceedings of ACM CHI 2014 Conference on Human Factors in Computing Systems
2014-04-26
v.2
p.2059-2064
© Copyright 2014 ACM
Summary: We present a current multi-study process aimed at developing a
hybrid-reality display for use in remote welding. Results from an initial user
study and applied cognitive task analysis are discussed along with possible
future development directions.
[6]
Green Expectations: The Story of a Customizable Lighting Control Panel
Designed to Reduce Energy Use
Posters: POS1 -- Poster & Demo Interactive Session 1
/
Lee, Michael
/
Carswell, C. Melody
/
Seidelman, Will
/
Sublette, Michelle
Proceedings of the Human Factors and Ergonomics Society 2013 Annual Meeting
2013-09-30
p.1353-1357
doi 10.1177/1541931213571299
© Copyright 2013 HFES
Summary: Environmental control and sustainability have become increasingly important
in the design of workspaces. Lighting systems in particular have undergone many
changes through the incorporation of computer-integrated control panels working
in tandem with occupancy and light sensors. Such control panels can allow for
increased perceived environmental control which has been shown to improve job
satisfaction and productivity (Kroner, 1992; O'Neil, 2004). However, these
controls must be designed effectively according to a number of principles
regarding interaction design, including good stimulus-response compatibility
and adherence to population stereotypes. The purpose of this study is to
evaluate the usability of one such control panel being used in a smart, green
building, and to see how the shortcomings in the design may force users to
default to the most familiar setting, which may not be the most energy
efficient.
[7]
Haptic Data Visualization and Creative Thought: Beyond Standard Measures of
Performance
Posters: POS1 -- Poster & Demo Interactive Session 1
/
Seidelman, Will
/
Carswell, C. Melody
/
Lee, Michael
Proceedings of the Human Factors and Ergonomics Society 2013 Annual Meeting
2013-09-30
p.1410-1414
doi 10.1177/1541931213571315
© Copyright 2013 HFES
Summary: Recently, there has been a large push for the use of multimodal interfaces
to enhance data visualization. However, supporting data visualization displays
with haptic feedback has been slower to develop. In the current paper, we argue
that the variables traditionally used by human factors practitioners to assess
performance of visualization displays will unfairly bias researchers and
designers away from the haptic modality. Instead, researchers will be better
served to assess the influence of haptic displays on some of the core strengths
of visualization: the depth at which the underlying data may be synthesized and
the level to which the display enhances novel or creative hypothesis
generation.
[8]
The Impact of Aesthetic Design on Bus Shelter Usability
Posters: POS2 -- Poster & Demo Interactive Session 2
/
Crouch, James
/
Lee, Michael
/
Carswell, C. Melody
/
Patrick, Tyler
/
Seidelman, Will
/
Sublette, Michelle
Proceedings of the Human Factors and Ergonomics Society 2013 Annual Meeting
2013-09-30
p.1490-1494
doi 10.1177/1541931213571332
© Copyright 2013 HFES
Summary: Public transportation is an important tool for any city with the population
to support it. According to the American Public Transportation Association
(APTA) (2012), between 1995 and 2011, public transportation ridership increased
by 34% -- a growth rate higher than the 17% increase in U.S. population and
higher than the 22% growth in the use of the nation's highways over the same
period. However, even a city with the population to support public
transportation will not receive all of its benefits if the implementation is
not handled successfully. One requirement for bus transit is that the system be
equipped with shelters having minimally the following features: support,
visibility, security and information access (Ely, 1998). A field study was
conducted to ascertain the impact of these design elements as well as aesthetic
pleasantness on users' perceptions of the shelters. Ultimately, our goal is to
implement future results in the creation of a needs-based heuristic framework
which will aid designers in the formation of functional bus shelters.
[9]
Further Explorations of the "White Space" Bias in Users' Anticipation of
Task Workload
Posters: POS2 -- Poster & Demo Interactive Session 2
/
Sublette, M.
/
Carswell, C. M.
/
Seidelman, W.
/
Lee, M.
/
Seales, W. B.
Proceedings of the Human Factors and Ergonomics Society 2013 Annual Meeting
2013-09-30
p.1600-1604
doi 10.1177/1541931213571356
© Copyright 2013 HFES
Summary: As more designers allow users to customize the look and feel of interfaces,
users will be required to recognize the implications of their choices on their
future performance, comfort, and enjoyment. Understanding the limits of
people's predictive capabilities may be an important component in identifying
why people choose one product over another based on ease of use or why people
have difficulties identifying tasks that can be performed together. The purpose
of this study is to further explore users' biases for utilizing the amount of
white space in the stimulus as a predictor of task difficulty, to validate
discrepancies between predicted task difficulty and performance outcomes found
in previous research and the human factors literature, and to identify
task-specific strategies that are used to anticipate task difficulty. The study
uses the NASA Task Load Index (NASA-TLX) in prospective difficulty judgments
for these three types of tasks: 1) a stimulus-response compatibility task, 2) a
target acquisition task and 3) a perceptual search task. In general,
participants predicted lower task demand for designs with more intervening
white space. For the visual search task, these estimates of demand were
consistent with participants' actual performance reaction times. However, for
the stove design and Fitts' tasks participants rated tasks that were likely to
result in more errors as less challenging suggesting that the type of task is
an important factor in participants' abilities to predict relative task
difficulty.
[10]
The Design of Product Comparison Tables and its Effects on Decision Making
Posters: POS2 -- Posters 2
/
Lee, Michael
/
Carswell, C. Melody
/
Seidelman, Will
/
Sublette, Michelle
Proceedings of the Human Factors and Ergonomics Society 2012 Annual Meeting
2012-10-22
p.1654-1658
doi 10.1177/1071181312561331
© Copyright 2012 HFES
Summary: Consumers are constantly presented with new information about new products.
The presentation of this information can affect decision making processes by
varying the form, organization, and sequence of the information (Kleinmuntz
& Schkade, 1993). One organization strategy frequently used in marketing is
a product comparison table which allows for side-by-side comparisons to be
made. Two decision making heuristics which can occur when using such tables are
the 'as-if (AI) heuristic,' where all features are treated 'as if' they are
equal in importance or value, and the other is the 'elimination-by-aspect (EBA)
heuristic,' where a preferred feature must be present for an alternative to be
considered further. One design manipulation that could affect such heuristics
when using a table is shading. When applying the Proximity Compatibility
Principle (PCP) and theories of visual search, it is easy to see how shading
can influence or shape the perceptual acquisition of information and, in turn,
affect decision making strategies. This research looked at shading orientation
and its effects on decision making during a guided choice task. The study of
spontaneous choice is ongoing.
[11]
Interval Production as a Secondary Task Workload Measure: Consideration of
Primary Task Demands for Interval Selection
Posters: POS2 -- Posters 2
/
Seidelman, Will
/
Carswell, C. Melody
/
Grant, Russell C.
/
Sublette, Michelle
/
Lio, Cindy H.
/
Seales, Brent
Proceedings of the Human Factors and Ergonomics Society 2012 Annual Meeting
2012-10-22
p.1664-1668
doi 10.1177/1071181312561333
© Copyright 2012 HFES
Summary: Twenty-eight participants performed a surgical training primary task along
with a concurrent time estimation (interval production) secondary task.
Fourteen participants were given a primary task that varied in motor demand;
the other fourteen performed a primary task that varied in cognitive demand.
Time estimation is an attractive option as a workload measure due to its low
cost and ease of implementation. Currently it is unclear whether the structure
of task demands influences the sensitivity of time estimation tasks that use
different intervals. The sensitivity of both a short (3 second) and long (21
second) interval were observed in tasks that differed in level of workload.
Results indicated that short intervals were more sensitive to changes in motor
workload while long intervals displayed more sensitivity to changes in
cognitive demand.
[12]
A First Look at Identifying Strategies People Use in Making Predictions
about Task Demand
Posters: POS4 -- Posters 4
/
Sublette, M. A.
/
Carswell, C. M.
/
W. Seidelman?, A
Proceedings of the Human Factors and Ergonomics Society 2012 Annual Meeting
2012-10-22
p.1867-1871
doi 10.1177/1071181312561376
© Copyright 2012 HFES
Summary: As shopping from online retailers continues to increase, designers need to
be aware of the strategies consumers are using to predict the ease-of-use of
products based on appearance. The following study investigates the influence of
task type (stimulus-response compatibility task, target-acquisition task,
perceptual-search task) on these strategies. The results suggest that for
abstract tasks (motor and search), participants are relying on elements in or
interactions with the actual stimulus such as the predicted time to complete
the task and the number of items in the stimulus. However for tasks that are
more concrete (using a stove), participants rely on their past experiences and
familiarity with the task to predict task difficulty.
[13]
A "White-Space" Effect in Users' Anticipation of the Challenges Involved in
Using Everyday Products
Posters: POS1 - Posters 1
/
Sublette, M.
/
Carswell, C. M.
/
Seidelman, W.
/
Seales, W. B.
/
Clarke, D.
Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting
2011-09-19
p.1313-1317
doi: 10.1177/1071181311551273
© Copyright 2011 HFES
Summary: Although the use of prospective workload judgments (i.e., judgments obtained
from users prior to any actual interaction with a product) may be appealing for
a variety of logistical reasons, a growing literature highlights the biases and
metacognitive misconceptions that sometimes lead such judgments to be far from
what is found in post-performance evaluations. The current study uses the NASA
Task Load Index (NASA-TLX) in a prospective workload judgment task that employs
two familiar stimulus sets from the human factors literature as to-be-rated
designs: 1) control-burner arrangements on cooktops, and 2) control layouts for
pointing tasks that vary in terms of Fitts' Law parameters. Participants made
reliable errors (compared to known performance outcomes) when judging both
stimulus sets. In general, lower workload judgments were associated with
designs that had greater intervening white space between controls and
displays/targets.
[14]
Do Operators Take Advantage of A Secondary, Global-Perspective Display when
Performing a Simulated Laparoscopic Search Task?
Posters: POS4 - Posters 4
/
Sublette, M.
/
Carswell, C. M.
/
Seidelman, W.
/
Grant, R.
/
Han, Q.
/
Field, M.
/
Lio, C. H.
/
Lee, G.
/
Seales, W. B.
/
Clarke, D.
Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting
2011-09-19
p.1626-1630
doi: 10.1177/1071181311551339
© Copyright 2011 HFES
Summary: Multi-display surgical environments have the potential to increase
performance and efficiency while decreasing errors and workload. However as
more and more information is required for complex task execution and decision
making, we must continually assess how the information is presented and whether
we are helping or hindering surgeons by providing more content. Most
laparoscopic surgeries are performed utilizing a single, two-dimensional (2-D)
display. In the current experiment, we compared display usage, subjective
workload, and workload measured via eye-tracking data to determine the
effectiveness of an additional three-dimensional (3-D) display for a simulated
surgical search task. We found that while participants did use the additional
display in less demanding conditions (e.g., with fewer search targets), they
did not use the supplemental display in conditions with greater demands, and
they did not receive a substantial benefit from the presence of the
supplemental display in either condition. Both increased saccades per target
and increased perceived workload via the NASA-TLX provided support that more
workload was experienced in conditions with more targets. And while
participants did perceive decreased workload for more targets when the 3-D
display was available, eye-tracking metrics were not consistent with
participants' subjective workload estimates. Since subjective workload ratings
may be influenced by expectancies for benefits for the additional display,
future research should attempt to understand this workload dissociation as well
as breakdowns in the usage of supplemental displays as a function of task
difficulty.
[15]
Potential Performance Costs Associated with Large-Format Tiled Displays For
Surgical Visualization
POSTERS: POS1 -- Posters 1
/
Seidelman, Will
/
Carswell, C. Melody
/
Lio, Cindy H.
/
Grant, Russell C.
/
Sublette, Michelle
/
Field, Matt
/
Seales, Brent
/
Clarke, Duncan
Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting
2010-09-27
v.54
p.1430-1434
© Copyright 2010 HFES
Summary: Twenty-five participants performed a surgical training task on a large
format display created from one projector or by tiling the images from a 4-, or
9-projector array. Utilizing a large-format display consisting of tiled
projector images brings the potential benefits of increased display size with
the potential threats to performance of inherent visual artifacts. The effect
of these artifacts on performance and subjective workload was assessed. Results
indicate that while display size did not affect performance on the surgical
task, differences in mental workload were observed. Although a global measure
of workload indicated that the tiled displays were the least demanding to use,
participants reported deploying additional but highly specific cognitive
resources when using these same displays. Their resource shifts seemed to
involve adjustments to the perceived control gains created by enhanced size and
also degraded ability to compare target sizes in the larger display, possibly
due to the obscuring effect of tile edges.
[16]
THE OPERATING ROOM AS CLASSROOM: UNDERSTANDING COGNITIVE CHALLENGES FACING
SURGICAL TRAINEES
POSTERS: POS3 -- Posters 3
/
Lio, Cindy H.
/
Carswell, C. Melody
/
Strup, Stephen E.
/
Roth, John S.
/
Grant, Russell
Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting
2010-09-27
v.54
p.1571-1575
© Copyright 2010 HFES
Summary: Naturalistic observations of two fifth-year surgical trainees in the OR
revealed that they struggled with specific tasks during several seemingly
straightforward laparoscopic surgical procedures. Retrospective think-aloud
reports of the trainees and their attending surgeons on those tasks in video
clips and NASATLX ratings further shed lights on trainees' specific challenges.
Results showed that trainees' inadequate cognitive skills rather than poor
technical skills could be their greatest hindrance in performing those tasks.
Specifically, the trainees seemed to focus their attention on immediate urgent
tasks and failed to plan strategically for action sequences or manipulations.
NASA-TLX results further showed that trainees and attending surgeons differed
in their perceptions of effort, performance, and frustration in performing
those isolated tasks. These preliminary data suggested that a gap exists
between trainees and the more experienced surgeons on their attention
allocation strategies, which may indicate the need to emphasize cognitive
skills training such as multitasking during the practice of surgical skills
outside the OR.
[17]
Dual-View Displays for Minimally Invasive Surgery: Does the Addition of a
3-D Global View Decrease Mental Workload
POSTERS: POS3 -- Posters 3
/
Sublette, M.
/
Carswell, C. M.
/
Han, Q.
/
Grant, R.
/
Lio, C. H.
/
Lee, G.
/
Field, M.
/
Staley, D.
/
Seales, W. B.
/
Clarke, D.
Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting
2010-09-27
v.54
p.1581-1585
© Copyright 2010 HFES
Summary: Technological innovations are at the forefront of advances in minimally
invasive surgery. Reduced visual and haptic cues, along with frame-of-reference
problems with location and scale can cause surgeons to become disoriented.
While most laparoscopic surgeries are performed via the use of a limited,
single-scope, two-dimensional (2-D) view presented on a monitor in the
operating room, there is demand for the availability of three-dimensional
(3-D), global views. We compared workload, task-completion time, and the
ability to recreate spatial mental representations between study participants
who used the current scopeview display and those who used a dual-view display
that included both the scope view and a computationally generated global view.
We found no statistically reliable improvements for the dual-view display over
the single-view display for any of our criterion measures, although trends were
toward a dual-view advantage for workload in all tasks and accuracy in the
reconstruction task, despite participants' claims that they did not utilize the
global view during the experiment. Future research is needed to better
understand the information available on global views that can enhance
performance during surgical tasks and participants' decisions regarding when to
use different views to support their performance.
[18]
Anticipating Workload: Which Facets of Task Difficulty are Easiest to
Predict
POSTERS: POS4 -- Posters 4
/
Sublette, M.
/
Carswell, C. M.
/
Grant, R.
/
Seidelman, W.
/
Clark, D.
/
Seales, B.
Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting
2010-09-27
v.54
p.1704-1708
© Copyright 2010 HFES
Summary: Prospective workload measures are used to assess individuals' expectations
about tasks they are facing, how difficult they think the tasks will be and how
well they expect to perform. In this study, 43 participants used the NASA-TLX
subjective workload scale to predict the difficulty of surgical training tasks.
The goal of the study was to determine the accuracy of their predictions and
whether the act of assessing tasks before performing them affected their
judgments post-performance. Regarding initial performance, results showed that
participants formed prospective judgments that were consistent with their
retrospective judgments, but they underestimated physical demands. After only
minimal practice, however, their retrospective judgments deviated from both the
experimental group's initial predictions and the control group's initial
retrospective assessments. Anticipating mental demand was particularly
challenging. No significant differences were found between the control and
experimental conditions for post-performance assessments, suggesting that
pre-performance assessment of workload has no effect of post-performance
judgment of task difficulty.
[19]
Using Formal Qualitative Methods to Guide Early Development of an Augmented
Reality Display System for Surgery
POSTERS
/
Lio, C. H.
/
Carswell, C. M.
/
Han, Q.
/
Park, A.
/
Strup, S.
/
Seales, W. B.
/
Clarke, D.
/
Lee, G.
/
Hoskins, J.
Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting
2009-10-19
v.53
p.1181-1185
© Copyright 2009 Human Factors and Ergonomics Society
Summary: Nine laparoscopic surgical experts (2 residents, 4 fellows, and 3 surgeons)
underwent semi-structured interview questions to evaluate the concept of a
"dual-view" display for laparoscopic surgery. The 30-40 minute audio-recorded
interviews were transcribed, submitted to an open source qualitative program
for classification and categorizing, and were condensed for the iterative
processes of analysis and interpretation. Findings revealed that despite the
relatively brief interview sessions and limited number of surgical experts
available, the experts provided sufficient insights and suggestions to guide
further development of prototypes. This means that the use of semi-structured
interviews as an expert knowledge elicitation technique may be suitable for
assessing the development of augmented reality display systems for surgical and
training applications, and it may have promise for the development of augmented
and virtual environments more genially.
[20]
A Mental Workload Study on the 2d and 3d Viewing Conditions of the da Vinci
Surgical Robot
POSTERS
/
Klein, Martina I.
/
Lio, Cindy H.
/
Grant, Russel
/
Carswell, C. Meldoy
/
Strup, Stephen
Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting
2009-10-19
v.53
p.1186-1190
© Copyright 2009 Human Factors and Ergonomics Society
Summary: Fifteen medical students performed a standard training task using the da
Vinci Surgical robot's 2d and 3d viewing conditions. Measures of mental
workload associated with both viewing conditions were assessed using a
secondary interval production task as well as the NASA Task Load Index
(NASA-TLX) and the Multiple Resources Questionnaire (MRQ). The Results of the
NASA-TLX indicated that the 3d viewing condition results in lower scores of
mental workload when compared to the 2d condition. The MRQ data provided
diagnostic information regarding which information processing pools were
stressed in both the 2d and 3d viewing conditions.
[21]
Verbal Time Production as a Secondary Task: Which Metrics and Target
Intervals are Most Sensitive to Workload for Fine Motor Laparoscopic Training
Tasks?
POSTERS
/
Grant, Russell C.
/
Carswell, C. Melody
/
Lio, Cindy H.
/
Seales, Brent
/
Clarke, Duncan
Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting
2009-10-19
v.53
p.1191-1195
© Copyright 2009 Human Factors and Ergonomics Society
Summary: Although time production is frequently used as a secondary task, research
has not thoroughly investigated whether the length of the to-be-produced
interval or the metric used to summarize productions affects sensitivity to
mental workload. Fourteen participants produced four target intervals (6, 11,
16, or 21 s) while performing a surgical training task that required putting
small beads into a cup (easy) or onto a peg (difficult). Intervals were
summarized into two metrics of central tendency and four metrics of dispersion
previously used in the literature. Results indicate that metrics of central
tendency and shorter target intervals are more sensitive to mental workload.
[22]
Anticipated vs. Experienced Workload: How Accurately Can People Predict Task
Demand?
POSTERS
/
Sublette, M.
/
Carswell, C. M.
/
Grant, R.
/
Klein, M.
/
Seales, W. B.
/
Clarke, D.
Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting
2009-10-19
v.53
p.1383-1387
© Copyright 2009 Human Factors and Ergonomics Society
Summary: The NASA-TLX subjective workload assessment is typically used immediately
following a participant's performance in an experimental task to assess the
workload experienced. However, it is sometimes necessary to assess the
anticipated workload of a task before the task is actually performed. This
study compares the workload assessments of participants who performed two
minimally invasive surgical training tasks to participants who only saw
descriptions of the two tasks. Results showed that participants who were asked
to rate the anticipated workload underestimated the overall workload required
for the "cannulation" task, while overestimating the overall workload required
for the rope task. Interactions between task type and condition also were found
in three of the NASA-TLX subscales (mental demand, effort, and frustration).
Overall, the reliability of participants' prediction of the difficulty depended
on the task being evaluated and the particular measure of difficulty that was
being assessed. In general, physical facets of workload appeared to be more
accurately assessed than cognitive facets.
[23]
Equivalent-Forms Reliability of Printed and Spoken Versions of the NASA-TLX
POSTERS: Workload / Stressors
/
Grant, R.
/
Carswell, C. M.
/
Lio, C.
/
Seales, W. B.
/
Clarke, D.
Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting
2008-09-22
v.52
p.1532-1535
© Copyright 2008 HFES
Summary: Sixty-four participants provided subjective workload assessments after each
of 15 trials of selected laparoscopic training tasks, including cannulation,
ring transfer, and rope inspection. Half of the participants responded to the
NASA-TLX using the traditional printed format with manual (written) responses.
The remainder listened to auditory scale cues and made vocal responses. A
comparison of the two formats revealed strong (r > .80) correlations and
equivalent sensitivity to task and training effects, indicating that the vocal
format may be a suitable substitute for traditional administration methods in
the evaluation of surgical technology.
[24]
Geospatial Perspective-Taking: How Well Do Decision Makers Choose Their
Views?
POSTERS: Poster Session 3
/
Bailey, Kyle
/
Carswell, C. Melody
/
Grant, Rusty
/
Basham, Luke
Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting
2007-10-01
v.51
p.1246-1248
© Copyright 2007 HFES
Summary: Today decision makers may benefit from richer sources of data and a wider
variety of visualization tools than ever. However, the extent to which
individuals make adequate use of a "toolkit" of visualization modes -- choosing
the right formats to support different task demands -- has received relatively
little attention. In the present study, a sample of 43 participants learned to
perform three decision-making tasks with a five geospatial formats or "views."
When allowed to choose their own views prior to beginning different tasks, few
participants spontaneously selected those displays that would provide the
greatest performance support. Most participants fell prey to "naïve
realism" (a preference for realistic-looking displays) or "viewpoint inertia"
(a preference for familiar map-like displays). These data suggest that greater
attention needs to be given to the training of basic visualization skills as
well as possibly limiting display choices in some contexts.
[25]
Using Global Implicit Measurement Strategies to Assess Situation Awareness
during the Training of Laparoscopic Surgical Skills
POSTERS: Poster Session 3
/
Lio, C. H.
/
Carswell, C. M.
/
Seales, W. B.
/
Clarke, D.
/
Kurs, Y.
/
Decuir, J.
Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting
2007-10-01
v.51
p.1280-1282
© Copyright 2007 HFES
Summary: How well does a global implicit measure assess situation awareness in an
elementary laparoscopic training scenario? Nine volunteers threaded as many
orange, purple, and blue foam rings as possible onto a pegboard during 2-minute
trials. They used a pair of 5mm laparoscopic surgical graspers in an endoscopy
training simulator to perform the task. Ring sizes were identical for all
colors in the first three trials but were of different inner diameters for the
remaining six trials. This switch was never mentioned to participants. Workload
measures were collected for each trial and included a subjective measure
(NASA-TLX) and a secondary-task method (interval productions). Results
indicated that interval productions, but not the NASA-TLX, showed evidence of a
workload spike at the time that situation awareness was first manifested in
performance. These preliminary data suggest that a global implicit measure can
be used for evaluating SA in a relatively simple environment.