if test -e question.html; then echo Overwriting question.html; else echo Extracting question.html; fi
cat > question.html << 'End of question.html'
User Interface Usability Evaluation with Web-Based Questionnaires
User Interface Usability Evaluation with Web-Based Questionnaires
Last updated:
Gary Perlman
(hcibib.org/perlman/
|
perlman@acm.org )
Abstract
question.cgi is a customizable Web-based
perl CGI script to administer and
collect data according to a few "standard" user interface
evaluation questionnaire forms (QUIS, PUEU, CSUQ, and PUTQ).
The script can be customized and run from a remote server,
hcibib.org/perlman/question.cgi ,
from which data are emailed in a simple format.
The script accepts options as part of its form data:
general customizations such as system name, administrator email, ...
customizations to the rating scale such as number of points, labels, ...
number of open-ended positive/negative comments requested
The script uses these options to present the questionnaire on the Web,
gather ratings, general comments, and question-specific comments,
and email the results to the designated survey administrator.
This document is a user manual that allows
the online reader to design and create their own questionnaire.
It is available at:
hcibib.org/perlman/question.html .
The script is freely available, AS-IS, in a shell archive at:
hcibib.org/perlman/question.sh .
Keywords
Subjective ratings,
Usability evaluation,
User satisfaction,
User acceptance,
User interface questionnaire,
Online survey administration,
Remote evaluation,
Measurement,
World-Wide Web, CGI, form,
Human-computer interaction,
Human factors
Introduction
Questionnaires have long been used to evaluate user interfaces
(Root & Draper, 1983 ).
Questionnaires have also long been used in electronic form
(Perlman, 1985 ).
For a handful of questionnaires specifically designed to
assess aspects of usability,
the validity and/or reliability have been established,
including some in the following table,
some of which are discussed in Chapter 6 of
Tullis & Albert, 2008 .
There are other questionnaires, including instruments from the
HFRG
(Human Factors Research Group):
Also, see LaLomia & Sidowski, 1990, 1991, 1993
for reviews of measurements of satisfaction, literacy, aptitude,
attitude, and anxiety.
NetRaker
(netraker.com )
once provided online usability evaluation,
with a free trial version.
Now there are many
online survey
services, most offering free simple surveys or trial periods:
Note:
Although these instruments are online,
many are copyrighted and some require a fee for non-educational use.
See the references at the end of each form for more information.
These questionnaires are similar in format,
so a Web-based system to present them has been developed
(as seen in the Example links above).
The system, question.cgi ,
is a perl-based (version 4 or 5) CGI script that presents a form
for a questionnaire and
emails data to a specifiable address.
Many options for the format of the questionnaire are read
from the incoming form data,
so a surveyor can adapt an existing questionnaire
(although in ways that may change the validity or reliability
of the standard forms of the questionnaires).
The rest of this document describes how to use
the standard forms of the surveys and how to adapt them.
Standard Forms of Questionnaires
Three options to
question.cgi
specify all you need to evaluate
a system using a Web form.
By default, the CSUQ is used, but you can supply a
form=
option:
form=QUIS
form=CSUQ
form=PUEU
form=PUTQ
You can specify a system name (e.g., My Web Site, WordProcessorII)
that will be used in the form and reported in the data.
system=HCI_Bibliography_Search
system=VR_Applet
You can specify an email address to which the
data will be sent when the rater submits their data.
email=perlman@acm.org
Combining Options
Options can be appended to a URL or supplied as form data
(either hidden or visible).
To append options to the
question.cgi
URL,
the list of options begins with a ?,
and an & is placed between options.
Also, many characters must the hex-quoted
(e.g., space is shown as %20).
So, to evaluate a system called
My HomePage Maker
with QUIS, and send the results to
marketing@myhomepage.com ,
you would append
?system=My%20HomePage%20Maker&form=QUIS&email=marketing@myhomepage.com .
Evaluate My HomePage Maker
To pass the options in via a form,
you could create a form with
question.cgi
as the action
and with input elements
for system, form, and email,
which can be hidden.
Options Reference and Design Form
The following options can be supplied as form data or on the URL.
The default values of the options depend on which form is in use.
The default or modified values are kept in the HTML as hidden values;
they can be viewed by looking at the HTML page source.
Data Format and Analysis
Data is sent to the email address in a name=value format,
with one name and value per line.
Missing comments on specific questions
and missing negative/positive points are omitted.
You are on your own for the analysis.
Obviously, you must coordinate with the questionnaire form.
Here is an example mail message with questionnaire data.
From httpd@turing.acm.org Mon Oct 5 12:47:00 1998
Date: Mon, 5 Oct 1998 12:46:59 -0400
Subject: question.cgi: Questionnaire System Evaluation
Sender: perlman@acm.org
From: perlman@acm.org (question.cgi)
Apparently-To: perlman@acm.org
system=question.cgi
date=98-10-05 12:46:58
comment=I like the generalization of this system.<br>Thanks.
q1=1
q2=0
q3=2
q4=1
q5=1
q6=0
q7=-1
c7=I found the concept novel & difficult to grok.
q8=0
q9=NA
q10=0
q11=-1
q12=-1
q13=0
q14=0
q15=1
q16=1
q17=1
q18=2
c18=It has more than expected, and yet, not enough. Sigh.
q19=2
negative1=no analysis tools
negative2=hard to completely customize
negative3=questionnaire terminology does not closely match my domain
positive1=nice looking forms
positive2=lots of options
positive3=based on established questionnaires
positive4=lets me automate data collection
End of question.html
chmod +x question.html
if test -e question.cgi; then echo Overwriting question.cgi; else echo Extracting question.cgi; fi
cat > question.cgi << 'End of question.cgi'
#!/usr/bin/perl
# Copyright 1998 Gary Perlman. All rights reserved.
# output form= info with questionnaire data
# allow dump of questions with data
@languages = ("en", "fr", "xx");
%F = &formdata (); # load the form data
&setup (); # set global variables
# handle the submit options
if ($F{'submit'} eq $Lang{'Submit'}) {
&mailit ($F{'system'}, $F{'email'});
} elsif ($F{'submit'} eq $Lang{'Addall'}) {
for $i (1 .. $qn) {
&addcomment ($i);
$Addbutton = "";
}
} else {
# check for user clicking on comment note image
for $i (1 .. $qn) {
$coord = "c$i.x"; # x coord of click
$name="c$i";
if ($F{$coord}) {
&addcomment ($i);
$message = "$Lang{'AddedComment'} $i ";
# maybe use something like the following to clean up comments
#} elsif ($F{$name}) {
# $F{$name} =~ s/$Lang{'NewNote'}:? *//;
}
}
}
print "Content-type: text/html\r\n\r\n"; # start the output
################################## Print the HTML Page
print "$F{'title'}
$F{'title'}
\n";
print "$Lang{'BasedOn'}: \n$F{'ref'}$Lang{'About'} $script_name
\n";
&printhelp;
print "
";
print "\n\n";
################################## UTILITY FUNCTIONS
sub mydate {
local ($xtime) = @_;
($sec,$min,$hour,$mday,$mon,$year,$wday,$yday,$isdst) = localtime ($xtime);
sprintf ("%d-%02d-%02d %02d:%02d:%02d", $year+1900, $mon+1, $mday, $hour, $min, $sec);
}
sub formdata { # nil -> %F
local (*F);
if ($ENV{'REQUEST_METHOD'} eq 'POST') {
read (STDIN, $F, $ENV{'CONTENT_LENGTH'});
} else {
$F = $ENV{'QUERY_STRING'};
}
@F = split (/&/, $F);
for (@F) {
local ($name, $value) = split (/=/, $_, 2);
$value =~ s/\+/ /g;
$value =~ s/%([\dA-Fa-f][\dA-Fa-f])/pack ("C", hex ($1))/eg;
$F{$name} = $value;
}
return (%F);
}
sub ratingscale # [section name]
{
local ($section) = (@_);
local ($empty) = " ";
print "";
if ($section) {
$section =~ tr/a-z/A-Z/;
print " $section $j \n";
}
print $empty;
print "$F{'NA'} \n";
print " ";
}
sub showitem # item number
{
local ($i) = @_;
local ($labfont) = "";
local ($name) = "q$i";
local ($cname) = "c$i"; # comment name
local ($value) = $F{$name};
local ($lowlab) = $lowlab[$i] ? $lowlab[$i] : $F{'lowlab'};
local ($highlab) = $highlab[$i] ? $highlab[$i] : $F{'highlab'};
local ($checked);
if ($section[$i]) {
&ratingscale ($section[$i]);
}
print "";
print "$i. ";
print "$q[$i] " if $q[$i];
if ($F{$cname}) { # there is a comment for this item in the form data
print " \n";
# LOW LABEL
print "$labfont$lowlab \n";
# RATING VALUES
local ($valtitle);
for $j ($F{'lowval'} .. $F{'highval'}) {
$checked = ($value eq $j) ? "checked" : "";
if ($j == $F{'lowval'}) {
$valtitle="$j ($lowlab)";
} elsif ($j == $F{'highval'}) {
$valtitle="$j ($highlab)";
} else {
$valtitle=$j
}
print "$labfont$highlab \n";
$checked = ($value eq $F{'NAval'}) ? "checked" : "";
# NA Value
print " ";
}
sub openended # number, label
{
local ($number, $label) = (@_);
local ($i, $name);
if ($number > 0) {
if ($label eq "negative") {
print "$Lang{'ListNegative'}:\n";
} else {
print "
$Lang{'ListPositive'}:\n";
}
print "
\n";
for $i (1 .. $number) {
$name = "$label$i";
print " \n";
}
}
sub hidden # void -> prints hidden form data
{
local ($name, $value);
for $name (sort (keys (%D))) {
$value = $F{$name};
$value =~ s/&/\&/g;
$value =~ s//\>/g;
print "$Lang{'RETURN'} /sg;
$string =~ s/(\n)|(\r\n)/
\n";
print " $Lang{'RespondAll'}\n";
print " $Lang{'UseNA'} $NA \n";
print " $Lang{'FillRequired'}:
$Object:
$Lang{'Email'}:
\n";
# print " $Lang{'UseComment'} \n";
print " $Lang{'AddComment'}" if $F{'commlines'};
print " $Lang{'HowSubmit'} $Lang{'Submit'} \n";
print " \n";
}
End of question.cgi
chmod +x question.cgi
if test -e quis.pl; then echo Overwriting quis.pl; else echo Extracting quis.pl; fi
cat > quis.pl << 'End of quis.pl'
$D{'title'} = "Questionnaire for User Interface Satisfaction";
$D{'sender'} = "QUIS 5.0";
$D{'lowval'} = 0;
$D{'highval'} = 9;
$D{'lowlab'} = $Lang{'Bad'};
$D{'highlab'} = $Lang{'Good'};
$D{'NAval'} = "-1";
$D{'ref'} = "Chin, J.P., Diehl, V.A., Norman, K.L. (1988)
Development of an Instrument Measuring User Satisfaction
of the Human-Computer Interface.
ACM CHI'88 Proceedings ,
213-218.
©1988 ACM.
[Abstract]
Copying without fee is permitted provided that the copies are not made or distributed
for direct commercial advantage, and credit to the source is given.
©1986-1998 University of Maryland.
This display is for educational uses only.
Commercial use requires a license from the Office of Technology Commercialization :
(301) 403-2711
otc\@umail.umd.edu .
[QUIS Home Page]
";
$qn = 27;
$D{'help'} = "Please rate your satisfaction with $System.";
$section[1] = "Overall Reaction to the Software";
$q[1] = ""; $lowlab[1] = "terrible"; $highlab[1] = "wonderful";
$q[2] = ""; $lowlab[2] = "difficult"; $highlab[2] = "easy";
$q[3] = ""; $lowlab[3] = "frustrating"; $highlab[3] = "satisfying";
$q[4] = ""; $lowlab[4] = "inadequate power"; $highlab[4] = "adequate power";
$q[5] = ""; $lowlab[5] = "dull"; $highlab[5] = "stimulating";
$q[6] = ""; $lowlab[6] = "rigid"; $highlab[6] = "flexible";
$section[7] = "Screen";
$q[7] = "Reading characters on the screen";
$lowlab[7] = "hard"; $highlab[7] = "easy";
$q[8] = "Highlighting simplifies task";
$lowlab[8]= "not at all"; $highlab[8] = "very much";
$q[9] = "Organization of information";
$lowlab[9]= "confusing"; $highlab[9] = "very clear";
$q[10] = "Sequence of screens";
$lowlab[10]= "confusing"; $highlab[10] = "very clear";
$section[11] = "Terminology and $Object Information";
$q[11] = "Use of terms throughout $object";
$lowlab[11]= "inconsistent"; $highlab[11] = "consistent";
$q[12] = "Terminology related to task";
$lowlab[12]= "never"; $highlab[12] = "always";
$q[13] = "Position of messages on screen";
$lowlab[13]= "inconsistent"; $highlab[13] = "consistent";
$q[14] = "Prompts for input";
$lowlab[14]= "confusing"; $highlab[14] = "clear";
$q[15] = "Computer informs about its progress";
$lowlab[15]= "never"; $highlab[15] = "always";
$q[16] = "Error messages";
$lowlab[16]= "unhelpful"; $highlab[16] = "helpful";
$section[17] = "Learning";
$q[17] = "Learning to operate $the $object";
$lowlab[17]= "difficult"; $highlab[17] = "easy";
$q[18] = "Exploring new features by trial and error";
$lowlab[18]= "difficult"; $highlab[18] = "easy";
$q[19] = "Remembering names and use of commands";
$lowlab[19]= "difficult"; $highlab[19] = "easy";
$q[20] = "Performing tasks is straightforward";
$lowlab[20]= "never"; $highlab[20] = "always";
$q[21] = "Help messages on the screen";
$lowlab[21]= "unhelpful"; $highlab[21] = "helpful";
$q[22] = "Supplemental reference materials";
$lowlab[22]= "confusing"; $highlab[22] = "clear";
$section[23] = "$Object Capabilities";
$q[23] = "$Object speed";
$lowlab[23]= "too slow"; $highlab[23] = "fast enough";
$q[24] = "$Object reliability";
$lowlab[24]= "unreliable"; $highlab[24] = "reliable";
$q[25] = "$Object tends to be";
$lowlab[25]= "noisy"; $highlab[25] = "quiet";
$q[26] = "Correcting your mistakes";
$lowlab[26]= "difficult"; $highlab[26] = "easy";
$q[27] = "Designed for all levels of users";
$lowlab[27]= "never"; $highlab[27] = "always";
1;
End of quis.pl
chmod +x quis.pl
if test -e pueu.pl; then echo Overwriting pueu.pl; else echo Extracting pueu.pl; fi
cat > pueu.pl << 'End of pueu.pl'
$D{'title'} = "Perceived Usefulness and Ease of Use";
$D{'sender'} = "PUEU";
$D{'lowlab'} = $Lang{'Unlikely'};
$D{'highlab'} = $Lang{'Likely'};
$D{'ref'} = "Davis, F. D. (1989)
Perceived Usefulness, Perceived Ease of Use,
and User Acceptance of Information Technology.
MIS Quarterly ,
13:3, 319-340.
";
$qn = 12;
$D{'help'} = "Please rate the usefulness and ease of use of $System.";
$section[1] = "Perceived Usefulness";
$q[1] = "Using $System in my job would enable me to accomplish tasks more quickly";
$q[2] = "Using $System would improve my job performance";
$q[3] = "Using $System in my job would increase my productity";
$q[4] = "Using $System would enhance my effectiveness on the job";
$q[5] = "Using $System would make it easier to do my job";
$q[6] = "I would find $System useful in my job";
$section[7] = "Perceived Ease of Use";
$q[7] = "Learning to operate $System would be easy for me";
$q[8] = "I would find it easy to get $System to do what I want it to do";
$q[9] = "My interaction with $System would be clear and understandable";
$q[10] = "I would find $System to be flexible to interact with";
$q[11] = "It would be easy for me to become skillful at using $System";
$q[12] = "I would find $System easy to use";
$abstract = "
Valid measurement scales for predicting user
acceptance of computers are in short supply.
Most subjective measures used in practice are
unvalidated, and their relationship to system
usage is unknown. The present research develops
and validates new scales for two specific
variables, perceived usefulness and perceived
ease of use, which are hypothesized to
be fundamental determinants of user acceptance.
Definitions of these two variables were
used to develop scale items that were pretested
for content validity and then tested for reliability
and construct validity in two studies involving
a total of 152 users and four application programs.
The measures were refined and streamlined,
resulting in two six-item scales with reliabilities
of .98 for usefulness and .94 for ease
of use. The scales exhibited high convergent,
discriminant, and factorial validity. Perceived usefulness
was significantly correlated with both self-reported
current usage (r=.63, Study 1) and
self-predicted future usage (r=.85, Study 2). Perceived
ease of use was also significantly correlated
with current usage (r=.45, Study 1) and
future usage (r=.59, Study 2). In both studies,
usefulness had a significantly greater correlation
with usage behavior than did ease of use.
Regression analyses suggest that perceived
ease of use may actually be a causal antecedent
to perceived usefulness, as opposed to
a parallel direct determinant of system usage.
Implications are drawn for future research on
user acceptance.
";
1;
End of pueu.pl
chmod +x pueu.pl
if test -e csuq.pl; then echo Overwriting csuq.pl; else echo Extracting csuq.pl; fi
cat > csuq.pl << 'End of csuq.pl'
$D{'title'} = "Computer System Usability Questionnaire";
$D{'sender'} = "CSUQ";
$D{'ref'} = "Lewis, J. R. (1995)
IBM Computer Usability Satisfaction Questionnaires:
Psychometric Evaluation and Instructions for Use.
International Journal of Human-Computer Interaction ,
7:1, 57-78.
$Lang{'Abstract'}
";
$qn = 19;
if ($F{'language'} eq "fr") {
$D{'title'} = "Questionnaire sur l'usabilité d'un système informatisé";
$D{'help'} = "Veuillez évaluer la facilité d'utilisation.";
# QUESTIONS
$q[1] = "En général, je suis satisfait(e) de la facilité
d’utilisation de ce $object";
$q[2] = "Ce $object est simple à utiliser";
$q[3] = "J’ai complété mon travail correctement en utilisant
ce $object";
$q[4] = "J’ai été en mesure de compléter rapidement
ma tâche avec ce $object";
$q[5] = " J’ai complété mon travail efficacement en utilisant
ce $object";
$q[6] = "Je me sens à l’aise avec ce $object";
$q[7] = "J’ai eu de la facilité à apprendre comment utiliser
ce $object";
$q[8] = "Je crois être devenu(e) rapidement efficace en utilisant
ce $object";
$q[9] = "Les messages d’erreur présentés par ce $object
m’indiquent clairement comment résoudre les problèmes";
$q[10] = "Lorsque j’ai fais une erreur d’utilisation sur ce
$object, il m’a été facile et rapide de la corriger";
$q[11] = "Les outils d’aide disponibles sur ce $object (tels que
l’aide en ligne, les messages à l’écran et
autres informations) sont utiles";
$q[12] = "J’ai facilement trouvé l’information que je cherchais";
$q[13] = "L’information fournie avec ce $object est facile à
comprendre";
$q[14] = "L’information disponible sur ce $object contribue à me
soutenir dans la réalisation des tâches et des scénarios";
$q[15] = "L’organisation de l’information dans les écrans
du $object est claire";
$q[16] = "L’interface de ce $object est agréable";
$q[17] = "J’aime utiliser l’interface de ce $object";
$q[18] = "Ce $object possède toutes les fonctions et le
potentiel correspondant à mes attentes";
$q[19] = "En général, je suis satisfait(e) de ce $object";
} else {
$D{'help'} = "Please rate the usability of $System.";
$q[1] = "Overall, I am satisfied with how easy it is to use $this $object";
$q[2] = "It was simple to use $this $object";
$q[3] = "I can effectively complete my work using $this $object";
$q[4] = "I am able to complete my work quickly using $this $object";
$q[5] = "I am able to efficiently complete my work using $this $object";
$q[6] = "I feel comfortable using $this $object";
$q[7] = "It was easy to learn to use $this $object";
$q[8] = "I believe I became productive quickly using $this $object";
$q[9] = "$The $object gives error messages that clearly tell me how to fix problems";
$q[10] = "Whenever I make a mistake using $the $object, I recover easily and quickly";
$q[11] = "The information (such as online help, on-screen messages, and other documentation) provided with $this $object is clear";
$q[12] = "It is easy to find the information I needed";
$q[13] = "The information provided for $the $object is easy to understand";
$q[14] = "The information is effective in helping me complete the tasks and scenarios";
$q[15] = "The organization of information on $the $object screens is clear";
$q[16] = "The interface of $this $object is pleasant";
$q[17] = "I like using the interface of $this $object";
$q[18] = "$This $object has all the functions and capabilities I expect it to have";
$q[19] = "Overall, I am satisfied with $this $object";
}
1;
End of csuq.pl
chmod +x csuq.pl
if test -e asq.pl; then echo Overwriting asq.pl; else echo Extracting asq.pl; fi
cat > asq.pl << 'End of asq.pl'
$D{'title'} = "After-Scenario Questionnaire";
$D{'sender'} = "ASQ";
$D{'positive'} = 0;
$D{'negative'} = 0;
# force add of all comment fields
$F{'submit'} = $Addall unless $F{'submit'};
$D{'ref'} = "Lewis, J. R. (1995)
IBM Computer Usability Satisfaction Questionnaires:
Psychometric Evaluation and Instructions for Use.
International Journal of Human-Computer Interaction ,
7:1, 57-78.
Abstract
";
$qn = 3;
$D{'help'} = "Please rate the usability of $System for the previous scenario.";
$q[1] = "Overall, I am satisfied with the ease of completing the tasks in this scenario";
$q[2] = "Overall, I am satisfied with the amount of time it took to complete the tasks in this scenario";
$q[3] = "Overall, I am satisfied with the support information (online-line help, messages, documentation) when completing the tasks";
1;
End of asq.pl
chmod +x asq.pl
if test -e putq.pl; then echo Overwriting putq.pl; else echo Extracting putq.pl; fi
cat > putq.pl << 'End of putq.pl'
$D{'title'} = "Purdue Usability Testing Questionnaire";
$D{'sender'} = "PUTQ";
$D{'lowlab'} = $Lang{'Bad'};
$D{'highlab'} = $Lang{'Good'};
$D{'ref'} = " Lin, H.X. Choong, Y.-Y., and Salvendy, G. (1997)
A Proposed Index of Usability:
A Method for Comparing the Relative Usability of Different Software Systems .
Behaviour & Information Technology ,
16:4/5, 267-278.
Abstract
Reproduced by permission.
(The ratings of importance are not included in this online version,
but could be incorporated into the comments.)
";
$qn = 100;
$D{'help'} = "Please rate the usability of $System.";
$section[1] = "1. Compatibility";
$q[1]='Is the control of cursor compatible with movement?';
$q[2]='Are the results of control entry compatible with user expectations?';
$q[3]='Is the control matched to user skill?';
$q[4]='Are the coding compatible with familiar conventions?';
$q[5]='Is the wording familiar?';
$section[6] = "2. Consistency";
$q[6]='Is the assignment of colour codes conventional?';
$q[7]='Is the coding consistent across displays, menu options?';
$q[8]='Is the cursor placement consistent?';
$q[9]='Is the display format consistent?';
$q[10]='Is the feedback consistent?';
$q[11]='Is the format within data fields consistent?';
$q[12]='Is the label format consistent?';
$q[13]='Is the label location consistent?';
$q[14]='Is the labelling itself consistent?';
$q[15]='Is the display orientation consistent? -- panning vs. scrolling.';
$q[16]='Are the user actions required consistent?';
$q[17]='Is the wording consistent across displays?';
$q[18]='Is the data display consistent with entry requirements?';
$q[19]='Is the data display consistent with user conventions?';
$q[20]='Are symbols for graphic data standard?';
$q[21]='Is the option wording consistent with command language?';
$q[22]='Is the wording consistent with user guidance?';
$section[23] = "3. Flexibility";
$q[23]='Does it have by-passing menu selection with command entry?';
$q[24]='Does it have direct manipulation capability?';
$q[25]='Is the design for data entry flexible?';
$q[26]='Can the display be controlled by user flexibly?';
$q[27]='Does it provide flexible sequence control?';
$q[28]='Does it provide flexible user guidance?';
$q[29]='Are the menu options dependent on context?';
$q[30]='Can user name displays and elements according to their needs?';
$q[31]='Does it provide good training for different users?';
$q[32]='Are users allowed to customize windows?';
$q[33]='Can users assign command names?';
$q[34]='Does it provide user selection of data for display?';
$q[35]='Does it handle user-specified windows?';
$q[36]='Does it provide zooming for display expansion?';
$section[37] = "4. Learnability";
$q[37]='Does it provide clarity of wording?';
$q[38]='Is the data grouping reasonable for easy learning?';
$q[39]='Is the command language layered?';
$q[40]='Is the grouping of menu options logical?';
$q[41]='Is the ordering of menu options logical?';
$q[42]='Are the command names meaningful?';
$q[43]='Does it provide no-penalty learning?';
$section[44] = "5. Minimal Action";
$q[44]='Does it provide combined entry of related data?';
$q[45]='Will the required data be entered only once?';
$q[46]='Does it provide default values?';
$q[47]='Is the shifting among windows easy?';
$q[48]='Does it provide function keys for frequent control entries?';
$q[49]='Does it provide global search and replace capability?';
$q[50]='Is the menu selection by pointing? -- primary means of sequence control.';
$q[51]='Is the menu selection by keyed entry? -- secondary means of control entry.';
$q[52]='Does it require minimal cursor positioning?';
$q[53]='Does it require minimal steps in sequential menu selection?';
$q[54]='Does it require minimal user control actions?';
$q[55]='Is the return to higher-level menus required only one simple key action?';
$q[56]='Is the return to general menu required only one simple key action?';
$section[57] = "6. Minimal Memory Load";
$q[57]='How are abbreviations and acronyms used?';
$q[58]='Does it provide aids for entering hierarchic data?';
$q[59]='Is the guidance information always available?';
$q[60]='Does it provide hierarchic menus for sequential selection?';
$q[61]='Are selected data highlighted?';
$q[62]='Does it provide index of commands?';
$q[63]='Does it provide index of data?';
$q[64]='Does it indicate current position in menu structure?';
$q[65]='Are data items kept short?';
$q[66]='Are the letter codes for menu selection designed carefully?';
$q[67]='Are long data items partitioned?';
$q[68]='Are prior answers recapitulated?';
$q[69]='Are upper and lower case equivalent?';
$q[70]='Does it use short codes rather than long ones?';
$q[71]='Does it provide supplementary verbal labels for icons?';
$section[72] = "7. Perceptual Limitation";
$q[72]='Does it provide coding by data category?';
$q[73]='Is the abbreviation distinctive?';
$q[74]='Is the cursor distinctive?';
$q[75]='Are display elements distinctive?';
$q[76]='Is the format for user guidance distinctive?';
$q[77]='Do the commands have distinctive meanings?';
$q[78]='Is the spelling distinctive for commands?';
$q[79]='Does it provide easily distinguished colours?';
$q[80]='Is the active window indicated?';
$q[81]='Are items paired for direct comparison?';
$q[82]='Is the number of spoken messages limited?';
$q[83]='Does it provide lists for related items?';
$q[84]='Are menus distinct from other displayed information?';
$q[85]='Is the colour coding redundant?';
$q[86]='Does it provide visually distinctive data fields?';
$q[87]='Are groups of information demarcated?';
$section[89] = "8. User Guidance";
$q[88]='Is the screen density reasonable?';
$q[89]='System feedback: How helpful is the error message?';
$q[90]='Does it provide CANCEL option?';
$q[91]='Are erroneous entries displayed?';
$q[92]='Does it provide explicit entry of corrections?';
$q[93]='Does it provide feedback for control entries?';
$q[94]='Is HELP provided?';
$q[95]='Is completion of processing indicated?';
$q[96]='Are repeated errors indicated?';
$q[97]='Are error messages non-disruptive/informative?';
$q[98]='Does it provide RESTART option?';
$q[99]='Does it provide UNDO to reverse control actions?';
$q[100]='Is the sequence control user initiated?';
1;
End of putq.pl
chmod +x putq.pl
if test -e phue.pl; then echo Overwriting phue.pl; else echo Extracting phue.pl; fi
cat > phue.pl << 'End of phue.pl'
$D{'title'} = "Practical Heuristics for Usability Evaluation";
$D{'sender'} = "PHUE";
$D{'lowlab'} = $Lang{'Bad'};
$D{'highlab'} = $Lang{'Good'};
$D{'positive'} = 5;
$D{'negative'} = 5;
$D{'ref'} = "Perlman, G. (1997)
Practical Usability Evaluation .
Based in part on Nielsen's 1993 Heuristics and Norman's 1990 Principles.
";
$qn = 13;
$D{'help'} = "Please rate $System using the heuristics.";
$section[1] = "Learning";
$q[1] = "Help and Documentation";
$qq[1] = "Design for use without documentation.
Provide easy-to-use task-oriented help";
$q[2] = "Adopt the User's Viewpoint";
$qq[2] = "Speak the user's language (avoid jargon).
Make use of existing knowledge (familiar mental models).";
$q[3] = "Simple and Natural Dialogue";
$qq[3] = "Avoid extraneous information, steps, actions.
Information should be in a logical, natural order.";
$q[4] = "Design for Advancement";
$qq[4] = "Provide shortcuts (quick keys, customization).";
$section[5] = "Adapting to the User";
$q[5] = "Provide Maps and a Trail";
$qq[5] = "Give the user a way to preview where to go, what will happen.
Give the user a way to review / return-to previous contexts.";
$q[6] = "Show the User What is (Not) Possible";
$qq[6] = "Provide affordances to indicate what can be done.";
$q[7] = "Intuitive Mappings";
$qq[7] = "Design good response compatibility between controls/actions.";
$q[8] = "Minimize Memory Load";
$qq[8] = "Remove the need to remember across dialogues.
Provide multiple views for easy comparisons.";
$q[9] = "Consistency in the System and to Standards";
$qq[9] = "Make sure the same term/action has one meaning.
When there is no better way, conform to a standard.";
$section[10] = "Feedback and Errors";
$q[10] = "Feedback";
$qq[10] = "Provide timely feedback about all processes, system status.";
$q[11] = "Prevent Errors";
$qq[11] = "Make it difficult to make errors.";
$q[12] = "Error Messages";
$qq[12] = "Diagnose the source and cause of a problem and suggest a solution.";
$q[13] = "Clearly Marked Exits and Error Recovery";
$qq[13] = "Make sure the user can get out of an undesirable state easily.
Design assuming that people will make errors and need to recover previous states.";
for $q (1 .. $qn) {
$q[$q] .= "\n$qq[$q] \n";
# $q[$q] =~ s/\n\t/\nUsability Engineering Usability Engineering $Lang{'Addall'} ."; # help on adding comments
$Lang{'CommentHelp'} = "Add a comment";
$Lang{'RespondAll'} = "Try to respond to all the items."; # general help
$Lang{'UseNA'} = "For items that are not applicable, use:"; # help for NA
$Lang{'UseComment'} = "Optionally provide comments and your email address in the box.";
# help for comment boxes, if they are present
$Lang{'FillRequired'} = "Make sure these fields are filled in";
# will be followed by "System" and "Email to"
$Lang{'HowSubmit'} = "To mail in your results, click on:"; # help for sending data
# instructions to list positive/negative aspects
$Lang{'ListNegative'} = "List the most negative aspect(s)";
$Lang{'ListPositive'} = "List the most positive aspect(s)";
# OBJECT LABELS (will be followed by :)
$Lang{'Email'} = "Email to"; # label for email address field
$Lang{'BasedOn'} = "Based on"; # label for reference field
$Lang{'NewNote'} = "Comments"; # label inside comment field
# LINK LABELS
$Lang{'FormTop'} = "Top of Form"; # link to get to top of form
$Lang{'Abstract'} = "Abstract"; # link to fid abstract in HCIBIB
$Lang{'About'} = "About"; # label before link to "About question.cgi"
$Lang{'RETURN'} = "RETURN TO REFERRING PAGE";
# label for link to return to page that got user to this form
# MISC
$Lang{'System'} = "System"; # type of object being evaluated
$Lang{'The'} = "The"; # definite article for object
$Lang{'This'} = "This"; # specific article for object
$Lang{'NA'} = "NA"; # label for "Not Applicable" value
$Lang{'StronglyDisagree'} = "strongly disagree"; # label for low end of scale
$Lang{'StronglyAgree'} = "strongly agree"; # label for high end of scale
$Lang{'Unlikely'} = "unlikely"; # label for low end of scale
$Lang{'Likely'} = "likely"; # label for high end of scale
$Lang{'Bad'} = "bad"; # label for low end of scale
$Lang{'Good'} = "good"; # label for high end of scale
} elsif ($F{'language'} eq "fr") { # French
# BUTTON LABELS
$Lang{'Addall'} = "Commentaires"; # add comments to all questions
$Lang{'Submit'} = "Soumettre"; # submit data
# FEEDBACK
# data was submitted
$Lang{'Submitted'} = "Nous avons reçu vos réponses. Merci.";
# data was not submitted
$Lang{'NotSubmitted'} = "Vos réponses n'ont pas été transmises.";
# comment field added to an item
$Lang{'AddedComment'} = " Un champ pour écrire vos commentaires
a été ajouté à l'énoncé";
# email missing or bad format
$Lang{'NeedEmail'} = "Vous devez fournir une adresse électronique valide";
# HELP
# help on adding comments
$Lang{'Comment'} = "Commentaire";
$Lang{'AddComment'} = "Faites un commentaire spécifique
à un énoncé en cliquant sur cet
$Lang{'Addall'} .";
$Lang{'CommentHelp'} = "Faites un commentaire spécifique"; # GP accessibility
# general help
$Lang{'RespondAll'} = "Essayez de répondre à tous les énoncés.";
# help for NA
$Lang{'UseNA'} = "Pour les énoncés qui ne s'appliquent pas, répondez :";
$Lang{'UseComment'} = "Vous êtes invités à faire des commentaires
et à inscrire votre adresse électronique dans l'espace
réservé à cette fin.";
# help for comment boxes, if they are present
$Lang{'FillRequired'} = "Assurez-vous que les champs suivants sont remplis";
# will be followed by $Lang{'System'} and $Lang{'Email'}
# help for sending data
$Lang{'HowSubmit'} = "Pour soumettre vos réponses, cliquez sur :";
# instructions to list positive/negative aspects
$Lang{'ListNegative'} = "Inscrivez les principaux aspects
négatifs ";
$Lang{'ListPositive'} = "Inscrivez les principaux aspects
positifs ";
# OBJECT LABELS (will be followed by :)
# label for Email field
$Lang{'Email'} = "Envoyer à";
# label for questionnaire reference
$Lang{'BasedOn'} = "Inspiré de";
# default value for comment field
$Lang{'NewNote'} = "Commentaires";
# LINK LABELS
# Top of Form
$Lang{'FormTop'} = "Haut";
# Abstract (of article)
$Lang{'Abstract'} = "Résumé";
# label for "About question.cgi"
$Lang{'About'} = "Au sujet du questionnaire";
# return to referrer
$Lang{'RETURN'} = "Retour au site";
# MISC
$Lang{'System'} = "Système";
# the System
$Lang{'The'} = "Le";
# this System
$Lang{'This'} = "Ce";
$Lang{'StronglyDisagree'} = "Désaccord";
$Lang{'StronglyAgree'} = "Accord";
$Lang{'NA'} = "NA";
$Lang{'Unlikely'} = "Improbable";
$Lang{'Likely'} = "Probable";
$Lang{'Bad'} = "Mauvais";
$Lang{'Good'} = "Bien";
} else { # special language
$F1 = ""; $F0 = " Measuring Usability with the USE Questionnaire.
STC Usability SIG Newsletter, 8:2.
[Abstract]
";
$qn = 30;
$D{'help'} = "Please rate your agreement with these statements.";
$section[1] = "Usefulness";
$q[1] = "It helps me be more effective.";
$q[2] = "It helps me be more productive.";
$q[3] = "It is useful.";
$q[4] = "It gives me more control over the activities in my life.";
$q[5] = "It makes the things I want to accomplish easier to get done.";
$q[6] = "It saves me time when I use it.";
$q[7] = "It meets my needs."; # low weight
$q[8] = "It does everything I would expect it to do.";
$section[9] = "Ease of Use";
$q[9] = "It is easy to use.";
$q[10] = "It is simple to use.";
$q[11] = "It is user friendly.";
$q[12] = "It requires the fewest steps possible to accomplish what I want to do with it.";
$q[13] = "It is flexible."; # low weight
$q[14] = "Using it is effortless."; # low weight
$q[15] = "I can use it without written instructions."; # low weight
$q[16] = "I don't notice any inconsistencies as I use it."; # low weight
$q[17] = "Both occasional and regular users would like it."; # low weight
$q[18] = "I can recover from mistakes quickly and easily."; # low weight
$q[19] = "I can use it successfully every time."; # low weight
$section[20] = "Ease of Learning";
$q[20] = "I learned to use it quickly.";
$q[21] = "I easily remember how to use it.";
$q[22] = "It is easy to learn to use it.";
$q[23] = "I quickly became skillful with it."; # low weight
$section[24] = "Satisfaction";
$q[24] = "I am satisfied with it.";
$q[25] = "I would recommend it to a friend.";
$q[26] = "It is fun to use.";
$q[27] = "It works the way I want it to work.";
$q[28] = "It is wonderful.";
$q[29] = "I feel I need to have it.";
$q[30] = "It is pleasant to use.";
1;
End of use.pl
chmod +x use.pl