Flashcards
UI Testing
Cards in this deck (15)
- 1Internal Validitythe validity of findings within the research study
---
particularly concerned with the control of extraneous influences that might effect the outcome
---
(Lab)
Concern for outer influcence outside the Lab - 2External Validitythe degree to which the findings can be inferred to the population of interest or to other populations or settings
----
(Field)
Population as in people outside of the study (Strangers) - 3Why is validity important?They are frequently at odds with one another in planning and designing a study
---
Internal validity is considered the basic minimum for experimental research - 4Threats to Internal Validity-History
-Maturation
-Testing
-Instrumentation
-Statistical regression
-Selection bias
-Experimental mortality
-Interaction among factors - 5Threats to External Validity-Interaction effects of testing
-Selection bias
-Reactive effects of experimental setting
-Multiple-treatment interference - 6What is a Usability Experiment?In a controlled environment:
•There is a test set of users
•They perform pre-specified tasks
•Data is collected (quantitative and qualitative)
•Take mean and/or median value of measured attributes
•Compare to goal or another system
Overall Experiment follows scientific method - 7Measuring User Performance*Learnability*
- Task completion time for a new user
*Efficiency*
- Task completion time for a expert
*Memorability* (difficult to do)
- Task completion time for a casual user
*Satisfaction* (on a scale)
*Amount of Errors*
- Minor vs Serious - 8Reliability vs Validity*Reliability*
-Repeatability
- Difficult because of individual performance variability
*Validity*
-Will the results transfer into a real-life situation?
It depends on matching the users, task, environment - 9Qualitative methods for collecting usability problems*Thinking aloud method
- user asked to describe what he is doing and why, what he thinks is happening etc.
*Questionnaires
*Focus groups
*Interviews - 104 Phases of Usability Experiment1. The planning phase
2. The execution phase
3. Data collection techniques
4. Data analysis - 111. Planning PhaseGoal: Written plan or proposal
Who, what, where, when and how much?•Who are test users, and how will they be recruited?
•Who are the experimenters?
•When, where, and how long will the test take?
•What equipment/software is needed?•How much will the experiment cost? - 122. The execution phasePrepare environment, materials, software.
Intro should include:
-purpose (evaluating software)
-voluntary and confidential
-explain all procedures
--recording
--question-handling
-invite questions - 133. Data collection techniques- Pad and paper the only absolutely necessary data collection tool!
- Observation areas should be shown to users
Others:
-Video (may be overrated also users must sign a release)
-Video display capture
-Portable usability labs
-Usability kiosks - 144. Data Analysis*Before you start to do any statistics:
-look at data
-save original data
*Choice of statistical technique depends on
-type of data
-information required
*Type of data
--discrete (finite number of values)
--continuous (any value) - 15Field Testing (High External Validity)*Advantages:
-natural environment
-context retained (though observation may alter it)
-longitudinal studies possible
*Disadvantages:
-distractions
-noise
Information
- Description
- Final Human Computer Interaction Flashcards on UI Testing, created by Karan Kumar on 02/12/2019.
- Created by
- Karan Kumar
- Views
- 2
- Rating