Karteikarten
UI Testing
Karten in diesem Stapel (19)
- 1Research Validity ( Internal Validity )[ Lab ]
the validity of findings with the research study
----
control everything & eliminate possible extraneous influences - 2Research Validity ( External Validity )[ Real World ]
the degree to which the findings can
be inferred to the population of interest or to other populations or settings
----
is considered the basic minimum for
experimental research
---
concerned with real-world applications - 3Threats to Internal ValidityHistory ( events during experiment)
----
Maturation ( biological or psychological changes )
----
Testing ( improper testing )
----
Instrumentation ( changes in testing instruments, raters, interviewers...)
----
Statistical Regression ( inconsistent results )
----
Selection Bias ( Not comparing by random )
----
Experimental Mortality ( loss of people )
----
Interaction Among Factors ( factors operating together ) - 4Threats to External ValidityInteraction effects of testing ( pretest making participants aware )
----
Selection Bias ( participants not representative of any particular population )
----
Reactive effects of experimental settings ( lab tests may not be effective in real world )
----
Multiple-treatment interference ( previous treatments influence future ones ) - 5What is a Usability Experiment?an experiment in a controlled environment
- There is a test set of users
- They perform pre-specified tasks
- Data is collected
- Take mean / medium value of measured attributes
- Compare to goal or another system
----
Follows Experimental Factors - 6Experimental FactorsSubjects ( representatives; samples )
---
Independent Variables ( eg: number of menu items )
---
Dependent Variables ( eg: time to perform a task )
---
Experimental Design
[ Within Groups ] ( performs under each condition )
[ Between Groups ] ( performs under only one condition ) - 7Measure User PerformanceLearnability - ( time to complete a task by novice )
Efficiency - ( time to complete a task by expert )
Memorability - ( task completion time for casual user )
User Satisfaction - ( measuring stress, have agree or disagree feedback )
Measuring Errors
Classifying minor vs serious - 8Reliabilitymeasures repeatability
----
difficult to achieve due to individual performance - 9Validityresults transfer into a real-life situation
----
difficult to achieve due modeling real world with lab tests - 10Observational Methods ( Think Aloud )Advantages: ( Simplicity, useful insight, show how system is used )
----
Disadvantage: ( Subjective, difficult to conduct, describing may alter task performance ) - 11Observational Methods ( Post Task Walkthrough )Advantages: ( focus on relevant incidents, avoids interruptions of task )
----
Disadvantage: ( lack of freshness, post-hoc interpretation of events ) - 12Query Techniques ( Interviews )Advantages: ( varied to suit context, explore issues )
----
Disadvantage: ( very subjective, time consuming ) - 13Query Techniques ( Questionnaires )Advantages: ( quick / reaches large user group, analyzed quantitatively )
----
Disadvantage: ( less flexible, less probing ) - 144 Phases of Usability ExperimentPlanning Phase
Execution Phase
Data Collection Technique
Data Analysis - 15Usability Experiment: 1- Planning PhaseGoal : Written Plan or Proposal
---
Outlines of Test Protocol: Tasks? Criteria? Data to be collected?
---
Designing Test Tasks: Representative of task? Cover parts of UI? Time Efficient?
---
Ex: Test Tasks ( task sheets, manual, questionnaire ) - 16Usability Experiment: 2 - Execution PhaseGoal : Prepare environment, materials, software
---
Outline: Should include valuation software, voluntary & confidential, explains procedures, invites questions
---
Designing the execution phase: Give a written task, de-brief, have ethical experimentation - 17Usability Experiment: 3 - Data CollectionRecord data using...
Pen & Paper
Showing users people / labs
prepare video
usability kiosks - 18Usability Experiment: 4 - Data AnalysisGoal :
Observe / save original data
Analyzing data depends on type & info required
---
measures confidence & time - 19Field Studies: Pros & ConsAppropriate for beta testing
Advantages: ( natural environment, context retained )
----
Disadvantage: ( distractions, noise )
Informationen
- Beschreibung
- Final Exam CSE 463 Karteikarten am UI Testing, erstellt von Oscar Jara am 02/12/2019.
- Erstellt von
- Oscar Jara
- Aufrufe
- 0
- Tags
- Bewertung