Empirical Evaluation

Empirical Evaluation

1. Usability Tests

   • Low cost
   • Breakdowns
   • Task-based evaluation
   • Steps to run test
     • Decide who is representative of stakeholders
       • Define tasks for participants
         • Retrospective interview
   • Tasks define the goal

2. Technology Probes

   • Deploy prototype
     • Interviews
     • Logging
     • Data collection
   • Ecological validity

3. A/B Tests

   • Experimental condition
   • Control condition
   • Very measurable
   • Limitations on holistic results

4. Experience Sampling

   • Surveys about prototype