Lab

Lab

1. Bringing High Seas into The Lab (Lumsden)

   • speech based input feasibility study for lobster fishing vessel
   • results suggest bringing real world into lab a success
   • possible to meaningfully abstract & bring relevant aspects of real world into lab in order to evaluate speech feasability
   • found results commensurate with not only environment close to real world (intermediate) but to real world itself
   • the focus is on FEASIBILITY not USABILITY
   • Demonstrate it is possible to bring complex scenarios based on diligent observation of real-world context that return meaningful results (that are commensurate with field study)

2. Usability Testing of mobile applications: a comparison between lab and field (Kaikkonen)

   • usability problems found in both environments and no difference in completion time
   • same set of tasks so only context changed
   • field - no beenfit gained in understanding userinteraction

3. Is It Worth The Hassle? Exploring the Added Value of Evaluating the usability...(Kjeldskov)

   • Electronic patient record system in hospital ward
   • significantly more serious & cosmetic USABILITY problems identified in lab
   • only 1 problem identified in field and not in lab
     • due to it taking place in real world the results entered into system were safety critical & the fact this issue was only picked up in field indicates teh lab wasn't quite real enough?
   • field study challenging to collect data
   • if real world environment taken into context in lab design - lab just as effective as field
   • field is difficult to conduct, time consuming and added value is unknown

4. Is it worth the Hassle: The added value of evaluating the usability of mobile systems in the field (Nielson)

   • designing tasks beforehand reduces the realism of 'field study' & people argue that reducing the realism to this extent takes away the purpose and real definition of a field study

5. Bringing a construction sit into the lab - a context relevant lab-based evaluation of a multimodal mobile app (Lumsden)

   • it is possible to bring a complex physical envrionment into the lab
   • represent key aspects of the intended context of use
   • noise level significatly affect data entry precision when using speech
   • further investigation into bone transfer mic to reduce impact of external noise
   • essential that lab setup adequatly represents the intended context