Evaluation based on critical systems heuristics

Evaluation based on critical systems heuristics

1. Evaluation based on critical systems heuristics

   • Sources of motivation
     • Beneficiary (client)
     • Purpose
     • Measure of success
   • Sources of expertise
     • Expert
     • Expertise
     • Guarantor
   • Sources of control
     • Decision maker
     • Resources
     • Decision environment
   • Sources of legitimation
     • Witnesses
     • Emancipation
     • Worldview

2. Why use CSH?

   • Boundary judgements encapture key dimensions of any purposeful system of interest
   • Value judgements are made transparent
   • Securing improvement provides the driving principle for evaluation.

3. The Technique: doing a CSH evaluation

   • 1-Identify the system of interest
   • 2-Reflect and make a note on your own role as evaluator
   • 3-For the SoI identified, attempt to locate where it fits within the thr ee level hierarchy of planning
   • 4-Focusing on the SoI, and its underlying purpose, identify associated stakeholders representing beneficiaries, decision makers, experts, and w itnesses
   • 5-Build up a picture of the SoI through addressing CSH questions in a systematic manner,
   • 6-Design an interview questionnaire for each of the key stakeholder groups identified.
   • 7-The ‘final’ evaluation will then need to be written up in a clear narrative form.

4. Case Study: natural resource management

   • 1- Identifying the system of interest
   • 2-Role of evaluator
   • 3-Level of planning
     • Participatory Rural Appraisal
     • Natural Resource Management Project
     • Botswana Range Inventory & Monitoring Project
   • 4-Stakeholder groups
   • 5-Monological appraisa
     • Sources of influence
       • Motivation
       • Control
       • Expertise
       • Legitimation
   • 6-Dialogical appraisal
   • 7-Reporting