Mindmap

Evaluation

Niall Dunne Englisch

Inhalt der Mindmap

Evaluation

Contract reseach fosters necessary partneship
- evaluator
  - programme personnel
    - management
      - revelant
        legimitate
- role in
  - evaluating
    - agency's activities
      - external perspective
        more objective
        maintain control of research
        Framework
        methology
        findings
  - not used in public sector
determining merit
- worth
  - value
    - Careful retrospective assessment
      - merit
        worth
        value of administration
qualitative
- quantative
  - regarding provision of service
    - how could have changes provided a better quality of service
      - necessary to improve the delivery of a service
boyle
- three types of activity define evaluation
  - Programme Design
    - conducting a needs assessment
      - asking questions
        what is know from previous efforts
  - Programme implementation
    - describing what a particular intervention looks like in practice
      - degree to which programme was implemented
        how effective management of the programme had been
  - programme outcome
    - determining the impact of the programme
      - what were the measurable effects of the programme
The evaluation process
- pre evaluation
  - best time to evaluate a project
    - when programme being implemented
      - type of information to collect
        awarness of evaluation
        need to establish realistic objectives
        ambiguities or unresolved issues are cleared up.
        research contract drawn up
        topic for research
        priorities
        aspects of performance best
        future development of policy
        scope considered
        purpose clarified
        clarification may be difficult
        several parties
        important exercise
        what and how many programmes or services to include
        areas of service to include
        professional managers
        time
        resources
- evaluation stage
  - deciding on research strategy
    - research goals and objectives
      - measures of performance
        suitable methodoligies
        collecting and disseminating data
        clarification of objectives of evaluation
        may be difficult
        if goals unclear or conflicting
        or different understanding of goals
        if hidden agenda
        difficult for evaluator to maintain honest brooker role
        clarification of objective may be seen as unwelcome burden.
  - nature of change can also some one will asked to change their practices
    - to increase effectivness
      - create tension
        suspicion of evaluation process
        evaluation it is political process
    - translating obectives into data
      - systematic feedback
        important feedback
        on performance
        one may choose qualatative or
        quantative
- use stage
  - analysing and interpretating the data
    - Deductive
      - inductive
        qualitatvive
        explortory enquiries
        little is known about the topic
        much less structures
        evaluator waits for patterns
        to emerge
        framework built up during data collection phase
        some decisions are made prior to data collection
      - quantitive
        Data collection
        knowledge of policy area
        past research
        research hypotheses
        relevant factors and variables
    - to identify patterns
      - in data
        construct an overall interpretation
        done with key stakeholders
disseminating findings
- important to make
  - findings avaliable to stakeholders
    - needs to be understandable
      - more impact
        final report should not be the only method of dissemination
        less formal also required
        ongoing findings
        emails/ bulletins
        ongoing feedback
        prepare stakeholders
        phased publication
        help debate
        educate
        interim report
        check relevance of report
        those with expert knowledge
        critical feedback
        may orient final report
        maybe reassess relevevance of research
- not just one way
  - understood two ways
    - hence significance
      - oral briefings
        may convincing key stakeholders
Uneasy relationship
- reluctance among policy makers and public sctor managers to use
  - social research
    - evaluator
      - external
        critic
        looking for
        most
        efficient and effective solution
        not sit easy with
        public sector manager
        practical demands
        implementation
        public manager needs to find workable solution
        in political setting
        compromise
        rather than optimal solution
        not fit with research
        making more visiable consequences
        can undermine agreement
        may be not bad
        better understanding
        more informed
        complex understandiig
        of consequences
        make it difficult for
        established intrests to resist cahnge
        or opt for alternative project
        it can be more open and
        challenging vested interests.
        danger that
        findings will be ignored
        misused
        misinterpreted
        transparency and accountability are necessary
        problems examined and policy is changed
Researcher
- should cover
  - new policy findings
    - political role
      - wish to see results acted upon
        everyone in evaluation process
        political agenda
        if fails to highlight a solution
        may have started initative
        clarifying the issues
        drawing attention to the problems
Criteria for policy evaluation
- pragmatic attitude
  - problem formulated perspective of the policy maker
    - rather than disciplinary
      - active involvement of end users at all stages.
        greater involvement
        more likley to apply
        partial decision making is better than no decision
        dissemination should be part of the study
        Findings should be translated into recommendations
Value for money review
- Value for money policy review initative
  - improved value for money
    - exchequere spending in a systematic manner
      - basis for more informed decisions
        on priorities
        move away from input
        look at achievements
        undertaken by Divisions
        internally
        practical focus
        evaluative capacity within departments
        Central Expenditure Evaluation Unit CEEU
        2006
        promote Value for money
        now provides
        analytical and research support
        best practice
        provision of guidance
        unified public spending code
Evaluation
- Monitoring
  - ongoing
    - built into the system
      - checking that things are done
        in correct sequence
        part of the implementation process
        Establishing facts
        current focus
- reflecting on the success of the system
  - making judgements
    - about performance
      - Efficiency
        best use made of existing resources
        maximum output from available
      - effectivness

Informationen

Beschreibung: Mindmap am Evaluation, erstellt von Niall Dunne am 25/03/2016.
Erstellt von: Niall Dunne
Aufrufe: 0
Bewertung

Evaluation

Inhalt der Mindmap

Informationen

Feedback

Wie gefällt dir das neue Design?