There are 2 related dimensions of evaluation. Summative is concerned with outcome process( outcome, process )
There are 2 related dimensions of evaluation. Formative is concerned with process outcome( process, outcome )
There is variation in the role of the evaluator. Pick the correct statement below, based on the lecture notes.
Outsiders are objective and insiders are involved
Outsiders are involved and insiders are objective
To inform decision making about a future program or a major review of an existing program, a proactive clarificative interactive monitoring( proactive, clarificative, interactive, monitoring ) evaluation is required
When does a proactive evaluation take place:
Before program development
During program development
After program development
Never
Select all the relevant questions that apply when conducting a proactive evaluation:
What is the problem and what do we know about it?
Is there a need for the program?
What attempts to address the problem have been made in the past?
What is best practice in this domain?
What other sources of information can inform development of this program?
How is delivery going?
Select all of the items below that are concerned with proactive evaluation:
The extent of the need for a program among a defined population within a defined area of provision
Synthesising what is known about the identified problem
Critically reviewing ways in which an identified problem or issue can be addressed
Program change and improvement on a continuous basis
Select the three approaches to proactive evaluation from the list below:
Needs assessment
Research review
Review of best practice
Responsive evaluation
Action research
Quality review
A needs assessment looks at the needs of a particular population
Taken directly from the lecture notes, a needs assessment identifies the discrepancy between:
an ideal or desired state and the actual state
competing views
path a and path b
the dependent variable and the independent variable
A needs assessment looks at what the priorities are amongst multiple needs. The term "need" is used as a noun verb adjective( noun, verb, adjective ).
In a needs assessment, the "need" refers to the problem, not the proposed solution. "The need for accessible treatment" is:
a problem
a proposed solution
In a needs assessment, the "need" refers to the problem, not the proposed solution. "The need for better preventative health" is:
proposed solution
In a needs assessment, the "need" refers to the problem, not the proposed solution. "We need a safe sex education program" is:
Identifying priorities and developing action plans are part of which needs assessment process:
Planning
Data management
Utilisation
A reasoned description or interpretation of a body of literature that is relevant to the problem is the product of which approach to proactive evaluation:
A research review identifies existing theoretical and applied research relevant to the issue or problem that may inform program development expected outcomes the plan of attack( program development, expected outcomes, the plan of attack )
A review of best practice is commonly referred to as establishment of benchmarks needs rules( benchmarks, needs, rules )
When reviewing best practice, organisational specific comparisons do NOT include:
identifying "cases" (who is doing best?)
analysis to identify common characteristics (how?)
Identify indicators of best practice (what can we translate to our situation?)
identify when the organisation achieved best practice (when?)
Taken directly from the lecture slide, clarificative evaluation forms aim to:
clarify program design and describe program delivery
describe program design and clarify program delivery
Clarificative forms of evaluation are not relevant to early stages of program implementation and delivery
Select the questions that apply when conducting a clarificative evaluation:
What are the intended outcomes and how does the design fit these outcomes?
What is the underlying rationale for the program?
What components need to be modified in order to achieve or maximise outcomes?
Is the program plausible?
What aspects are evaluable?
Select all of the items below that are concerned with clarificative evaluation:
Description of program
Analysis of program logic
Plausibility of program design
Consistency between design and delivery
Planning for subsequent evaluation (e.g. of outcomes and impact)
Assistance in planning and conducting evaluations
Analysis of program logic leads to the rationale conclusion description of the program( rationale, conclusion, description of the program )
Which is NOT an approach to clarificative evaluation:
Evaluability assessment
Examination of program logic
Empowerment evaluation
Which evaluation form "assumes people at the local level can create effective solutions to situational concerns"?
Interactive
Proactive
Monitoring
Impact
Interactive evaluation is relevant for early implementation or existing programs open to improvement, with the emphasis being on delivery planning feedback( delivery, planning, feedback )
Interactive evaluation integrates evaluation into the day to day processes of organisations that deliver programs or services
Select all of the items below that are concerned with interactive evaluation:
The provision of systematic evaluation findings that local providers can use to make decisions about the direction of their programs
Evaluation as a means of empowering providers and participants
Which of the interactive evaluation approaches meets these criteria: * responds to stakeholder needs for information * fieldwork - organisation case study approach * negotiated boundaries of the evaluation * increases stakeholder awareness
Developmental evaluation
Which of the interactive evaluation approaches meets these criteria: * local level solutions to on the job problems * collaborative, social action * cyclical process: develop plan of action to improve current program; implement plan' observe effects of action; reflect and refine; develop plan...
Which of the interactive evaluation approaches meets these criteria: * institutional self-study * undertaken by program staff at the discretion of management in the context of a culture of evalution
Which of the interactive evaluation approaches meets these criteria: * evaluator as key adviser * team approach to design and test new approaches in long-term continuous improvement
Responsiveness evaluation
Which of the interactive evaluation approaches meets these criteria: * emphasis on self-determination * meaningful change is underpinned by an increased capacity in stakeholders and participants to initiate and carry out social change
