Karteikarten
AGEE 651-Program Evaluation
Karten in diesem Stapel (39)
- 1An approach helpful in identifying major stakeholder groups and persons involved in the program.Snowball approach
- 2Impact assessment without any process evaluation. Considers what goes into a program and what comes out without considering what goes on inside the program.Black box evaluation
- 3Examines the careful study of program delivery-including how programs are implemented and association b/t program components and outcomes. Also considers outside factors.Transparent box paradigm
- 4When stakeholders are involved in designing and conducting an evaluationParticipatory evaluation
- 5Rapid, low-cost evaluation. Produces evaluation findings and helps evaluators to identify priorities and ensure feasibility and usefulness.Exploratory assessment
- 6Answers the question of whether a program is ready for future evaluationEvaluability assessment
- 7Trained volunteers or employees that are used to conduct rating, most useful when what you need is obtainable by seeing or hearing itTrained observers
- 8Addresses questions about program outcomesImpact assessment
- 9Answers the questions about the social conditions a program is intended to addressNeeds assessment
- 10Focuses on questions relating to the way the program is conceptualized and designed.Assessment of program theory
- 11Formative EvaluationIs used for guiding program improvement
- 12Summative evaluationUsed to prove the effectiveness of programs
- 13Informal evaluationCasual, spontaneous, criteria are implicit, judgement hastily made, evidence is quickly/insufficiently obtained
- 14Formal evaluationTakes time, deliberate, criteria are explicit and clear, judgement is carefully made, evidence is systematically collected
- 15Original document-like and interview or official recordP
- 16Analysis collected from the primary evidence-such as census data or textbooksSecondary evidencec
- 17Describe quantitative indicatorsIndicators that are observable or measurable.
- 18Describe qualititativeRefer to feelings and are subjective decisions
- 19F-Observation guides
-Recording sheets
-Field Notes
-Pictures
-Combinations - 20DStructured observations are "looking for"-specific things, pre-defined process, information is gathered without any respondents or interviewees
Means of recording: observation guides and recording sheets - 21Describe unstructured observationsUnstructured observations are "looking at"-example is an observation noting advantages and disadvantages of something.
Means of recording : logs and field notes - 22What are the advantages to using trained observers?Ensures standardized observations that will be comparable across sites-observers need to look for the same things and record them as similarly as possible.
- 23Data entered into and agency's record system by a representative of the organization.Agency records
- 24Problems with agency records:-Missing or incomplete data
-concerns about accuracy
-changing definitions
-data in aggregated form
-confidentiality/privacy considerations
-data linked across programs and agencies - 25People who are committed, competent and connected and who are looked to by others for informationTipping point connectors
- 26How are tipping point connectors identified?By creating a stakeholder influence diagram of primary intended users, ask about who is viewed as connected to whom and who has influence with key decision makers.
- 27What are the seven steps (guidelines) in identifying and working with Primary Intended Users?-Develop facilitation skills
-Find and train evaluation information users
-Find tipping point connectors
-Facilitate high quality interaction
-Nurture interest in evaluation
-Demonstrate cultural sensitivity and competence
-Anticipate turnover of intended users - 28A grid that puts stakeholders on a 2x2 matrix where the dimensions are the level of a stakeholder's interest in the evaluation and their power to affect the process or use of the evaluationPower vs. Interest Grid
- 29What are the four catagories1) Players (people w/ both interest and power)
2) Subjects (people with interest but little power)
3) Context Setters (people with power but little direct interest)
4) Crowd (people with little interest or power) - 30What four standards must be met in order for an evaluation to be useful?-Program goals are agreed on and realistic
-Information needs are well defined
-Evaluation data are obtainable
-Intended users are willing and able to use evaluation information - 31When should rapid feedback evaluation begin?Only after there is agreement on the goals
- 32Which 2 processes used in rapid feedback evaluation are exploratory evaluation methods?-Evaluation synthesis
-Small sample studies - 33Who has priority in determining the evaluation questions?The evaluation funder
- 34An important outcome, characteristic, attribute or variable of the subject under evaluationPerformance measure/indicator
- 35Types of performance measures are:-Process
-Client benefit
-Consequence - 36Name some potential stakeholder groups-Policymakers
-Program sponsors
-Evaluation sponsors
-Target participants
-Program managers
-Program staff
-Competitors
-Research community - 37What are the steps in focusing an evaluation (12)1. Define the pro3gram you are developing
2. Who is involved in the project
3. Who are the stakeholders
4. Why does the program exist-goals & objectives
5. What are the fundamental elements of the program
6. What is the purpose of the evaluation
7. Who will use the evaluation? how?
8. How many others will be involved
9. What questions will the evaluation seek to answer
10. What information is needed to answer the questions?
11. When is the evaluation needed
12. What resources are needed - 38What three considerations should guide evaluation planning?-The purpose of the evaluation
-Programs structure & Circumstances
- Resources available - 39Describe the T.O.P. Model (Diagram)Targeting Outcomes of Programs
-focuses on outcomes in planning, implementing and evaluation programs. Based on a hierarchy that integrates program evaluation within the program development process.
Informationen
- Beschreibung
- Karteikarten am AGEE 651-Program Evaluation, erstellt von Amber Hines am 03/03/2019.
- Erstellt von
- Amber Hines
- Aufrufe
- 2
- Bewertung