Evaluation Steps

Evaluation Steps

1. Step 1: Meet with evaluation users - build rapport, understand needs, discuss expectations and intentions of use

   • Work with team at OneWorld to understand their social impact of HIV/AIDS through technology, understand the need for evaluation, and discuss the intent to utilize evaluation outcomes

2. Step 2: Ensure relevance and use of evaluation/Explain process of hearing feedback and data

   • Collaborate with the Learning About Living project evaluation users to make sure there is relevance to the evaluation process. Explain the difficulty that can come with hearing data outcomes and feedback that do not align with expectations. Gain commitment that evaluation users are prepared to hear and use the findings regardless of expected outcomes

3. Step 3: Create a foundation of how to implement feedback

   • Discuss how learning and professional development goals can be identified from the evaluation. Changes that grow from results are unique to the project needs in expanding so the project continues to flourish

4. Step 4: Identify time, budget, political, and cultural constraints specific to the project and company

   • Review any constraints that may impact OneWorld/the Learning About Living project. Each evaluation process is unique, the evaluators and users can identify how to best formulate a design that considers these elements

5. Step 5: Ensure the fundamental areas for evaluation inquiry are being addressed

   • Since the project does not seem to have any prior evaluations, it is important to learn about the feedback from students, parents, teachers, and professionals within the Learning About Living Project to understand core areas to address

6. Step 6: Build and define program theory model

   • Build program model based off of the multilayer educational approach and goals of the project. Develop a model that includes evaluation of education computer program, call and text line, question response time, education and information understanding outcome

7. Step 7: Gather data through method designed - quantitative, qualitative, or mixed methods

   • Collect data through a mixed methods design - allows evaluation users to gain numerical data and participant reflections

8. Step 8: Organize and present data to intended users

   • Organize the data in quantitative and qualitative sections through a powerpoint presentation

9. Step 9: Develop and monitor follow-up action plan with users to enhance evaluation use

   • Establish a plan for timely check-ins to see how intended implementation is working. Discuss ideas for continued use of evaluation

10. Step 10: Institutionalize evaluation use

    • Support the process of making official changes to the project, and offer further collaboration as needed.