Agenda | Implementing empirical evaluations with correlational (Type 2) evidence
- 26 November 2024, 09:30–16:30
- Nesta, 58 Victoria Embankment, London EC4Y 0DS
- Event overview and tickets
Pre-workshop preparation (optional)
Homework: Interventions
- Bring one or two interventions you’d like to focus on during the workshop.
- You should have a good understanding of this intervention(s) and their outcomes, preferably having completed a Core Theory of Change relating to that intervention.
Event agenda
09:30 Arrival & refreshments
10:00 Presentation: An overview of evaluation
Session outline:
- Explore key definitions, standards of evidence, design options,and TASO’s approach to evaluation.
- Learn how theories of change contribute to effective monitoring and evaluation, and discover the benefits of a collaborative approach to theory of change development.
10:30 Workshop: Measuring Outcomes (with existing data)
Session outline:
- Reflect on your programmes and what your evaluation is looking to achieve, using TASO’s ‘MEF’ framework.
- Explore and develop research questions for your intervention evaluation.
Understand outcome measures for your intervention using existing secondary data, internal and external to your institution. - Begin to map what existing data you can utilise to evaluate your chosen intervention.
11:15 Break
11:30 Workshop: Primary data collection
Session outline:
- Explore the basics of pre- and post-intervention surveying. Learn about validated instruments and how to use them, exploring TASO’s Access and Success Questionnaire (ASQ).
- Learn about other validated scales and how to source your own.
- Review your intervention evaluation, and what pre- and post- survey to use in your evaluation design.
12:15 Lunch
13:00 Workshop: Digging for detail
Session outline:
-
- Reflect on qualitative data collection methods after exploring quantitative data collection.
- Explore tips to effectively gather qualitative feedback through interviews and focus groups.
- Design your own interview and focus group questions to support your evaluation.
13:45 Workshop: Analysis and presentation of results
Session outline:
-
- Discover the fundamentals of statistical analysis, and myth-busting, and get answers to key questions.
- Explore ways in which qualitative and quantitative data is presented internally and externally to stakeholders.
- Reflect on examples of effective and ineffective presentation of evaluation findings.
14:45 Break
15:00 Workshop: Next steps, and looking ahead
Session outline:
-
-
- Consider the broader administration of your evaluation, including ethical approval, data protection, and practical delivery. Additionally, explore who you may need to involve in its execution.
- Apply a project planning approach to review your evaluation plan and identify next steps.
- Reflect on what you need to do next, and share your plan with others to enhance your evaluation.
-
16:30 Reflections & wrap up