9 December 202510:00–16:00
Book now
Join us on 9 December (10:00-16:00) for an online training session on impact evaluation with small cohorts, delivered as part of our Autumn Evaluation Essentials training.
To measure the impact of interventions with a small number of participants (e.g. less than 50), specific evaluation methods are required to generate the most robust insights possible. In this training session, we will introduce how theory-based evaluation methods can be used to evaluate the impact of interventions with small cohorts.
During this session, you will learn about key concepts for impact evaluations with small cohorts:
- The foundational concepts of impact evaluation and its relevance to evaluating higher education interventions
- How theory-based evaluation methods can be used to evaluate interventions with smaller numbers of participants, informed by theory of change
- How to plan a theory-based impact evaluation with small cohorts, including considerations when choosing an evaluation method and the key steps required
- Examples of real-world case studies from the higher education sector, to show how impact evaluations with small cohorts have been run in practice
By the end of this training, you will have an overview of evaluation methods suitable for small cohorts and understand the key steps for evaluation planning, data collection, and reporting. You will have the opportunity to apply the key concepts to your context, that can be developed into a full evaluation plan with further expert support.
The session will include a mix of presentations, activities, and group discussions, giving attendees the opportunity to interact with other practitioners and evaluators in the sector and learn from each other.
Due to the breadth and complexity of theory-based evaluation methods that can be used to evaluate interventions with small cohorts, this training will not teach you how to complete a full impact evaluation using a single theory-based method.
Agenda
Note: timings may change slightly
| Time | Session | Outline |
| 10:00 | Welcome and introductions | |
| 10:20 | Introduction to evaluation | Understand the fundamentals of evaluation. Learn about the purpose and main principles of theory-based evaluation. |
| 10:40 | Research questions | Understand the difference between impact and process questions. Identify research questions for your evaluation. |
| 11:15 | Break | |
| 11:25 | Introduction to theory-based evaluation methods | Learn about different approaches to theory-based evaluation with small cohorts. Consider which theory-based evaluation method is most appropriate for your context. |
| 11:55 | Case study: Contribution analysis | A deep dive into contribution analysis, through a case study example of a contextual admissions evaluation at the London School of Economics (LSE). Learn about the principles of contribution analysis and how the method has been applied in an HE context, presented by the LSE’s Evaluation Lead. |
| 12:40 | Lunch | |
| 13:25 | Case study: Realist evaluation | A deep dive into realist evaluation, through a case study example of a university coaching programme evaluation commissioned by TASO. Learn about the principles of realist evaluation and how the method has been applied in an HE context, presented by TASO’s project lead/ |
| 13:55 | Testing causal pathways part 1: Theoretical explanations | Understand the role of causal pathways in theory-based evaluation methods. Practice testing causal pathways through developing theoretical explanations. |
| 14:25 | Break | |
| 14:35 | Testing causal pathways part 2: Collecting data | Learn about common data collection methods used in theory-based evaluations. Develop data collection plans for testing causal pathways. Apply your learnings to your own intervention. |
| 15:25 | Reporting and using findings | Reflect on reporting evaluation findings to the relevant audiences and using them to inform practice. |
| 15:45 | Final reflections and wrap up | |
| 16:00 | Close |
How to prepare
To make the most of the session, please come prepared with an intervention or programme in mind that you’d like to plan a theory-based evaluation for. During the training, we’ll be using theory of change to inform evaluation planning.
If you don’t already have a theory of change for your intervention, we recommend trying our Theory of Change Builder in advance. While you’ll still be able to fully take part without one, having a draft will help you think through your intervention ahead of the session.
Who should attend?
- Individuals in any role within higher education institutions or third-sector organisations who are looking to evaluate interventions with small cohorts of about 50 or less.
- Experienced evaluators seeking to refresh their knowledge of theory-based evaluation methods suitable for small cohorts.
Why attend?
- Targeted learning: Learn how theory-based methods can be applied to robustly evaluate the impact of interventions run with small cohorts. You’ll have the opportunity to work directly on your own evaluation plan throughout the training, with personalised guidance and support from experienced facilitators.
- Professional development: Improve your skills around best-practice evaluation methods, positioning yourself as a leader in driving impactful change.
- Benefit for your institution: Get your specific questions answered and explore how theory-based evaluation can be applied to your organisational needs.
Pricing
- Standard rate: £259 (+ £51.80 VAT)
- Group booking rate: £233 (+ £46.60 VAT) per person
As a thank you for joining, you’ll also receive a 10% discount for your next session in the Evaluation Essentials series. A code will be included in your booking confirmation and can be applied to any other session in the series.