Nesta, 58 Victoria Embankment, London EC4Y 0DS09:30–16:30
4 December 2024
Book now
Exploring causal impact evaluation using QEDs
Join our evaluation training event where you’ll explore how to meet the Office for Students (OfS) Type 3 (causal) standard of evidence using quasi-experimental designs (QEDs).
QEDs aim to establish a causal relationship between an intervention and outcomes. They rely on naturally occurring or constructed intervention and comparator groups rather than achieving this through random assignment. For instance, curriculum-based interventions which are being rolled out and are delivered in some courses but not others.
This session is applicable to both pre-entry and post-entry access and participation (APP) work, offering a comprehensive overview of when and how to use QEDs to evaluate your interventions.
Key elements in this session
- How to evaluate whether an intervention was implemented as planned.
- Learn how to identify when it is appropriate to use a QED and explore variations of this methodology.
- Understand sample size considerations for implementing QEDs.
- Explore how to use a QED to evaluate your new intervention or strategy.
- Learn how to interpret and learn from the findings of QEDs, as well as how to effectively communicate these findings to stakeholders.
- Review case studies that illustrate common issues encountered when running a QED.
- By the end of the session, you will have a high-level understanding of when it is appropriate to use a QED, how to plan a QED for an intervention, and the knowledge of potential challenges you may face.
Who should attend?
- Those new to evaluation.
- Experienced evaluators seeking to refresh their understanding of causal impact methods.
- Managers and practitioners who commission and manage evaluations.
- Those who work closely with evaluators
Why attend?
- Professional development: Gain a deep understanding of the appropriate use of QEDs, and learn how to interpret and learn from their outputs.
- Benefit for your institution: Learn which interventions within your APPs would be suitable for a QED, and effectively manage their evaluation.
- Networking opportunities: Connect with professionals across the higher education sector, fostering collaboration and sharing best practices for effective evaluation.
Note: This session will not cover statistical techniques, therefore, no statistical or technical expertise required to attend.
Location
Nesta, 58 Victoria Embankment, London EC4Y 0DS
Cost
Early bird
- Non-profit organisations (higher education providers, charities, public sector): £299 + VAT
- For-profit organisations: £599 + VAT
Standard rate
- Non-profit organisations (higher education providers, charities, public sector): £349 + VAT
- For-profit organisations: £699 + VAT
Agenda
Agenda: find out more
Event agenda
09:30 Arrival & refreshments
10:00 Workshop: Introduction to causal evaluation
Session outline:
- Learn to differentiate between correlation and causation.
- Explore the role of the counterfactual and ways to construct comparator groups through ‘matching’, and understand the strengths and weaknesses of these designs.
- Gain foundational knowledge on robust causal methods, including randomised controlled trials (RCTs) and quasi-experimental designs (QEDs).
11:00 Break
11:30 Workshop: Variations in QED methodology and when to use them
Session outline:
- Learn about different QED methodologies including difference-in-differences and regression discontinuity designs.
- Discover how and when to apply these methodologies, considering data types and necessary criteria.
12:30 Lunch
13:30 Workshop: QEDs in the real world
Session outline:
- Explore real-world examples of QED methodologies in higher education, including past TASO projects.
- Learn from practical examples evaluating wellbeing and curriculum reform interventions, and using student analytics data.
14:30 Workshop: Break
15:00 Workshop: Practical steps on applying and interpreting QEDs
Session outline:
- Learn practical steps for embedding QEDs in your own context.
- Utilise TASO’s data infrastructure guide to determine suitable QED methodologies and data requirements.
- Explore the transition from a theory of change to a core evaluation plan for your interventions.
- Learn how to interpret QED findings effectively.
16:30 Reflections & wrap up