Participants will be provided with a detailed understanding of different types of impact evaluation techniques as well as an introduction to what factors need to be considered with evaluating a policy or program. Impact evaluations involve quantifying the effect of a policy or a program by estimating what would have taken place if it had not been implemented (i.e. the ‘counterfactual’). The day will focus on the ‘gold standard’ of impact evaluation, which is using randomised control trials.

The course is interactive in nature and is customised to the level and needs of the participants.

Topics to be covered:

• Overview of randomized control trials
• Applications of randomized control trials
• Determining the appropriate sample size
• Identifying opportunities for potential RCTs

Outcomes:

Policy makers are often unsure if the intended impact of policies and/or programs are achieved because commonly used monitoring and evaluation approaches focus on input and outputs not outcomes. Public sector organisations often describe impact in terms of the amount of money spent or what that money is spent on as opposed to what the outcomes of policies/programs are. For example, the funding set aside for schools or the number of teachers trained is focused on as opposed to learning outcomes and the opportunities students have after school. This course on impact evaluations addresses this issue by providing policy makers with techniques to be able to measure the outcomes and impact of the policies and programs their organisations implements.

Anticipated behavioural and business impacts of the course include:

Participants will be equipped so that they can learn how to determine whether policies and programs have their intended outcomes and understand what changes can be made to increase their impact. The brainstorming and group work activity that is integrated into this course will provide participants with tangible examples that they can return back to their work places with and implement immediately. Furthermore, we will assist with matching the most promising idea that is proposed with a potential implementing partner (such as a researcher or non-government organisations) to fast track the anticipated impact.

Who should attend?

Policy makers and program managers between the levels of APS4 to EL2 (or equivalent). This course has been designed for those without a background in economics and participants do not require any quantitative skills. The content will be accessible so that participants without any exposure to monitoring and evaluation will still be able to benefit from the course. All that is required is some experience with working on public policy issues.