COVID-19

Policy evaluation: understanding the evaluation process

Crawford School of Public Policy | Executive course
Policy Essentials

Summary

What the main factors that need to be considered when implementing an evaluation of public policies and what approaches should be used? This one-day course will equip participants so that they can learn how to identify the potential for, manage the implementation of and interpret the findings of different kinds of policy evaluations. They will learn the difference between outputs, outcomes and impact, as well as how to build and apply a theory of change. In addition, participants will be guided through the process of planning an impact evaluation of one of the policies or programs they work on.

See related courses: Quantifying Policy Impact Using Randomized Control Trials

Course overview

Be introduced to the factors that need to be considered with evaluating a policy or program. Participants will gain insights about different kinds of policy evaluations (both qualitative and quantitative). To conclude participants will be guided through the process of designing an impact evaluation of one of the policies or programs they work on and will have an opportunity to pitch some of their ideas.
The course is interactive in nature and is customised to the level and needs of the participants.

Topics to be covered:

  • Introduction to the different types of evaluations
  • Selecting an evaluation approach
  • Managing the implementation of an evaluation
  • Brainstorming ideas for potential impact evaluations

Outcomes:

Policy makers are often unsure if the intended impact of policies and/or programs are achieved because commonly used monitoring and evaluation approaches focus on input and outputs not outcomes. Public sector organisations often describe impact in terms of the amount of money spent or what that money is spent on as opposed to what the outcomes of policies/programs are. For example, the funding set aside for schools or the number of teachers trained is focused on as opposed to learning outcomes and the opportunities students have after school. This course on impact evaluations addresses this issue by providing policy makers with techniques to be able to measure the outcomes and impact of the policies and programs their organisations implements.

Anticipated behavioural and business impacts of the course include:

Participants will be equipped so that they can learn how to determine whether policies and programs have their intended outcomes and understand what changes can be made to increase their impact. The brainstorming and group work activity that is integrated into this course will provide participants with tangible examples that they can return back to their work places with and implement immediately. Furthermore, we will assist with matching the most promising idea that is proposed with a potential implementing partner (such as a researcher or non-government organisations) to fast track the anticipated impact.

Who should attend?

Policy makers and program managers between the levels of APS4 to EL2 (or equivalent). This course has been designed for those without a background in economics and participants do not require any quantitative skills. The content will be accessible so that participants without any exposure to monitoring and evaluation will still be able to benefit from the course. All that is required is some experience with working on public policy issues.

Course presenter(s)

Dr Christopher Hoy

Christopher Hoy is a Research and Policy Fellow at the Crawford School of Public Policy. He has conducted over 20 impact evaluations in 15 countries, including the first large-scale randomised control trials in Papua New Guinea and Fiji. He has worked as an impact evaluation expert for the World Bank and Asian Development Bank as well as a lecturer for a subject on impact evaluations at the University of Sydney. Christopher holds a PhD in Economics from the Australian National University and a Masters in International and Development Economics from Yale University.

Updated:  17 July 2024/Responsible Officer:  Crawford Engagement/Page Contact:  CAP Web Team