Lecture Notes


LEC # TOPICS LECTURE NOTES
1 What is evaluation?
  • Needs assessment
  • Process evaluation
  • Impact evaluation
  • Cost-benefit analysis
Lecture 1
slides (PDF)
2 Why randomize?
  • Different types of impact evaluation
  • Counterfactual
  • Selection bias
  • Internal / external validity
Lecture 2
slides (PDF)
3 How to Randomize I
  • Methods of randomization: Lottery, Phase in, Rotation, encouragement
  • Multiple treatments
  • Gathering support
Lecture 3
slides (PDF)
4 How to Randomize II
  • Unit of randomization
  • Cross-cutting treatments
  • Stratification
  • Mechanics
Lecture 4
slides (PDF)
5 Measurement and Outcomes
  • Key hypotheses
  • Primary and intermediate outcomes
  • Interpreting multiple outcomes
  • Theory of change Model
  • Questionnaire design
  • Data collection/entry
Lecture 5
slides (PDF)
6 Sample Size and Power Calculations
  • Estimation
  • Hypothesis testing
  • Power: significance level, variance of outcome, effect size
  • Clustered design
Lecture 6
slides (PDF)
7 Managing threats to evaluation and data analysis
  • Attrition
  • Externalities (spillovers)
  • Partial compliance and selection bias
Lecture 7
slides (PDF)
8 Analyzing Data
  • Intention to treat (ITT) and Treatment on treated (ToT)
  • Choice of outcomes and covariates
  • External validity
  • Cost-effectiveness
Lecture 8
slides (PDF)

Acknowledgements

The lecture notes were created over several years by the following people:

  • Esther Duflo, Professor of Economics, MIT
  • Abhijit Banerjee, Professor of Economics, MIT
  • Rachel Glennerster, Executive Director, J-PAL
  • Michael Kremer, Professor of Economics, Harvard University
  • Dan Levy, Lecturer, Harvard Kennedy School of Government
  • Dean Karlan, Professor of Economics, Yale University
  • Sendhil Mullainathan, Professor of Economics, Harvard University
  • Ben Olken, Associate Professor of Economics, MIT
  • Rohini Pande, Professor of Public Policy, Harvard Kennedy School of Government
  • Shawn Cole, Assistant Professor of Business Administration, Harvard Business School
  • Erica Field, Assistant Professor of Economics, Harvard University
  • Greg Fisher, Lecturer in Economics, London School of Economics
  • Rema Hanna, Assistant Professor of Public Policy, Harvard Kennedy School of Government
  • Leigh Linden, Assistant Professor of Economics, Columbia University
  • Pascaline Dupas, Assistant Professor of Economics, UCLA
  • Seema Jayachandran, Assistant Professor of Economics, Stanford University
  • Luc Behaghel, INRA Researcher, Paris School of Economics
  • Bruno Crepon, Researcher, ENSAE and Ecole Polytechnique
  • Marc Gurgand, Associate Professor, Paris School of Economics
  • William Pariente, Post-Doctoral Fellow, J-PAL
  • Nava Ashraf, Assistant Professor of Business Administration, Harvard Business School
  • Karthik Muralidharan, Assistant Professor of Economics, UCSD