A growing literature on inference in difference-in-differences (DiD) designs has been pessimistic about obtaining hypothesis tests of the correct size, particularly with few groups. We provide Monte Carlo evidence for four points: (i) it is possible to obtain tests of the correct size even with few groups, and in many settings very straightforward methods will achieve this; (ii) the main problem in DiD designs with grouped errors is instead low power to detect real effects; (iii) feasible GLS estimation combined with robust inference can increase power considerably whilst maintaining correct test size – again, even with few groups, and (iv) using OLS with robust inference can lead to a perverse relationship between power and panel length.
Authors
Mike Brewer
Research Fellow University of Michigan
Tom is a Research Fellow at IFS, a Research Professor for the Institute for Social Research at the University of Michigan.
Deputy Director
Robert is a Deputy Director. His work focuses on primarily on the labour market, income and wealth inequality, and the design of the welfare system.
Journal article details
- DOI
- 10.1515/jem-2017-0005
- Publisher
- De Gruyter
- JEL
- C12; C13; C21
- Issue
- October 2017
Suggested citation
M, Brewer and T, Crossley and R, Joyce. (2017). 'Inference with difference-in-differences revisited' (2017)
More from IFS
Understand this issue
Gender norms, violence and adolescent girls’ trajectories: Evidence from India
24 October 2022
Empty defence spending promises are a shot in the dark
29 April 2024
Public investment: what you need to know
25 April 2024
Policy analysis
IFS Deputy Director Carl Emmerson appointed to the UK Statistics Authority Methodological Assurance Review Panel
14 April 2023
ABC of SV: Limited Information Likelihood Inference in Stochastic Volatility Jump-Diffusion Models
We develop novel methods for estimation and filtering of continuous-time models with stochastic volatility and jumps using so-called Approximate Bayesian Compu- tation which build likelihoods based on limited information.
12 August 2014
Is there really an NHS productivity crisis?
17 November 2023
Academic research
Sample composition and representativeness on Understanding Society
2 February 2024
Understanding Society: minimising selection biases in data collection using mobile apps
2 February 2024
Robust analysis of short panels
8 January 2024