Downloads
cwp351515.pdf
PDF | 354.4 KB
Models with high-dimensional covariates arise frequently in economics and other fields. Often, only a few covariates have important effects on the dependent variable. When this happens, the model is said to be sparse. In applications, however, it is not known which covariates are important and which are not. This paper reviews methods for discriminating between important and unimportant covariates with particular attention given to methods that discriminate correctly with probability approaching 1 as the sample size increases. Methods are available for a wide variety of linear, nonlinear, semiparametric, and nonparametric models. The performance of some of these methods in finite samples is illustrated through Monte Carlo simulations and an empirical example.
Authors
Northwestern University
Working Paper details
- DOI
- 10.1920/wp.cem.2015.3515
- Publisher
- Institute for Fiscal Studies
Suggested citation
Horowitz, J. (2015). Variable selection and estimation in high-dimensional models. London: Institute for Fiscal Studies. Available at: https://ifs.org.uk/publications/variable-selection-and-estimation-high-dimensional-models (accessed: 3 May 2024).
More from IFS
Understand this issue
Where next for the state pension?
13 December 2023
Social mobility and wealth
12 December 2023
Autumn Statement 2023: IFS analysis
23 November 2023
Policy analysis
Recent trends in and the outlook for health-related benefits
19 April 2024
Progression of nurses within the NHS
12 April 2024
Regional variation in earnings and the retention of NHS staff in Agenda for Change bands 1 to 4
10 April 2024
Academic research
Imagine your life at 25: Gender conformity and later-life outcomes
24 April 2024
A senior doctor like me: Gender match and occupational choice
24 April 2024
Police infrastructure, police performance, and crime: Evidence from austerity cuts
24 April 2024