Abstract

The problem of determining cause and effect is one of the oldest in the social sciences, where laboratory experimentation is generally not possible. This article provides a perspective on the analysis of causal relationships in population research that draws upon recent discussions of this issue in the field of economics. Within economics, thinking about causal estimation has shifted dramatically in the past decade toward a more pessimistic reading of what is possible and a retreat in the ambitiousness of claims of causal determination. In this article, the framework that underlies this conclusion is presented, the central identification problem is discussed in detail, and examples from the field of population research are given. Some of the more important aspects of this framework are related to the problem of the variability of causal effects for different individuals; the relationships among structural forms, reduced forms, and knowledge of mechanisms; the problem of internal versus external validity and the related issue of extrapolation; and the importance of theory and outside evidence.

This content is only available as a PDF.

References

Adams, P., Hurd, M., McFadden, D., Merrill, A., & Ribeiro, T. (
2003
).
“Healthy, Wealthy, and Wise? Tests for Direct Causal Paths Between Health and Socioeconomic Status.”
.
Journal of Econometrics
,
112
,
3
56
. 10.1016/S0304-4076(02)00145-8
Angrist, J., Imbens, G., & Rubin, D. (
1996
).
“Identification of Causal Effects Using Instrumental Variables.”
.
Journal of the American Statistical Association
,
91
,
444
55
. 10.2307/2291629
Angrist, J., & Krueger, A. (
1991
).
“Does Compulsory School Attendance Affect Schooling and Earnings?”
.
Quarterly Journal of Economics
,
106
,
979
1014
. 10.2307/2937954
Björklund, A., & Moffitt, R. (
1987
).
“Estimation of Wage Gains and Welfare Gains in Self-Selection Models.”
.
Review of Economics and Statistics
,
69
,
42
49
. 10.2307/1937899
Bound, J., Jaeger, D., & Baker, R. (
1995
).
“Problems With Instrumental Variables Estimation When the Correlation Between the Instruments and the Endogenous Explanatory Variable Is Weak.”
.
Journal of the American Statistical Association
,
90
,
443
50
. 10.2307/2291055
Bound, J., & Solon, G. (
1999
).
“Double Trouble: On the Value of Twins-Based Estimation of the Return to Schooling.”
.
Economics of Education Review
,
18
,
169
82
. 10.1016/S0272-7757(98)00048-X
Duncan, G., Magnuson, K., & Ludwig, J. (
2003
).
“The Endogeneity Problem in Developmental Studies.”
.
Northwestern University, Evanston, IL
:
Institute for Policy Research
.
Fricke, T. (
2003
).
“Culture and Causality: An Anthropological Comment.”
.
Population and Development Review
,
29
,
470
79
. 10.1111/j.1728-4457.2003.00470.x
Geronimus, A., & Korenman, S. (
1992
).
“The Socioeconomic Consequences of Teen Childbearing Reconsidered.”
.
Quarterly Journal of Economics
,
107
,
1187
214
. 10.2307/2118385
Geronimus, A., Korenman, S., & Hillemeier, M. (
1994
).
“Does Maternal Age Adversely Affect Child Development? Evidence From Cousin Comparisons in the United States.”
.
Population and Development Review
,
20
,
585
609
. 10.2307/2137602
Grogger, J., & Bronars, S. (
1993
).
“The Socioeconomic Consequences of Teen Childbearing: Findings From a Natural Experiment.”
.
Family Planning Perspectives
,
25
,
156
61
. 10.2307/2135923
Haavelmo, T. (
1943
).
“The Statistical Implications of a System of Simultaneous Equations.”
.
Econometrica
,
11
,
1
12
. 10.2307/1905714
Haavelmo, T. (
1944
).
“The Probability Approach in Econometrics.”
.
Econometrica
,
12
(
Suppl.
),
1
115
.
Heckman, J. (
1978
).
“Dummy Endogenous Variables in a Simultaneous Equation System.”
.
Econometrica
,
46
,
931
60
. 10.2307/1909757
Heckman, J. (
2000
).
“Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective.”
.
Quarterly Journal of Economics
,
115
,
45
97
. 10.1162/003355300554674
Heckman, J. (
2004
).
“The Scientific Model of Causality.”
.
University of Chicago
:
Department of Economics
.
Heckman, J., & Navarro-Lozano, S. (
2004
).
“Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models.”
.
Review of Economics and Statistics
,
86
,
30
57
. 10.1162/003465304323023660
Heckman, J., & Robb, R. (
1985
).
“Alternative Models for Evaluating the Impact of Interventions.”
. In J. Heckman, & B. Singer (Eds.),
Longitudinal Analysis of Labor Market Data
(pp.
156
245
).
Cambridge, England
:
Cambridge University Press
.
Heckman, J., & Vytlacil, E. (
1999
).
“Local Instrumental Variables and Latent Variable Models for Identifying and Bounding Treatment Effects.”
.
Proceedings of the National Academy of Sciences
,
96
,
4730
34
. 10.1073/pnas.96.8.4730
Heckman, J., & Vytlacil, E. (
2001
).
“Policy-Relevant Treatment Effects.”
.
American Economic Review
,
91
,
107
11
. 10.1257/aer.91.2.107
Heckman, J. and E. Vytlacil. Forthcoming. “The Econometric Evaluation of Social Programs.” In Handbook of Econometrics, Vol. 6, edited by J. Heckman and E. Leamer. New York: Elsevier.
Hoffman, S., Foster, E.M., & Furstenberg, F. (
1993
).
Demography
,
30
,
1
13
. 10.2307/2061859
Holland, P. (
1986
).
“Statistics and Causal Inference.”
.
Journal of the American Statistical Association
,
81
,
945
60
. 10.2307/2289064
Hotz, V.J., McElroy, S., & Sanders, S. (
1997
).
“The Impacts of Teenage Childbearing on the Mothers and the Consequences of Those Impacts for the Government.”
. In R. Maynard (Ed.),
Kids Having Kids: Economic Costs and Social Consequences of Teen Pregnancy
(pp.
55
94
).
Washington, DC
:
Urban Institute Press
.
Hotz, V.J., Mullin, C., & Sanders, S. (
1997
).
“Bounding Causal Effects Using Data From a Contaminated Natural Experiment: Analysing the Effect of Teenage Childbearing.”
.
Review of Economic Studies
,
64
,
575
603
. 10.2307/2971732
Imbens, G., & Angrist, J. (
1994
).
“Identification and Estimation of Local Average Treatment Effects.”
.
Econometrica
,
62
,
467
76
. 10.2307/2951620
Kelley, A., & Williamson, J. (
1984
).
What Drives Third World City Growth? A Dynamic General Equilibrium Approach
.
Princeton, NJ
:
Princeton University Press
.
Krueger, A., & Pischke, J.-S. (
1992
).
“The Effect of Social Security on Labor Supply: A Cohort Analysis of the Notch Generation.”
.
Journal of Labor Economics
,
10
,
412
37
. 10.1086/298294
Kuznets, S. (
1966
).
Modern Economic Growth
.
New Haven, CT
:
Yale University Press
.
Manski, C. (
1995
).
Identification Problems in the Social Sciences
.
Cambridge, MA
:
Harvard University Press
.
R. Maynard (
1997
).
Kids Having Kids: Economic Costs and Social Consequences of Teen Pregnancy
.
Washington, DC
:
Urban Institute
.
McFadden, D. (
1974
).
“Conditional Logit Analysis of Qualitative Choice Behavior.”
. In P. Zarembka (Ed.),
Frontiers in Econometrics
(pp.
105
42
).
New York
:
Academic Press
.
Moffitt, R. (
1991
).
“Program Evaluation With Nonexperimental Data.”
.
Evaluation Review
,
15
,
291
314
. 10.1177/0193841X9101500301
Moffitt, R. (
2003
).
“Causal Analysis in Population Research: An Economist’s Perspective.”
.
Population and Development Review
,
29
,
448
58
. 10.1111/j.1728-4457.2003.00448.x
Neyman, J. (
1923
).
“On the Application of Probability Theory to Agricultural Experiments. Essay on Principles.”
.
Roczniki Nauk Rolniczych
,
10
,
1
51
.
Neyman, J. (
1935
).
“Statistical Problems in Agricultural Experimentation.”
.
Supplement to the Journal of the Royal Statistical Society
,
2
,
107
80
. 10.2307/2983637
Quandt, R. (
1972
).
“Methods for Estimating Switching Regressions.”
.
Journal of the American Statistical Association
,
67
,
306
10
. 10.2307/2284373
Robins, J.M. (
1999
).
“Association, Causation, and Marginal Structural Models”.
.
Synthese
,
121
,
151
79
. 10.1023/A:1005285815569
Rosenbaum, P. (
1995
).
Observational Studies
.
New York
:
Springer-Verlag
.
Rosenzweig, M., & Wolpin, K. (
2000
).
“Natural ‘Natural Experiments’ in Economics.”
.
Journal of Economic Literature
,
38
,
827
74
. 10.1257/jel.38.4.827
Roy, A. (
1951
).
“Some Thoughts on the Distribution of Earnings.”
.
Oxford Economic Papers
,
3
,
135
46
.
Rubin, D. (
1974
).
“Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies.”
.
Journal of Educational Psychology
,
66
,
688
701
. 10.1037/h0037350
Rubin, D. (
1978
).
“Bayesian Inference for Causal Effects.”
.
Annals of Statistics
,
6
,
34
58
. 10.1214/aos/1176344064
Schultz, T.P. (
1985
).
“Changing World Prices, Women’s Wages, and the Fertility Transition: Sweden 1860–1910.”
.
Journal of Political Economy
,
93
,
1126
54
. 10.1086/261353
Smith, H. (
2003
).
“Some Thoughts on Causation as It Relates to Demography and Population Studies.”
.
Population and Development Review
,
29
,
459
69
. 10.1111/j.1728-4457.2003.00459.x
Stock, J., Wright, J., & Yogo, M. (
2002
).
“A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments.”
.
Journal of Business and Economic Statistics
,
20
,
518
29
. 10.1198/073500102288618658
Report to Congress on Out-of-Wedlock Childbearing
. (
1995
).
Washington, DC
:
U.S. Government Printing Office
.
Winship, C., & Morgan, S. (
1999
).
“The Estimation of Causal Effects From Observational Data.”
.
Annual Review of Sociology
,
25
,
659
706
. 10.1146/annurev.soc.25.1.659
L. Wu, & B. Wolfe (
2001
).
Out of Wedlock: The Causes and Consequences of Nonmarital Fertility
.
New York
:
Russell Sage Foundation
.