Original Article
PreviousPrevious
Volume 356:447-458 February 1, 2007 Number 5
NextNext
Long-Term Exposure to Air Pollution and Incidence of Cardiovascular Events in Women
Kristin A. Miller, M.S., David S. Siscovick, M.D., M.P.H., Lianne Sheppard, Ph.D., Kristen Shepherd, M.S., Jeffrey H. Sullivan, M.D., M.H.S., Garnet L. Anderson, Ph.D., and Joel D. Kaufman, M.D., M.P.H.

1. Brook RD, Franklin B, Cascio W, et al. Air pollution and cardiovascular disease: a statement for healthcare professionals from the Expert Panel on Population and Prevention Science of the American Heart Association. Circulation 2004;109:2655-2671.  [CrossRef][ISI][Medline]

14. Pope CA III, Burnett RT, Thurston GD, et al. Cardiovascular mortality and long-term exposure to particulate air pollution: epidemiological evidence of general pathophysiological pathways of disease. Circulation 2004;109:71-77.  [ISI][Medline]

27. Bhatnagar A. Environmental cardiology: studying mechanistic links between pollution and heart disease. Circ Res 2006;99:692-705.  [Free Full Text]

1. Brook RD, Franklin B, Cascio W, et al. Air pollution and cardiovascular disease: a statement for healthcare professionals from the Expert Panel on Population and Prevention Science of the American Heart Association. Circulation 2004;109:2655-2671.  [CrossRef][ISI][Medline]

2. Samet JM, Zeger SL, Dominici F, et al. The National Morbidity, Mortality, and Air Pollution Study. Part II: Morbidity and mortality from air pollution in the United States. Res Rep Health Eff Inst 2000;94:5-70.  [Medline]

3. Dockery DW, Pope CA III, Xu X, et al. An association between air pollution and mortality in six U.S. cities. N Engl J Med 1993;329:1753-1759.  [Free Full Text]

4. Pope CA III, Thun MJ, Namboodiri MM, et al. Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults. Am J Respir Crit Care Med 1995;151:669-674.  [Abstract]

6. Krewski D, Burnett RT, Goldberg MS, et al. Reanalysis of the Harvard Six Cities Study and the American Cancer Society Study of Particulate Pollution and Mortality: a special report of the Institute's Particle Epidemiology Reanalysis Project. Cambridge, MA: Health Effects Institute, 2000.

3. Dockery DW, Pope CA III, Xu X, et al. An association between air pollution and mortality in six U.S. cities. N Engl J Med 1993;329:1753-1759.  [Free Full Text]

4. Pope CA III, Thun MJ, Namboodiri MM, et al. Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults. Am J Respir Crit Care Med 1995;151:669-674.  [Abstract]

5. Pope CA III, Burnett RT, Thun MJ, et al. Lung cancer, cardiopulmonary mortality, and long-term exposure to fine particulate air pollution. JAMA 2002;287:1132-1141.  [Free Full Text]

6. Krewski D, Burnett RT, Goldberg MS, et al. Reanalysis of the Harvard Six Cities Study and the American Cancer Society Study of Particulate Pollution and Mortality: a special report of the Institute's Particle Epidemiology Reanalysis Project. Cambridge, MA: Health Effects Institute, 2000.

7. Abbey DE, Nishino N, McDonnell WF, et al. Long-term inhalable particles and other air pollutants related to mortality in nonsmokers. Am J Respir Crit Care Med 1999;159:373-382.  [Free Full Text]

8. Hoek G, Brunekreef B, Goldbohm S, Fischer P, van den Brandt PA. Association between mortality and indicators of traffic-related air pollution in the Netherlands: a cohort study. Lancet 2002;360:1203-1209.  [CrossRef][ISI][Medline]

9. Kaiser J. Showdown over clean air science. Science 1997;277:466-469.  [Free Full Text]

10. Vedal S. Ambient particles and health: lines that divide. J Air Waste Manag Assoc 1997;47:551-581.  [ISI][Medline]

11. Pope CA III, Dockery DW. Health effects of fine particulate air pollution: lines that connect. J Air Waste Manag Assoc 2006;56:709-742.  [ISI][Medline]

12. Kunzli N, Medina S, Kaiser R, Quenel P, Horak F Jr, Studnicka M. Assessment of deaths attributable to air pollution: should we use risk estimates based on time series or on cohort studies? Am J Epidemiol 2001;153:1050-1055.  [Free Full Text]

13. McMichael AJ, Anderson HR, Brunekreef B, Cohen AJ. Inappropriate use of daily mortality analyses to estimate longer-term mortality effects of air pollution. Int J Epidemiol 1998;27:450-453.  [Free Full Text]

3. Dockery DW, Pope CA III, Xu X, et al. An association between air pollution and mortality in six U.S. cities. N Engl J Med 1993;329:1753-1759.  [Free Full Text]

4. Pope CA III, Thun MJ, Namboodiri MM, et al. Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults. Am J Respir Crit Care Med 1995;151:669-674.  [Abstract]

5. Pope CA III, Burnett RT, Thun MJ, et al. Lung cancer, cardiopulmonary mortality, and long-term exposure to fine particulate air pollution. JAMA 2002;287:1132-1141.  [Free Full Text]

14. Pope CA III, Burnett RT, Thurston GD, et al. Cardiovascular mortality and long-term exposure to particulate air pollution: epidemiological evidence of general pathophysiological pathways of disease. Circulation 2004;109:71-77.  [ISI][Medline]

4. Pope CA III, Thun MJ, Namboodiri MM, et al. Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults. Am J Respir Crit Care Med 1995;151:669-674.  [Abstract]

6. Krewski D, Burnett RT, Goldberg MS, et al. Reanalysis of the Harvard Six Cities Study and the American Cancer Society Study of Particulate Pollution and Mortality: a special report of the Institute's Particle Epidemiology Reanalysis Project. Cambridge, MA: Health Effects Institute, 2000.

8. Hoek G, Brunekreef B, Goldbohm S, Fischer P, van den Brandt PA. Association between mortality and indicators of traffic-related air pollution in the Netherlands: a cohort study. Lancet 2002;360:1203-1209.  [CrossRef][ISI][Medline]

15. Jerrett M, Burnett RT, Ma R, et al. Spatial analysis of air pollution and mortality in Los Angeles. Epidemiology 2005;16:727-736.  [CrossRef][ISI][Medline]

16. Kunzli N, Jerrett M, Mack WJ, et al. Ambient air pollution and atherosclerosis in Los Angeles. Environ Health Perspect 2005;113:201-206.  [ISI][Medline]

21. Chen LH, Knutsen SF, Shavlik D, et al. The association between fatal coronary heart disease and ambient particulate air pollution: are females at greater risk? Environ Health Perspect 2005;113:1723-1729. [Erratum, Environ Health Perspect 2006;114:A21.]  [ISI][Medline]

16. Kunzli N, Jerrett M, Mack WJ, et al. Ambient air pollution and atherosclerosis in Los Angeles. Environ Health Perspect 2005;113:201-206.  [ISI][Medline]

17. The Women's Health Initiative Study Group. Design of the Women's Health Initiative clinical trial and observational study. Control Clin Trials 1998;19:61-109.  [CrossRef][ISI][Medline]

18. Langer RD, White E, Lewis CE, Kotchen JM, Hendrix SL, Trevisan M. The Women's Health Initiative Observational Study: baseline characteristics of participants and reliability of baseline measures. Ann Epidemiol 2003;13:Suppl 9:S107-S121.  [CrossRef][ISI][Medline]

18. Langer RD, White E, Lewis CE, Kotchen JM, Hendrix SL, Trevisan M. The Women's Health Initiative Observational Study: baseline characteristics of participants and reliability of baseline measures. Ann Epidemiol 2003;13:Suppl 9:S107-S121.  [CrossRef][ISI][Medline]

19. Curb JD, McTiernan A, Heckbert SR, et al. Outcomes ascertainment and adjudication methods in the Women's Health Initiative. Ann Epidemiol 2003;13:Suppl 9:S122-S128.  [CrossRef][ISI][Medline]

20. Heckbert SR, Kooperberg C, Safford MM, et al. Comparison of self-report, hospital discharge codes, and adjudication of cardiovascular events in the Women's Health Initiative. Am J Epidemiol 2004;160:1152-1158.  [Free Full Text]

22. Maheswaran R, Elliott P. Stroke mortality associated with living near main roads in England and Wales: a geographical study. Stroke 2003;34:2776-2780.  [Free Full Text]

23. Maheswaran R, Haining RP, Brindley P, et al. Outdoor air pollution and stroke in Sheffield, United Kingdom: a small-area level geographical study. Stroke 2005;36:239-243.  [Free Full Text]

24. Wellenius GA, Schwartz J, Mittleman MA. Air pollution and hospital admissions for ischemic and hemorrhagic stroke among Medicare beneficiaries. Stroke 2005;36:2549-2553.  [Free Full Text]

25. Moolgavkar SH, Luebeck EG. A critical review of the evidence on particulate air pollution and mortality. Epidemiology 1996;7:420-428.  [ISI][Medline]

26. Abrahamowicz M, Schopflocher T, Leffondre K, du Berger R, Krewski D. Flexible modeling of exposure-response relationship between long-term average levels of particulate air pollution and mortality in the American Cancer Society study. J Toxicol Environ Health A 2003;66:1625-1654.  [CrossRef][ISI][Medline]

28. Suwa T, Hogg JC, Quinlan KB, Ohgami A, Vincent R, van Eeden SF. Particulate air pollution induces progression of atherosclerosis. J Am Coll Cardiol 2002;39:935-942.  [Free Full Text]

1. Miller KA, Siscovick DS, Sheppard L, et al. Long-term exposure to air pollution and incidence of cardiovascular events in women. N Engl J Med 2007;356:447-458.  [Free Full Text]

2. Künzli N, Jerrett M, Mack WJ, et al. Ambient air pollution and atherosclerosis in Los Angeles. Environ Health Perspect 2005;113:201-206.  [ISI][Medline]

3. Burnett RT, Dewanji A, Dominici F, Goldberg MS, Cohen A, Krewski D. On the relationship between time-series studies, dynamic population studies, and estimating loss of life due to short-term exposure to environmental risks. Environ Health Perspect 2003;111:1170-1174.  [ISI][Medline]

4. Peters A, von Klot S, Heier M, et al. Exposure to traffic and the onset of myocardial infarction. N Engl J Med 2004;351:1721-1730.  [Free Full Text]

5. Laden F, Schwartz J, Speizer FE, Dockery DW. Reduction in fine particulate air pollution and mortality: extended follow-up of the Harvard Six Cities study. Am J Respir Crit Care Med 2006;173:667-672.  [Free Full Text]

1. Pope CA III, Burnett RT, Thurston GD, et al. Cardiovascular mortality and long-term exposure to particulate air pollution: epidemiological evidence of general pathophysiological pathways of disease. Circulation 2004;109:71-77.  [ISI][Medline]

2. Jerrett M, Burnett RT, Ma RJ, et al. Spatial analysis of air pollution and mortality in Los Angeles. Epidemiology 2005;16:727-736.  [CrossRef][ISI][Medline]

3. Ross Z, Jerrett M, Ito K, Tempalski B, Thurston G. A land use regression model for predicting fine particulate matter concentrations in the New York City region. Atmos Environ 2007;41:2255-2269.  [CrossRef]

4. Schlesinger RB, Kunzli N, Hidy GM, Gotschi T, Jerrett M. The health relevance of ambient particulate matter characteristics: coherence of toxicological and epidemiological inferences. Inhal Toxicol 2006;18:95-125.  [CrossRef][ISI][Medline]

1. Haneuse S, Wakefield J, Sheppard L. The interpretation of exposure effect estimates in chronic air pollution studies. Stat Med (in press).

2. Künzli N, Medina S, Kaiser R, Quenel P, Horak F Jr, Studnicka M. Assessment of deaths attributable to air pollution: should we use risk estimates based on time series or on cohort studies? Am J Epidemiol 2001;153:1050-1055.  [Free Full Text]

3. Sun Q, Wang A, Jin X, et al. Long-term air pollution exposure and acceleration of atherosclerosis and vascular inflammation in an animal model. JAMA 2005;294:3003-3010.  [Free Full Text]

4. Suwa T, Hogg JC, Quinlan KB, Ohgami A, Vincent R, van Eeden SF. Particulate air pollution induces progression of atherosclerosis. J Am Coll Cardiol 2002;39:935-942.  [Free Full Text]

5. Pope CA III, Burnett RT, Thun MJ, et al. Lung cancer, cardiopulmonary mortality, and long-term exposure to fine particulate air pollution. JAMA 2002;287:1132-1141.  [Free Full Text]

  • Article

  • Exposure to air pollution has been associated with death and hospitalization from cardiovascular causes.1 Uncertainty remains about the magnitude of these associations, the mechanisms, and the effects of long-term exposure to pollutants, as compared with short-term exposure. Although previous studies of daily increases in exposure to pollution have assessed both fatal and nonfatal events,2 studies investigating long-term exposure — estimating average exposure during years of follow-up — have evaluated mortality only on the basis of death certificates.3, 4, 5, 6, 7,8 The increase in mortality associated with long-term exposure to air pollution is larger than that seen in studies of short-term exposure, and long-term effects on death rates serve as the current basis for fiercely challenged environmental regulations in this country.9, 10, 11, 12, 13

    In previous studies of the long-term effect of air pollution on cardiovascular disease, investigators have averaged exposures across a city and then compared health effects between cities.3, 4, 5, 14 However, gradients of exposure to pollutants within cities also affect the risk of death from cardiovascular causes8, 15 and may be associated with subclinical atherosclerosis.16

    We evaluated long-term exposure to air pollution and the incidence of cardiovascular disease in the Women's Health Initiative (WHI) Observational Study, a prospective cohort study with medical-record review and classification procedures designed to document specific first cardiovascular events. We also examined how between-city and within-city gradients of exposure to particulate matter of less than 2.5 µm in aerodynamic diameter (PM2.5) are associated with first cardiovascular events.

    Methods

    Study Subjects

    The WHI enrolled postmenopausal women between the ages of 50 and 79 years in the study from 1994 to 1998. The study design and characteristics of the subjects have been described in detail elsewhere.17, 18 All subjects lived within commuting distance of one of 49 WHI clinical centers and satellite clinics in 36 U.S. Metropolitan Statistical Areas (referred to throughout as "cities"). Eligible subjects were those who planned to remain in the area and were free from conditions (including alcoholism, mental illness, and dementia) that might have precluded their participation in follow-up surveys. Baseline questionnaires assessed demographic and lifestyle characteristics, cardiovascular risk factors, medical history, diet, and medications. Written informed consent was obtained from all subjects. Anthropometric and blood-pressure measurements were performed at baseline.18

    We restricted our study population to subjects without a history of physician-diagnosed cardiovascular disease, including previous myocardial infarction, congestive heart failure, coronary revascularization, and stroke. To establish a stable primary residence during follow-up, we included women who lived within 150 mi (241 km) of a clinic (and had not changed clinics) before either death or the year 2002. Institutional review boards at the University of Washington and the Fred Hutchinson Cancer Research Center approved the study.

    Data on Air Pollution Exposure

    We obtained data on the monitoring of air pollution from the Environmental Protection Agency's Aerometric Information Retrieval System with the use of AirData (www.epa.gov/oar/data). Such data are recorded for PM2.5 and particulate matter of less than 10 µm in aerodynamic diameter (PM10), sulfur dioxide, nitrogen dioxide, carbon monoxide, and ozone. We selected monitors on the basis of monitoring objectives and scale to represent ambient community-scale exposure and excluded those with data available from less than 50% of intended samples (see the Supplementary Appendix, available with the full text of this article at www.nejm.org). On the basis of a five-digit ZIP Code centroid, the nearest monitor to the location of each residence was identified and used to assign an average of annual pollutant concentrations to each study subject. Only women linked to a monitor within 30 mi (48 km) of their residence were included. The long-term average PM2.5 concentration was the exposure of interest, and the annual average concentration in the year 2000 was the primary exposure measure, owing to the substantially increased network of monitors in place in that year, as compared with previous years.

    Cardiovascular Outcomes

    The WHI determined events on the basis of subjects' responses on annual questionnaires and review of medical records (including hospital discharge summaries and diagnostic codes, results of electrocardiography, and reports on diagnostic tests and procedures) by physician adjudicators, following an established protocol.19 Deaths were identified by proxy reports or by a review of the National Death Index. For deaths, WHI adjudicators reviewed all available records, including those from emergency, outpatient, and inpatient departments, and emergency medical services; autopsy and coroner records; and death certificates. We included outcomes adjudicated through August 2003.

    The first cardiovascular event was the first occurrence of any of the following: myocardial infarction, coronary revascularization, stroke, and death from either coronary heart disease (categorized as "definite" or "possible") or cerebrovascular disease. These events were considered to be most consistent with an atherosclerotic disease process and most reliably verified by the WHI protocol.20 Death from coronary heart disease (both definite and possible diagnoses) required documented myocardial infarction or angina or an antecedent procedure related to coronary artery disease during the follow-up period. Possible deaths from coronary heart disease were those consistent with the condition but without an identifiable nonatherosclerotic cause. Definite deaths from coronary heart disease were those with chest pain within the previous 72 hours or a history of chronic ischemic heart disease, without valvular disease or nonischemic cardiomyopathy. For some analyses, events were classified as coronary events (myocardial infarction, revascularization, and death from coronary heart disease) or cerebrovascular events (stroke and death from cerebrovascular causes). Although some women had more than one type of event, no analysis included multiple events per subject.

    Our principal hypothesis concerned levels of PM2.5. Single-pollutant and multipollutant models were fit to investigate possible independent or joint effects of other pollutants (see the Supplementary Appendix).

    Sensitivity Analyses

    We performed sensitivity analyses that excluded subjects living more than 10 mi (16 km) from a monitor or residing for fewer than 20 years in their current state. Other sensitivity analyses included and excluded coronary revascularization and other outcomes; examined a larger group of cardiovascular events, with the addition of angina pectoris, congestive heart failure, transient ischemic attack, other carotid artery disease, and deaths from all cardiovascular causes; and excluded cities with the highest variation of within-city exposure or the lowest exposure concentration (see the Supplementary Appendix).

    Statistical Analysis

    We used Cox proportional-hazards regression to estimate hazard ratios and 95% confidence intervals (CIs) for the time to the first cardiovascular event associated with an elevation of 10 µg per cubic meter in the level of long-term exposure to PM2.5. In all models, we included factors that we hypothesized a priori could potentially confound the relationship between air pollution and cardiovascular disease. These factors included age, body-mass index (BMI), smoking status, the number of cigarettes smoked per day, the number of years of smoking, systolic blood pressure, educational level, household income, race or ethnic group, and presence or absence of diabetes, hypertension, or hypercholesterolemia. Models were stratified with use of separate baseline hazards according to current treatment for diabetes, age, and BMI. We also evaluated other characteristics previously associated with the risk of cardiovascular disease — including presence or absence of environmental tobacco smoke, occupation, physical activity, diet, alcohol consumption, waist circumference, waist-to-hip ratio, medical history, medications, and presence or absence of a family history of cardiovascular disease — as possible confounders in extended models.

    Interactions between exposure and factors that could modify the association between air pollution and the incidence of cardiovascular disease were evaluated with partial-likelihood ratio tests. For tests of linear trend using the partial-likelihood method, potential effect modifiers measured as continuous variables (such as BMI, waist-to-hip ratio, and waist circumference) or as ordered categorical variables (such as household income, educational level, and years lived in state) were grouped into quintiles.

    We created exposure variables to estimate between-city and within-city effects. Exposures for all women in a metropolitan area were averaged into a weighted citywide exposure. Two approaches were used to estimate the within-city effects as part of the overall exposure–effect relationship. One approach fit indicator variables for each metropolitan area, which we term "city-adjusted." The other approach subtracted the weighted citywide mean exposure, which we termed "within-city" (see the Supplementary Appendix for details). Data were analyzed with the use of SAS software (version 8.0, SAS Institute) and Stata software (version 8.0, Stata).

    Results

    Study Subjects

    Of the 93,676 subjects, 72,569 had no cardiovascular disease at baseline. Of those women, 65,893 (90.8%) returned a follow-up questionnaire, met our residence criteria, and were assigned PM2.5 exposure data. We recorded 349,643 women-years of follow-up for the 58,610 women with complete information for the main analytical variables (88.9% of those who were eligible).

    Most of the subjects were white (83.1%), and the median age at enrollment was 63 years. The characteristics of the subjects were similar in most respects across categories of PM2.5 exposure (Table 1). Race and ethnic group and socioeconomic measures were distributed somewhat unevenly across exposure categories. Current smoking was rare (reported by 6.1% of the subjects), and half of the cohort reported never having smoked. Stable long-term residential location was typical; 85.7% of the subjects had lived for 20 years or more in their current state.

    View this table:
    [in a new window]
    Get Slide
              		Table 1. Characteristics of Study Subjects and Events, According to the Quintile of Exposure to Fine Particulate Matter (PM2.5).
     
    Exposure to Pollution

    We linked each woman in the study to one of 573 PM2.5 monitors operating in the year 2000, with a median of 20 monitors per city (range, 4 to 78) (Table 2). Most women lived within 6 mi (10 km) of a monitor. The overall median concentration of fine particle pollution was 13.4 µg per cubic meter (interquartile range, 11.6 to 18.3). The minimum concentration (3.4 µg per cubic meter) was observed in Honolulu, and the maximum (28.3 µg per cubic meter) in Riverside, California.

    View this table:
    [in a new window]
    Get Slide
              		Table 2. Average Concentrations of Fine Particulate Matter (PM2.5) Measured near the Homes of 65,893 Subjects (Year 2000).
     
    Cardiovascular Events

    A total of 1816 women had one or more cardiovascular events during the study (Table 3). An increase in exposure of 10 µg per cubic meter in the level of PM2.5 was associated with an adjusted hazard ratio of 1.24 (95% CI, 1.09 to 1.41) for the time to the first cardiovascular event. Within-city estimates tended to be larger than between-city estimates, but the differences were not significant (P=0.07); the city-adjusted approach and the estimate of within-city effects yielded similar results (1.69 and 1.64, respectively). A similar pattern emerged for coronary heart disease and cerebrovascular events.

    View this table:
    [in a new window]
    Get Slide
              		Table 3. Estimated Hazard Ratios for the Time to the First Cardiovascular Event or Death Associated with an Exposure Increase of 10 µg per Cubic Meter in the Level of Fine Particulate Matter (PM2.5).
     
    The magnitude of effects observed was largest for mortality end points (Table 3). The strongest overall association was with death definitely associated with coronary heart disease (hazard ratio, 2.21; 95% CI, 1.17 to 4.16), the fatal event characterized by greatest diagnostic certainty. The effect size increased across the range of exposure concentrations that were measured (Figure 1). We did not observe associations between other pollutants and cardiovascular disease in single-pollutant models, and adjustment for other measured pollutants did not attenuate the findings for PM2.5.

    Figure 1
    View larger version (24K):
    [in a new window]
    Get Slide
              		Figure 1. Level of Exposure to Fine Particulate Matter and the Risk of Death from Cardiovascular Causes in Women.

    The graphs demonstrate the observed relationship between the risk of death from cardiovascular disease and the level of particulate matter of less than 2.5 µm in aerodynamic diameter (PM2.5), including both definite and possible deaths from coronary heart disease or cerebrovascular disease. Panel A shows the overall relationship between the PM2.5 level and death, Panel B the effects between metropolitan areas, and Panel C the effects within metropolitan areas, with an indicator variable used to adjust for each city. These results suggest a generally linear relationship between exposure and risk, though the 95% confidence intervals (shaded areas) are wide at the extremes of exposure. Risk is depicted in comparison with a reference value of 11 µg per cubic meter. The histogram in each panel illustrates the density of exposure distribution for air pollution. All estimates are adjusted for age, race or ethnic group, educational level, household income, smoking status, systolic blood pressure, body-mass index, and presence or absence of a history of diabetes, hypertension, or hypercholesterolemia.
     
    Sensitivity Analyses

    A sensitivity analysis incorporating a random-effect term for each city allowed for the possibility that effects might vary from city to city in the estimation of the main effect and its variance for each of the overall, between-city, and within-city effects. Results from this sensitivity analysis were consistent with the primary analysis. The effect estimates were not diminished, and in all cases, the lower confidence limits above 1 did not decrease (see the Supplementary Appendix). Adjustment for additional covariates (i.e., presence or absence of environmental tobacco smoke, occupation, physical activity, diet, the use or nonuse of dietary supplements, use or nonuse of alcohol, household income, waist circumference, waist-to-hip ratio, medical history, medications, and presence or absence of a family history of cardiovascular disease) did not substantially change the risk estimates.

    Susceptibility to Effects of Air Pollution

    Differences in the relationship between PM2.5 and cardiovascular disease according to the characteristics of the subjects are summarized in Table 4. The association between cardiovascular events and the level of PM2.5 increased with increasing categories of BMI and waist-to-hip ratio and with a shorter duration of residence in the current state.

    View this table:
    [in a new window]
    Get Slide
              		Table 4. Estimated Hazard Ratios for Cardiovascular Events Associated with an Increase of 10 µg per Cubic Meter in the Level of Fine Particulate Matter (PM2.5), According to Selected Characteristics.
     
    Discussion

    In a large, prospective cohort of postmenopausal women, long-term (annual average) exposure to increased concentrations of fine particulate air pollution was associated with an increased risk of first cardiovascular events. The increased risk applied to nonfatal and fatal cardiovascular events, including both coronary and cerebrovascular events. We found that estimates of effects within cities were often larger than those of effects between cities; the latter had been the primary measure in previous U.S. studies of long-term exposure to pollutants.

    The risk of death associated with higher levels of PM2.5 was generally larger than the risk of all first events; it was also larger than mortality estimates reported in previous U.S. cohort studies that used only death certificates. For death from cardiovascular causes (including coronary heart disease and cerebrovascular disease), we estimated an overall 76% increase in risk with each increase of 10 µg per cubic meter in long-term PM2.5 exposure — accounting for subjects in approximately the 10th to 90th percentiles for exposure.

    Our measurement of the between-city effect is similar to that in the American Cancer Society's Cancer Prevention Study II4 and the Harvard Six Cities Study.3 The between-city hazard ratio was 1.63 for death from cardiovascular causes as defined in our study and 1.42 for the broader definition similar to that used in the other two studies. In the independent reanalysis,6 the estimated hazard ratio for death from all cardiovascular causes associated with an increase of 10 µg per cubic meter in long-term PM2.5 exposure was 1.19 (95% CI, 1.05 to 1.34) in the Six Cities Study and 1.13 (95% CI, 1.08 to 1.18) in the American Cancer Society's study. However, subjects in those cohorts differed substantially from ours, especially by the inclusion of men and persons with previous cardiovascular disease. The larger effect sizes observed for levels of PM2.5 in our study may be due to these factors or to our efforts to reduce misclassification of outcomes and exposures. However, other studies have suggested greater effects of particulate air pollution in women than in men.16, 21 The increased association we observed between the PM2.5 level and death from cardiovascular causes, as compared with all cardiovascular events, could be related to methodologic considerations, such as a reduced misclassification of fatal events. Alternatively, fine particulate exposures could exert effects that disproportionately result in fatal events (such as arrhythmic events or hemorrhagic stroke), as compared with nonfatal cardiovascular events.

    In addition to the increased risk of coronary heart disease, we identified an association between long-term exposure to air pollution and the incidence of cerebrovascular disease. For each increase of 10 µg per cubic meter of exposure, there was a 35% increase in the risk of cerebrovascular events and an 83% increase in the risk of death from cerebrovascular causes. Previous evidence in this area included ecologic studies suggesting that the rate of death from stroke may be elevated in areas near main roads or with increased pollution,22, 23 and short-term exposure has been linked to stroke, for example.24

    We observed a stronger association between the PM2.5 level and cardiovascular disease with increasing obesity, as measured by either the BMI or the waist-to-hip ratio. These findings require replication. In contrast to the findings in the American Cancer Society's study,4, 6 we observed a uniform pollution-related risk of cardiovascular events across age groups, possibly because of the greater homogeneity of subjects in our study.

    Our study benefited from well-defined outcomes, extensive data regarding risk factors for cardiovascular disease, and long-term geographic stability of a cohort without previous cardiovascular disease. Critics of earlier studies have suggested that poorly measured or unmeasured confounding factors may vary from city to city and account, at least in part, for the observed city-to-city differences in death rates associated with air pollution.25 We ascertained key characteristics of subjects that might confound the relationship with exposure, and study results were not sensitive to adjustment for these characteristics, although some residual confounding cannot be excluded. Aspects of our analytic approach also reduce the concern over confounding, such as our examination of the between-city and within-city components of exposure. We controlled for the factors that vary from city to city (e.g., imperfectly measured subject characteristics, the composition or toxicity of particulate matter, and particle infiltration) in the analysis, which included a city indicator variable. By investigating many potential covariates, and by including both within-city and between-city exposures, we provided confirmation of the observed association between long-term exposure to air pollution and cardiovascular disease.

    The role of socioeconomic status has received attention in air-pollution epidemiology. Beyond controlling for educational level and household income, our results were not sensitive to further adjustment for occupation or Census-derived measures of income, wealth, or poverty on the basis of ZIP Code. Neither educational level nor household income significantly modified the relationship between air pollution and cardiovascular disease, although there was a trend toward greater effects among those with less education.

    Since our study included a large number of women who lived in many locales, regional or smaller-scale differences in medical practice might have influenced our findings, particularly regarding coronary revascularization. However, the results did not change when revascularization procedures were not included in the analysis. Furthermore, it is possible that women living close to one another may be more similar than those living farther apart, which could affect the variance estimation. However, we found no evidence that such a bias influenced our results.

    Our assessment of exposure remains necessarily limited, since exposure levels were assigned from one monitor with the use of the subjects' primary residential ZIP Codes, which could potentially introduce some inaccuracy. The degree to which ambient pollution monitors represent the exposures of the subjects is imperfect, though we took measures to exclude nonrepresentative monitors. We were unable to assess microclimate differences in exposure, whether some participants may have moved, or details regarding the subjects' activity and location, such as time spent in traffic and indoors. These factors contribute to errors in measurement and misclassification of exposure but are unlikely to have introduced a bias that would explain the study's findings.

    We used data regarding PM2.5 levels from a single year at the midpoint of follow-up, rather than a baseline or multiyear average, because of the presence of a much greater number of measuring stations in the year 2000 than at other times. Concentrations of particulate pollution were stable during the period under study; year-to-year PM2.5 values were very highly correlated during years available (Pearson's correlation, ≥0.92). Analysis in the American Cancer Society's study showed a strong correlation between the sites at a 20-year interval and no time dependence of the hazard function, indicating that fine particulate pollution measured at any time during follow-up is a reasonable surrogate for the relevant exposure (long-term exposure to particulate matter).26

    The mechanism by which long-term exposure to fine particulate air pollution may increase the risk of cardiovascular disease remains uncertain and the subject of intensive speculation and investigation.1, 14, 27 Accelerated atherosclerosis and vulnerability to plaque rupture have been documented in an experimental model,28 and ambient pollution has been correlated with carotid intima–media thickness in humans.16

    Our results were specific to fine particulate pollution; we did not observe robust effects with other sizes of particulate matter or with other measured air pollutants (see the Supplementary Appendix). Finally, since we investigated long-term exposure and first cardiovascular events, the results in this cohort cannot be ascribed primarily to the short-term effects of increases in levels of pollution occurring on a day-to-day basis or to effects of pollution limited to those who were already ill.

    Our study provides evidence of the association between long-term exposure to air pollution and the incidence of cardiovascular disease. Our study confirms previous reports and indicates that the magnitude of health effects may be larger than previously recognized. These results suggest that efforts to limit long-term exposure to fine particulate pollution are warranted.

    Supported by grants from the Environmental Protection Agency (R827355, to the Northwest Center for Particulate Matter and Health) and the National Institute of Environmental Health Sciences (T32ES07262, K24ES013195, K23ES011139, and P30ES07033, to the University of Washington). The WHI program is funded by the National Heart, Lung, and Blood Institute.

    No potential conflict of interest relevant to this article was reported.

    The views expressed in this article do not necessarily reflect the views or policies of the Environmental Protection Agency.

    We thank the WHI investigators (listed in the Supplementary Appendix); the women who participated in this study; and Nancy Bonnington, Jill Shupe, and Jonathan Schildcrout for their assistance with data management.


    Source Information

    From the Departments of Epidemiology (K.A.M., D.S.S., J.D.K.), Medicine (D.S.S., J.D.K.), Biostatistics (L.S., G.L.A.), and Environmental and Occupational Health Sciences (L.S., K.S., J.H.S., J.D.K.), University of Washington; and the Women's Health Initiative Clinical Coordinating Center, Fred Hutchinson Cancer Research Center (G.L.A.) — both in Seattle.

    Address reprint requests to Dr. Kaufman at the University of Washington Occupational and Environmental Medicine Program, 4225 Roosevelt Way NE, Suite 100, Seattle, WA 98105, or at joelk@u.washington.edu .

  • Abstract

  • Background Fine particulate air pollution has been linked to cardiovascular disease, but previous studies have assessed only mortality and differences in exposure between cities. We examined the association of long-term exposure to particulate matter of less than 2.5 µm in aerodynamic diameter (PM2.5) with cardiovascular events.
    Full text of Background >

    Methods We studied 65,893 postmenopausal women without previous cardiovascular disease in 36 U.S. metropolitan areas from 1994 to 1998, with a median follow-up of 6 years. We assessed the women's exposure to air pollutants using the monitor located nearest to each woman's residence. Hazard ratios were estimated for the first cardiovascular event, adjusting for age, race or ethnic group, smoking status, educational level, household income, body-mass index, and presence or absence of diabetes, hypertension, or hypercholesterolemia.
    Full text of Methods >

    Results A total of 1816 women had one or more fatal or nonfatal cardiovascular events, as confirmed by a review of medical records, including death from coronary heart disease or cerebrovascular disease, coronary revascularization, myocardial infarction, and stroke. In 2000, levels of PM2.5 exposure varied from 3.4 to 28.3 µg per cubic meter (mean, 13.5). Each increase of 10 µg per cubic meter was associated with a 24% increase in the risk of a cardiovascular event (hazard ratio, 1.24; 95% confidence interval [CI], 1.09 to 1.41) and a 76% increase in the risk of death from cardiovascular disease (hazard ratio, 1.76; 95% CI, 1.25 to 2.47). For cardiovascular events, the between-city effect appeared to be smaller than the within-city effect. The risk of cerebrovascular events was also associated with increased levels of PM2.5 (hazard ratio, 1.35; 95% CI, 1.08 to 1.68).
    Full text of Results >

    Conclusions Long-term exposure to fine particulate air pollution is associated with the incidence of cardiovascular disease and death among postmenopausal women. Exposure differences within cities are associated with the risk of cardiovascular disease.
    Full text of Conclusions >


    Source Information

    From the Departments of Epidemiology (K.A.M., D.S.S., J.D.K.), Medicine (D.S.S., J.D.K.), Biostatistics (L.S., G.L.A.), and Environmental and Occupational Health Sciences (L.S., K.S., J.H.S., J.D.K.), University of Washington; and the Women's Health Initiative Clinical Coordinating Center, Fred Hutchinson Cancer Research Center (G.L.A.) — both in Seattle.

    Address reprint requests to Dr. Kaufman at the University of Washington Occupational and Environmental Medicine Program, 4225 Roosevelt Way NE, Suite 100, Seattle, WA 98105, or at joelk@u.washington.edu .

  • References
    1. Brook RD, Franklin B, Cascio W, et al. Air pollution and cardiovascular disease: a statement for healthcare professionals from the Expert Panel on Population and Prevention Science of the American Heart Association. Circulation 2004;109:2655-2671.  [CrossRef][ISI][Medline]
    2. Samet JM, Zeger SL, Dominici F, et al. The National Morbidity, Mortality, and Air Pollution Study. Part II: Morbidity and mortality from air pollution in the United States. Res Rep Health Eff Inst 2000;94:5-70.  [Medline]
    3. Dockery DW, Pope CA III, Xu X, et al. An association between air pollution and mortality in six U.S. cities. N Engl J Med 1993;329:1753-1759.  [Free Full Text]
    4. Pope CA III, Thun MJ, Namboodiri MM, et al. Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults. Am J Respir Crit Care Med 1995;151:669-674.  [Abstract]
    5. Pope CA III, Burnett RT, Thun MJ, et al. Lung cancer, cardiopulmonary mortality, and long-term exposure to fine particulate air pollution. JAMA 2002;287:1132-1141.  [Free Full Text]
    6. Krewski D, Burnett RT, Goldberg MS, et al. Reanalysis of the Harvard Six Cities Study and the American Cancer Society Study of Particulate Pollution and Mortality: a special report of the Institute's Particle Epidemiology Reanalysis Project. Cambridge, MA: Health Effects Institute, 2000.
    7. Abbey DE, Nishino N, McDonnell WF, et al. Long-term inhalable particles and other air pollutants related to mortality in nonsmokers. Am J Respir Crit Care Med 1999;159:373-382.  [Free Full Text]
    8. Hoek G, Brunekreef B, Goldbohm S, Fischer P, van den Brandt PA. Association between mortality and indicators of traffic-related air pollution in the Netherlands: a cohort study. Lancet 2002;360:1203-1209.  [CrossRef][ISI][Medline]
    9. Kaiser J. Showdown over clean air science. Science 1997;277:466-469.  [Free Full Text]
    10. Vedal S. Ambient particles and health: lines that divide. J Air Waste Manag Assoc 1997;47:551-581.  [ISI][Medline]
    11. Pope CA III, Dockery DW. Health effects of fine particulate air pollution: lines that connect. J Air Waste Manag Assoc 2006;56:709-742.  [ISI][Medline]
    12. Kunzli N, Medina S, Kaiser R, Quenel P, Horak F Jr, Studnicka M. Assessment of deaths attributable to air pollution: should we use risk estimates based on time series or on cohort studies? Am J Epidemiol 2001;153:1050-1055.  [Free Full Text]
    13. McMichael AJ, Anderson HR, Brunekreef B, Cohen AJ. Inappropriate use of daily mortality analyses to estimate longer-term mortality effects of air pollution. Int J Epidemiol 1998;27:450-453.  [Free Full Text]
    14. Pope CA III, Burnett RT, Thurston GD, et al. Cardiovascular mortality and long-term exposure to particulate air pollution: epidemiological evidence of general pathophysiological pathways of disease. Circulation 2004;109:71-77.  [ISI][Medline]
    15. Jerrett M, Burnett RT, Ma R, et al. Spatial analysis of air pollution and mortality in Los Angeles. Epidemiology 2005;16:727-736.  [CrossRef][ISI][Medline]
    16. Kunzli N, Jerrett M, Mack WJ, et al. Ambient air pollution and atherosclerosis in Los Angeles. Environ Health Perspect 2005;113:201-206.  [ISI][Medline]
    17. The Women's Health Initiative Study Group. Design of the Women's Health Initiative clinical trial and observational study. Control Clin Trials 1998;19:61-109.  [CrossRef][ISI][Medline]
    18. Langer RD, White E, Lewis CE, Kotchen JM, Hendrix SL, Trevisan M. The Women's Health Initiative Observational Study: baseline characteristics of participants and reliability of baseline measures. Ann Epidemiol 2003;13:Suppl 9:S107-S121.  [CrossRef][ISI][Medline]
    19. Curb JD, McTiernan A, Heckbert SR, et al. Outcomes ascertainment and adjudication methods in the Women's Health Initiative. Ann Epidemiol 2003;13:Suppl 9:S122-S128.  [CrossRef][ISI][Medline]
    20. Heckbert SR, Kooperberg C, Safford MM, et al. Comparison of self-report, hospital discharge codes, and adjudication of cardiovascular events in the Women's Health Initiative. Am J Epidemiol 2004;160:1152-1158.  [Free Full Text]
    21. Chen LH, Knutsen SF, Shavlik D, et al. The association between fatal coronary heart disease and ambient particulate air pollution: are females at greater risk? Environ Health Perspect 2005;113:1723-1729. [Erratum, Environ Health Perspect 2006;114:A21.]  [ISI][Medline]
    22. Maheswaran R, Elliott P. Stroke mortality associated with living near main roads in England and Wales: a geographical study. Stroke 2003;34:2776-2780.  [Free Full Text]
    23. Maheswaran R, Haining RP, Brindley P, et al. Outdoor air pollution and stroke in Sheffield, United Kingdom: a small-area level geographical study. Stroke 2005;36:239-243.  [Free Full Text]
    24. Wellenius GA, Schwartz J, Mittleman MA. Air pollution and hospital admissions for ischemic and hemorrhagic stroke among Medicare beneficiaries. Stroke 2005;36:2549-2553.  [Free Full Text]
    25. Moolgavkar SH, Luebeck EG. A critical review of the evidence on particulate air pollution and mortality. Epidemiology 1996;7:420-428.  [ISI][Medline]
    26. Abrahamowicz M, Schopflocher T, Leffondre K, du Berger R, Krewski D. Flexible modeling of exposure-response relationship between long-term average levels of particulate air pollution and mortality in the American Cancer Society study. J Toxicol Environ Health A 2003;66:1625-1654.  [CrossRef][ISI][Medline]
    27. Bhatnagar A. Environmental cardiology: studying mechanistic links between pollution and heart disease. Circ Res 2006;99:692-705.  [Free Full Text]
    28. Suwa T, Hogg JC, Quinlan KB, Ohgami A, Vincent R, van Eeden SF. Particulate air pollution induces progression of atherosclerosis. J Am Coll Cardiol 2002;39:935-942.  [Free Full Text]
  • Citing Articles

  • This article has been cited by other articles:

    • Briet, M., Collin, C., Laurent, S., Tan, A., Azizi, M., Agharazii, M., Jeunemaitre, X., Alhenc-Gelas, F., Boutouyrie, P. (2007). Endothelial Function and Chronic Exposure to Air Pollution in Normal Male Subjects. Hypertension 50: 970-976 [Abstract] [Full Text]  
    • Mills, N. L., Tornqvist, H., Gonzalez, M. C., Vink, E., Robinson, S. D., Soderberg, S., Boon, N. A., Donaldson, K., Sandstrom, T., Blomberg, A., Newby, D. E. (2007). Ischemic and Thrombotic Effects of Dilute Diesel-Exhaust Inhalation in Men with Coronary Heart Disease. NEJM 357: 1075-1082 [Abstract] [Full Text]  
    • Mittleman, M. A. (2007). Air Pollution, Exercise, and Cardiovascular Risk. NEJM 357: 1147-1149 [Full Text]  
    • Kabir, Z., Taylor-Robinson, D. C., Capewell, S. (2007). Decrease in U.S. Deaths from Coronary Disease. NEJM 357: 941-941 [Full Text]  
    • Kaufman, J. D. (2007). Air Pollution and Mortality: Are We Closer to Understanding the How?. Am. J. Respir. Crit. Care Med. 176: 325-326 [Full Text]  
    • Hoffmann, B., Moebus, S., Mohlenkamp, S., Stang, A., Lehmann, N., Dragano, N., Schmermund, A., Memmesheimer, M., Mann, K., Erbel, R., Jockel, K.-H., for the Heinz Nixdorf Recall Study Investigative G, (2007). Residential Exposure to Traffic Is Associated With Coronary Atherosclerosis. Circulation 116: 489-496 [Abstract] [Full Text]  
    • Lindsay, A. (2007). JournalScan. Heart 93: 773-774 [Full Text]  
    • Brook, R. D., Rajagopalan, S., Jerrett, M., Burnett, R. T., Kaufman, J. D., Miller, K. A., Sheppard, L. (2007). Air Pollution and Cardiovascular Events. NEJM 356: 2104-2106 [Full Text]  
    • (2007). From the Library. Br. J. Ophthalmol. 91: 704-704 [Full Text]  
    • (2007). Fine particle pollution linked to cardiovascular disease. BMJ 334: 283-283 [Full Text]  
    • Dockery, D. W., Stone, P. H. (2007). Cardiovascular Risks from Fine Particulate Air Pollution. NEJM 356: 511-513 [Full Text]  
    • (2007). Air Pollution and Cardiovascular Risk. Journal Watch Cardiology 2007: 5-5 [Full Text]  
  • Letters

  • To the Editor: In the report by Miller and colleagues on long-term exposure to air pollution and the incidence of cardiovascular events in women (Feb. 1 issue),1 the authors state that their robust findings (hazard ratio for death from cardiovascular disease, 1.76) cannot be explained by acute effects of particulate matter. Although particulate matter might subtly promote atherosclerosis,2 their findings in no way illustrate synergistic, long-term health consequences of exposure beyond acute effects.

    The largest portion of the observed cardiovascular morbidity and mortality is due to particulate matter as a "triggering event" within hours to weeks after exposure. Cohort studies1 relate long-term levels of particulate matter to events but provide no information regarding the time courses over which exposures actually cause outcomes. The differences between the results of time series (relative risk of death from cardiovascular disease approximately 1.01), which can provide similar data on mortality,3 and the results reported by Miller et al. are primarily likely to be due to underestimation of the true risk by time series, for multiple reasons. Moreover, case–crossover studies4 show that the risks within a single hour after exposure are similar in magnitude to those reported by Miller et al., that lowering pollution dramatically reduces mortality within only months,5 and that extending exposure lag-times to weeks yields findings similar to those of cohort studies. It is not biologically plausible that long-term exposure would increase mortality by a factor of 76 (or even by a factor of 2) because of cumulative health responses beyond acute effects (hours to weeks in duration).


    Robert D. Brook, M.D.
    University of Michigan
    Ann Arbor, MI 48106
    robdbrok@umich.edu


    Sanjay Rajagopalan, M.D.
    Ohio State University
    Columbus, OH 43210

    5 References

     
    To the Editor: Miller et al. overstate the risk of death from cardiovascular disease associated with exposure to particulate matter of less than 2.5 µm in aerodynamic diameter (PM2.5). The exposure increment of 10 µg per cubic meter for PM2.5 used in the study is not available for most American cities. This exposure increment has been used correctly to describe between-city exposures to PM2.51 or within-city exposures in Los Angeles,2 a megalopolis with unusually variable levels of PM2.5. The actual increment for PM2.5 within most cities would be much less. With 62 PM2.5 monitors covering 16 metropolitan areas around New York City,3 the 10th to 90th percentile exposure increment is 3.23 µg per cubic meter. The 10th to 90th percentile range of within-city deviations reported by Miller et al. is 3.3 µg per cubic meter. The authors also report that the within-city and between-city regression coefficients are different (P=0.07), probably because of the variation in PM2.5 across the United States, which is mostly due to secondary sulfate levels, whereas the variation within cities arises from traffic sources. The toxicity of these mixtures differs,4 and the exposure increment used for interpreting the hazard ratio should reflect this difference. Using an exposure increment of 3.3 µg per cubic meter on the basis of data for New York City and data from the study by Miller et al. yields a hazard ratio for death from cardiovascular disease of 1.31, not 2.28, as reported, which is consistent with prior research.1,2


    Michael Jerrett, Ph.D.
    University of California
    Berkeley, CA 94720-7360
    jerrett@berkeley.edu


    Richard T. Burnett, Ph.D.
    Health Canada
    Ottawa, ON K1A 0K9, Canada

    4 References

     
    The authors reply: The correspondents comment on the magnitude of the risk estimate in our study, emphasizing the mortality results. Our primary hypothesis concerned the effect of fine particulate matter on all incident cardiovascular events, for which the hazard ratio was 1.24 (95% confidence interval, 1.09 to 1.41). Beyond exposure considerations, there are important differences between prior studies and our research regarding the population under study and the outcomes assessed.

    Brook and Rajagopalan suggest that the effects on mortality we reported can be ascribed entirely to short-term exposure. Indeed, acute effects of air pollution are important and warrant additional study. Cohort studies cannot easily distinguish between acute and long-term effects, since such studies reflect both different time courses of the underlying exposure distribution and different exposure–risk relationships.1,2 The cohort design suggests that long-term exposure is important, and the toxicologic database3,4 suggests that air pollution may promote atherosclerosis. Additional research is needed to determine whether different time scales of exposure share pathophysiological underpinnings.

    Jerrett and Burnett are concerned that our use of an exposure increment of 10 µg per cubic meter for PM2.5 provides an exaggerated estimate of the effect of particulate matter. For ease of comparison with published results from studies of previous national cohorts,5 we reported estimates using the exposure increment conventionally used in those studies. The increment of 10 µg per cubic meter lies well within the range of the individual exposure increments (3.4 to 28.3 µg per cubic meter; 10th to 90th percentile, 9.1 to 18.3) among participants in the Women's Health Initiative Observational Study. Since we found no reason to doubt a linear relationship between pollutants and effects, readers can and should scale the exposure increment to their own scientific context.

    We agree with Jerrett and Burnett that the sources and components of particulate matter are likely to be important for determining toxicity and that much variation within cities is attributable to traffic sources. Our study, like prior work, does not provide specific guidance on sources and components.


    Joel D. Kaufman, M.D., M.P.H.
    Kristin A. Miller, M.S.
    Lianne Sheppard, Ph.D.
    University of Washington
    Seattle, WA 98195
    joelk@u.washington.edu

    5 References

 rightContentBox

COMMENTS AND QUESTIONS? PLEASE CONTACT US.

THE NEW ENGLAND JOURNAL OF MEDICINE IS OWNED, PUBLISHED, AND COPYRIGHTED © MASSACHUSETTS MEDICAL SOCIETY.

ALL RIGHTS RESERVED.