In 1999, Congress directed the Agency for Healthcare Research and Quality (AHRQ) to produce an annual report, starting in 2003, to track "prevailing disparities in health care delivery as it relates to racial factors and socioeconomic factors in priority populations." Although the emphasis is on disparities related to race, ethnicity, and socioeconomic status (SES), this directive includes a charge to examine disparities in "priority populations"—groups with unique health care needs or issues that require special focus. The National Healthcare Disparities Report (NHDR) was designed and produced by AHRQ, with support from the Department of Health and Human Services (HHS) and private-sector partners, to respond to this legislative mandate.
The first National Healthcare Disparities Report (NHDR), released in 2003, was a comprehensive national overview of disparities in health care among racial, ethnic, and socioeconomici groups in the general U. S. population and within priority populations. The 2004 NHDR initiated a second critical goal of the report series—tracking the Nation's progress toward the elimination of health care disparities. The 2005 NHDR introduced a set of core measures, a variety of new compositeii measures, and methods for tracking changes in disparities that allow for the identification of specific disparities that are shrinking and disparities that are widening.
This 2006 NHDR continues the improvement of data, measures, and methods used to meet these goals. New databases and measures have been added to provide a more comprehensive assessment of quality and disparities in the Nation. Methods for quantifying changes in health care over time and changes in disparities have been refined. In addition, new composite measures are tracked that make information about quality and disparities easier to comprehend. The 2006 NHDR continues to focus on a subset of core measures that comprise the most important and scientifically supported measures in the full NHDR measure set. Finally, as in previous NHDRs, references have been systematically updated (that is, annual reports and other regularly released publications have been updated as appropriate, and a wide breadth of peer-reviewed journals and electronically published articles have been searched for inclusion as references).
The NHDR supports HHS Secretary Mike Leavitt's 500-Day Plan to fulfill the President's vision of a healthier America, specifically in the areas of eliminating inequalities in health care and better transparency of health care quality information. As in previous years, the 2006 NHDR was planned and written by AHRQ staff with the support of AHRQ's National Advisory Council and the Interagency Work Group for the NHDR, which includes representatives from every operating division of the Department of Health and Human Services In addition, ad hoc groups were convened to address specific issues such as the creation of composite measures and the refinement of definitions of persons with disabilities.
i Socioeconomic disparities include differences in education and income levels.
ii Composite measures provide readers with a summarized picture of some aspect of health care by combining information from multiple component measures. For example, the NHDR composite measure for "complications following surgery" includes measures for persons who develop pneumonia, bladder infection, and blood clots in the legs following surgery.
The basic structure of the 2006 NHDR is unchanged from the 2005 NHDR and consists of the following:
Appendixes are available online:
Consistent with the goal of improving quality of and access to health care for all Americans, a number of improvements in the quality and accessibility of the NHDR are made each year. Improvements include changes to report format, changes to the measure set, addition of new data sources, expanded analyses to include Hispanic subpopulations and uninsurance, and a summary of disparities.
The 2006 NHDR and its companion NHQR continue to be formatted as chartbooks. Although needed to assess health care in America comprehensively, the large number of measures tracked in the reports may sometimes be confusing and overwhelming for users. Hence, the 2006 reports continue to focus on a smaller subset of core measures. Other modifications have also been made to make the information in the reports easier to understand.
Core measures. For the 2005 reports, the Interagency Work Group was convened to select a group of measures from the full measure sets on which the reports would present findings each year. In 2006, the work group made additional changes to the core measure set. For some topics, the group favored alternating sets of core measures. These measures relate to cancer prevention and childhood preventive services. Alternating measures are listed in Table 1.1.
| Reported in the 2006 NHDR and NHQR: | Reported in 2005 NHDR and NHQR* |
|---|---|
|
|
* The measures listed in this column will be reported again in the 2007 reports.
The core measures of patient safety also underwent modifications. Several measures included in last year's report were not available this year. New composite measures were developed to summarize information across several individual patient safety measures (described below). Other new measures became available that cover important aspects of patient safety. The combination of these changes yielded this year's patient safety core measures:
All core measures fall into two categories: process measures, which track receipt of medical services, and outcome measures, which in part reflect the results of medical care (Table 1.2). Both types of measures are not reported for all conditions due to data limitations. For example, data on HIV care are suboptimal; hence, no HIV process measures are included as core measures. In addition, not all core measures are included in trending analysis because 2 or more years of data were not available.
| Section | Process Measures | Outcome Measures |
|---|---|---|
| Effectiveness - Cancer |
|
|
| Effectiveness - Diabetes |
|
|
| Effectiveness - End Stage Renal Disease |
|
|
| Effectiveness - Heart Disease |
|
Acute myocardial infarction mortality |
| Effectiveness - HIV and AIDS |
|
|
| Effectiveness - Maternal and Child Health |
|
|
| Effectiveness - Mental Health and Substance Abuse |
|
|
| Effectiveness - Respiratory Diseases |
|
|
| Effectiveness - Nursing Home, Home Health, and Hospice Care |
|
|
| Patient Safety |
|
|
| Timeliness |
|
|
| Patient Centeredness |
|
Presentation. Each section in the 2006 report begins with a description of the importance of the section's topic in a standardized format. New this year is an assessment of the cost effectiveness of different clinical preventive services. These estimates come from a recent review by the National Commission on Prevention Priorities.1 Cost effectiveness is measured as the average net cost of each quality adjusted life year (QALY)iii that is saved by a particular health intervention. A lower cost per QALY saved indicates a greater degree of cost effectiveness while beneficial preventive services that fully cover their costs are labeled as cost saving.
After introductory text, chart figures and accompanying findings highlight a small number of measures relevant to this topic. When data are available, these charts typically show contrasts by:
Almost all core measures and composite measures have multiple years of data, so figures typically illustrate trends over time. When data support stratified analyses, a figure showing racial and ethnic differences stratified by SES is often included. For some measures with supporting data, regression models were run and used to help interpret bivariate and stratified results. In addition, figures showing odds ratios adjusted for age, gender, race, ethnicity, income, education, insurance, and residence location are presented for two measures.vii Figures include a note about the reference group for population-based measures and the denominator for measures based on services or events.
iii QALY is a measure of survival adjusted for its value: 1 year in perfect health is equal to 1.0 QALY, and a year in poor health would be something less than 1.0.
iv "Asian" includes "Asian or Pacific Islander" (API) when information is not collected separately for each group.
v Not all data sources used in the NHDR collect data by race and ethnicity separately (i.e., allowing for comparisons of Blacks with Whites and Hispanics with non-Hispanic Whites). When this is the case, comparisons are made by combined racial/ethnic categories (i.e., comparing non-Hispanic Blacks and Hispanics with non-Hispanic Whites).
vi Throughout this report, "poor" is defined as having family incomes less than 100% of the Federal poverty level; "near poor," between 100% and 199%; "middle income," between 200% and 399%; and "high income," 400% or more of the Federal poverty level.
vii The measures are obese adults given advice about exercise and individuals having a usual primary care provider.
As in last year's report, findings presented in the text meet report criteria for importanceviii; comparisons not discussed in text do not meet these criteria. However, absence of differences that meet criteria for importance should not be interpreted as absence of disparities. Often, large differences between groups did not meet criteria for statistical significance because of small sample sizes and limited power. In addition, significance testing used in this report does not take into account multiple comparisons. To facilitate linkage to other Federal reporting initiatives, this report indicates where NHDR measures are also tracked in Healthy People 2010.
viii Criteria for importance are that the difference is statistically significant at the alpha=0.05 level, two-tailed test and that the relative difference is at least 10% different from the reference group when framed positively as a favorable outcome or negatively as an adverse outcome.
NHDR data sources include surveys of individuals and health care facilities and extract from surveillance, vital statistics, and health care organization data systems. Table 1.3 lists all data sources and includes five new data sources. Standardized suppression criteria were applied to all databases to support reliable estimates.ix New data added this year come from:
ix Estimates based on sample size fewer than 30 or with relative standard error greater than 30% are considered unreliable and suppressed. Databases with more conservative suppression criteria are allowed to retain them.
Surveys collected from populations:
|
Data collected from samples of health care facilities and providers:
|
Data extracted from data systems of health care organizations:
|
Data from surveillance and vital statistics systems:
|
* This file is designed to provide national estimates of disparities in the AHRQ Quality Indicators using weighted records from a sample of hospitals from the following 22 States: AZ, CA, CO, CT, FL, GA, HI, KS, MD, MA, MI, MO, NJ, NY, PA, RI, SC, TN, TX, VA, VT, and WI.
New measures. The measure sets used in the 2006 NHDR and NHQR have been improved in several ways. First, a handful of measures were modified to reflect more current standards of care. Second, age adjustmentx for a number of measures was updated. For example, to enhance the comparability of measures of diabetes care from MEPS, the Behavioral Risk Factor Surveillance System (BRFSS), and the National Health and Nutrition Examination Survey (NHANES), these measures now apply the same age adjustment methodology among persons age 40 and over with diabetes.xi Finally, a number of new measures were added to fill identified gaps, including:
Measure revisions were proposed and reviewed in meetings of the Interagency Work Group for the NHDR, which includes representation from across HHS.
x Age-adjusted measures are labeled as such. All other measures are not age adjusted.
xi Prior to 2006, these measures tracked persons age 18 and over.
xii This is a new core measure.
xiii Because this is not a periodic survey, the four measures from this survey will not be permanently added to the measure set.
Composite measures. Composite measures provide readers with a summarized picture of some aspect of health care by combining information from multiple component measures. Policymakers and others have voiced their support for composite measures because they can be used to facilitate understanding of information from many individual measures. The effort to develop new composites is ongoing; and this year, a number of new composite measures were added. Composite measures now make up about 20% of the core measures. New composite measures included in the 2006 reports and the individual component measures they aggregate are shown in Table 1.4. Future reports will include more composite measures.
| Composite measure | Individual measures forming composite | Model |
|---|---|---|
| Receipt of three recommended diabetic services* |
|
Appropriateness |
| Childhood immunization |
|
Appropriateness |
| Recommended hospital care for heart attack |
|
Opportunities |
| Recommended hospital care for heart failure |
|
Opportunities |
| Recommended hospital care for pneumonia |
|
Opportunities |
| Timing of antibiotics to prevent postoperative wound infection |
|
Opportunities |
| Patient - provider communication problems |
|
CAHPS® |
| Communication with doctors in the hospital |
|
CAHPS® |
| Communication with nurses in the hospital |
|
CAHPS® |
| Communication about medications in the hospital |
|
CAHPS® |
| Discharge information from the hospital |
|
CAHPS® |
| Postoperative complications |
|
Additive |
| Complications of central venous catheters |
|
Additive |
* This composite measure was modified between the 2004 and 2005 reports. Starting with the 2005 composite, two tests, flu vaccination and lipid profile, were omitted due to differences in the manner in which they were collected. The current composite measure on diabetes care focuses on the receipt of three processes for which the best data are available: HbA1c testing, retinal eye examination, and foot examination in the past year. Starting in 2006, the target age group for this measure changed from age 18 and older to age 40 and older.
When possible, an appropriateness model is used to create composite measures. In this model, the denominator is the number of patients who should receive the services included in the composite, and the numerator is the number of patients who receive all of these services. The composite measure is presented as the percentage of patients who receive all services recommended to them. Because no partial credit is given for incomplete care, this model is sometimes referred to as an "all-or-none" approach. The appropriateness model is attractive to patients, who naturally desire to receive every appropriate service.4 One example of this model is the diabetes composite, in which a patient who receives only one or two of the three services would not be counted as having received the recommended care.
Sometimes, insufficient data are available to apply an appropriateness model. In these instances, an opportunities model developed by Qualidigm5 and used in the CMS Premier Hospital Quality Incentive Demonstration6 and for public reporting by the Rhode Island Department of Health7 is used. The model assumes that each patient needs and has the opportunity to receive one or more processes of care but that not all patients need the same care. The denominator for an opportunities model composite is the sum of these opportunities to receive appropriate care across a panel of process measures. The numerator is the sum of the appropriate care that is actually delivered. The composite measure is typically presented as the proportion of appropriate care that is delivered.
For example, recommended hospital care for heart failure includes evaluation of left ventricular ejection fraction and ACE inhibitor for patients with left ventricular systolic dysfunction. This represents two opportunities for providing appropriate care. The number of patients who should have an evaluation of left ventricular ejection fraction is added to the number of patients who should receive an ACE inhibitor to calculate the total number of opportunities for providing appropriate care. The number of patients who actually receive an evaluation of left ventricular ejection fraction is added to the number of patients who actually receive an ACE inhibitor to calculate the number of opportunities for providing care for which appropriate care was actually delivered. The composite is created by dividing the number of opportunities for care for which appropriate care was actually delivered by the total number of opportunities for care.
Measures from the CAHPS® (Consumer Assessment of Healthcare Providers and Systems8) surveys have their own method for computing composite measures that has been in use for many years. These composite measures average individual components of patient experiences of care. These composite measures are typically presented as the proportion of respondents who reported that providers sometimes or never, usually, or always performed well.
Two new composite measures relate to rates of complications of hospital care—postoperative complications and complications of central venous catheters. For these complication rate composites, an additive model is used, which sums together individual complication rates. Thus, for these composites, the numerator is the sum of individual complications and the denominator is the number of patients at risk for these complications. The composite rates are presented as the overall rate of complications. The postoperative complications composite is a good example of this type of composite measure; if 50 patients had a total of 15 complications between them (regardless of their distribution), the composite score would be 30%.
Trends in health care quality and access. As in previous NHDRs, the 2006 report uses the earliest and most recent available NHDR data estimates for each measure to calculate average annual rate of change for the general U.S. population and for each racial, ethnic, and socioeconomic group. Consistent with Health, United States, the geometric rate of change, which assumes the same rate each year between the two time periods, has been calculated for the 2006 NHDR and NHQR.xiv
Two criteria are applied to determine whether a significant trend exists:
Only changes over time that meet these two criteria are discussed in the 2006 reports.
xiv The geometric rate of change assumes that a measure increases or decreases at the same rate during each year between two time periods. It is calculated using the following formula: [(Vy/Vz)^1 / N-1] X 100, where Vy is the most recent year's value, Vz is the most distant year's value, and N is the number of years in the interval.
One additional constraint relates to trends among specific racial and ethnic groups. Some Federal databases completed transition by 2003 (as required) to the new Federal standards for racial and ethnic data during years covered by the NHDR. These new standards created two separate racial categories: "Asian" and "Native Hawaiian or Other Pacific Islander." In addition, individuals could report more than one race, which significantly affected estimates for the "American Indian or Alaska Native" category. In contrast, effects on estimates for Whites, Blacks, and Hispanics were proportionately much smaller. Consequently, the 2006 NHDR shows shorter trends (i.e., fewer years of data) for groups directly or significantly affected by the new standards such as Asian, Native Hawaiian or Other Pacific Islander, American Indian or Alaska Native, and multiple race individuals.
Hispanic subpopulations. As with all U.S. populations, racial and ethnic minority groups that are the focus of the NHDR can be highly heterogeneous. Data are typically not available to examine different racial and ethnic groups in greater detail. One exception relates to Hispanic subpopulations for which increasing amounts of data are available. The 2006 NHDR shows information from MEPS related to health care differentiating Hispanics of Mexican, Central or South American, Puerto Rican, and Cuban descent. These analyses are presented in the section on racial and ethnic minorities in Chapter 4, Priority Populations.
Uninsurance. Lack of health insurance is widely recognized as a risk factor for poorer quality of health care and worse access to health care. Previous reports have included analyses of uninsured compared with privately insured individuals but did not bring these findings together into a specific section of the reports. This year, a focus on disparities related to insurance status is introduced. These analyses are presented in the section on low income groups in Chapter 4, Priority Populations.
In the 2006 NHDR, efforts to summarize disparities have been further refined.
Quantifying disparities. In the Highlights and in Chapter 4, Priority Populations, the extent of disparities across the core measures is summarized for Blacks, Hispanics, Asians, NHOPIs, AI/ANs, and the poor. Racial, ethnic, and socioeconomic groups are compared with a designated reference group for each core measure; each group could receive care that is worse than, about the same as, or better than the reference group. For each group, the percentages of measures for which the group received worse care, similar care, or better care were calculated. Health care utilization measures are difficult to interpret and were excluded when summarizing disparities in access to care.xv In Chapter 4, Priority Populations, which presents information on each population separately, all core measures are used when summarizing disparities for each group. However, in the Highlights, where multiple groups are presented side by side, only core measures with estimates for all racial and ethnic groups are used to facilitate comparisons across the groups. An exception is made for income comparisons of quality measures because much less information is available for these groups.
As in the 2005 NHDR, rates relative to standard reference groups are used to quantify the magnitude of disparities and to identify the largest disparities faced by specific groups. For each group, the group rate was divided by the reference group rate to calculate the relative rate for each core measure. The median relative rate across core measures is presented in Chapter 4 as another way of summarizing the magnitude of disparities in quality and access; the relative rates are also presented to identify potential areas for improvement.
Trends in disparities. The method for summarizing trends in disparities introduced in the 2005 NHDR is improved in the 2006 NHDR. For each core measure, racial, ethnic, and socioeconomic groups are compared with a designated reference group at different points in time. Consistent with Healthy People 2010, disparities are measures in relative terms as the percent difference between each group and a reference group; changes in disparity are measured by subtracting the percent difference from the reference group at the baseline year from the percent difference from the reference group at the most recent year. The change in each disparity is then divided by the number of years between the baseline and most recent estimate to calculate change in disparity per year. Thus, in determining change:
xv Interpreting health care utilization data is more complex than analyzing data on patient perceptions of access to care. Along with access to care, health care utilization is strongly affected by health care need and patient preferences and values. In addition, greater use of services does not necessarily indicate better care. In fact, high use of some inpatient services may reflect impaired access to outpatient services. For these reasons, measures of health care utilization are excluded from summaries of access to health care.
In Chapter 4, Priority Populations, which presents information on each population separately, all core measures are used when summarizing trends in disparities for each group. However, in the Highlights where multiple groups are presented side by side, only core measures with estimates for all racial and ethnic groups over time are used to facilitate comparisons across the groups. As noted above, an exception is made for income comparisons of quality measures because much less information is available for these groups.
1. Maciosek MV, Coffield AB, Edwards NM, et al. Priorities among effective clinical preventive services: results of a systematic review and analysis. Am J Prev Med 2006 Jul;31(1):52-61.
2. Connor SR, Teno J, Spence C, Smith N. Family evaluation of hospice care: results from voluntary submission of data via website. J Pain Symptom Manage 2005 Jul;30(1):9-17.
3. Agency for Healthcare Research and Quality. CAHPS® hospital survey chartbook: what patients say about their experiences with hospital care. Report of summary data from hospital test sites. Prepublication copy; March 2006.
4. Nolan T, Berwick DM. All-or-none measurement raises the bar on performance. JAMA 2006 Mar 8;295(10):1168-70.
5. Scinto JD, Galusha DH, Krumholz HM, Meehan TP. The case for comprehensive quality indicator reliability assessment. J Clin Epidemiol 2001 Nov; 54(11):1103-11.
6. Centers for Medicare & Medicaid Services. Rewarding superior quality care: the Premier Hospital Quality Incentive Demonstration. Centers for Medicare & Medicaid Services Fact Sheet; updated January 2006. Available at: http://www.cms.hhs.gov/HospitalQualityInits/.
7. Rhode Island Department of Health. Hospital Performance in Rhode Island. Technical Report, 2nd ed. July 2003. Available at: http://www.health.ri.gov/chic/performance/quality/quality17tech.pdf [PDF Help]. Accessed July 19, 2006.
8. Hargraves J, Hays RD, Cleary PD. Psychometric properties of the Consumer Assessment of Health Plans Study (CAHPS®) 2.0 adults core survey. Health Serv Res 2003 Dec;38(6 Pt 1):1509-27.