Section 3. Examining Waste/Poor Quality

Cost of Poor Quality or Waste in Integrated Delivery System Settings

 

Our examination of waste/poor quality in health care is guided by the Chain of Effect for Quality as described in Section 2.4 and depicted in Exhibit 3. Specifically, we focus on three distinct levels to exemplify approaches for culling out waste/poor quality in health care: the Population Level, the Microsystem/Episode Level, and the Patient (care delivery) Level (Exhibit 7). These approaches for examining waste are linked to our analytic approach in Exhibit 8. For these three areas, we provide a more detailed description of the approach together with specific examples of how these approaches can be applied (and estimates when appropriate). 

Exhibit 7. Identifying waste by levels

ApproachLevel to Address Waste
National rates of potential overuse and underusePopulation Level
Analysis of waste represented by overuse, as reflected in regional variabilityPopulation Level
Analysis of the cost of errors and adverse eventsMicrosystem/Episode Level (health delivery organizations)
Analysis of ATP, Six Sigma target areasMicrosystem/Episode Level (health care delivery organizations, microsystems)
Lean™ ObservationsPatient Level (microsystems, individuals)

 

Exhibit 8. Efficiency/waste metric and analytic approach

Inefficiency/Waste MetricAnalytical Approach
Dartmouth AtlasSix Sigma, ATPTPSCost of Unusual Occurrences
Cost per unitNoYesYesNo
Units per caseNoYesYesYes
Number of casesYesNoNoNo

Return to Contents

3.1. Estimating Waste at the Population Level—the Dartmouth Atlas

In 1973, Wennberg and Gittelsohn published a seminal paper documenting massive geographic variation in the rates at which Americans are hospitalized. He later organized the Center for the Evaluative Clinical Sciences (CECS), based at Dartmouth University in Hanover, New Hampshire. In 1999, CECS first published the Dartmouth Atlas, which documents ongoing, massive variation in care delivery across the United States, as reflected in hospital admission rates. The CECS group has updated the Dartmouth Atlas on a 2- to 3-year schedule ever since.

Several years ago, Wennberg and the CECS group shifted the focus of their variation research to Medicare patients at the end of life (Wennberg et al., 2002). They have shown that (1) Medicare patients exhibit a very high degree of loyalty to a particular hospital and the physicians associated with that hospital, with about 90 percent of all services to a particular patient, on average, delivered through a single facility; and (2) care within a particular facility is consistent over time, despite major geographic variation among facilities. For example, health resource consumption in the last 2 months before death, which accounts for more than 20 percent of all Medicare expenditures, accurately predicts care resource consumption during the last 6 months of life, and accurately predicts health resource consumption during the last 2 years of life, well beyond the period associated with a final terminal illness. The CECS approach thus provides a unique method to account for and remove patient factors when measuring differences in clinical or cost outcomes. It directly adjusts for age, gender, ethnicity, and chronic disease burden, but then centers on patients who all are at an equivalent health outcome—all patients in this class have died. It then demonstrates that resource consumption at a particular hospital for this class of patients accurately predicts resource consumption at the same facility in other time periods before terminal illness (Wennberg, 2005; Wennberg et al., 2002).

The CECS analysis identified three classes of care: effective care, supply-sensitive care, and preference-sensitive care. "Effective care" refers to disease entities with good evidence for effective treatment, such as total hip arthoplasty following hip fracture. Effective care tends to be generally underutilized, but shows very little geographic variation. "Supply-sensitive care" centers on 13 chronic conditions, accounting for more than 50 percent of all Medicare expenditures (Exhibit 9). "Preference-sensitive care" centers on an additional 10 elective surgical procedures (Exhibit 10), where patients have legitimate choices among surgical, medical, or "watchful waiting" options. Together, supply-sensitive and preference-sensitive care account for almost 80 percent of all hospital-associated Medicare expenditures and explain the high rates of cost variation that the CECS group has documented. High resource utilization directly and significantly correlates with high rates of patient visits to specialists, with higher testing rates, higher hospital use rates, and more days spent in intensive care units. In turn, utilization of each of those resources was very strongly correlated with their availability in the geographic community. Fisher et al. (2003) demonstrated that high utilization for supply-sensitive conditions is associated with worse medical outcomes (mortality rates about 2 percent higher than expected).

Exhibit 9. Supply-sensitive chronic conditions (as identified by the Dartmouth CECS group)

Supply Sensitive Chronic ConditionsPercentage of Medicare Patients Exhibiting Each Condition at the End of Life
Congestive heart failure32.7%
Cancer: solid tumors27.6%
Chronic pulmonary disease22.5%
Dementia14.8%
Nutritional deficiencies10.5%
Coronary artery disease8.6%
Chronic renal failure5.9%
Cancer: lymphomas and leukemias5.5%
Peripheral vascular disease5.2%
Functional impairment2.6%
Diabetes with end organ damage2.5%
Severe chronic liver disease2.0%
AIDS0.1%

 

Exhibit 10. Preference-sensitive conditions associated with elective surgical procedures (as identified by the Dartmouth CECS group)

  1. Benign prostatic hypertrophy
  2. Abnormal uterine bleeding/uterine fibroids (hysterectomy)
  3. Breast cancer
    • Early breast cancer: chemotherapy and hormone therapy
    • Early breast cancer: breast-sparing surgery
    • Breast cancer: breast reconstruction
    • Breast cancer: DCIS
    • Breast cancer: metastatic phase
  4. Coronary artery disease
    • Treatment choices
    • Chronic care
  5. Colorectal cancer screening
  6. Low back pain
    • Acute management
    • Chronic low back pain: treatment choices
    • Herniated disc
    • Spinal stenosis
  7. Hip osteoarthritis
  8. Knee osteoarthritis
  9. Prostate cancer/PSA testing
  10. Bariatric weight-loss surgery

In the latest release of the Dartmouth Atlas (Wennberg et al., 2006), the CECS group identified two integrated delivery systems—the Mayo Clinic hospitals and Intermountain Healthcare—as having the most efficient care delivery in the nation and excellent associated clinical outcomes. While their analysis focused exclusively on supply-sensitive conditions, they estimated that total Medicare costs to the nation (Part A and Part B) would fall by 32 percent if all other hospitals were to adopt similar care patterns. Preference-sensitive conditions offer even more savings. Internal CECS data suggest that, when patients are offered complete, fair, and unbiased choices around preference-sensitive conditions, procedure utilization rates fall by 20 percent to 60 percent.

We classified Dartmouth Atlas estimates of supply-induced demand as Population Level waste: health services that consumed resources but did not improve patients' clinical outcomes. To the extent that care practices for Medicare patients represent general patterns of care delivery and resource consumption, as the CECS analysis suggests, Medicare-associated waste levels would apply to total health care costs for the country. Supply-induced demand represents Chassin's "overuse" category. In Deming's scheme, it is inefficiency waste. It results from increased frequency of unit and bundled services, as described above.

The same Dartmouth Atlas report extended the CECS supply-sensitive variation measurement methodology to the level of individual hospitals (Wennberg et al., 2002). The Dartmouth Atlas Web site (http://www.dartmouthatlas.org) allows hospitals to estimate their rates of supply-induced overuse waste. The focus of our report is hospital care alone, so we excluded potential waste in Medicare Part B physician visits. On the basis of hospital costs alone, if the entire Medicare program achieved the blended Mayo Clinic/Intermountain Healthcare utilization rates, then Medicare Part A costs would fall by 14 percent.

Exhibit 11 presents the CECS methodology and provides blended base utilization rates for the combined Mayo Foundation and Intermountain Healthcare systems, compared with national averages. Exhibit 12 applies the Mayo-Intermountain baseline to the Medicare total hospital reimbursements for Providence Health System facilities to demonstrate how the method could be used to estimate Population Level waste for any U.S. hospital. These estimates are conservative, in that they exclude Medicare Part B payments, where the effect is larger; and they do not (yet) include estimates of overuse associated with preference-induced demand.  

Exhibit 11. Medicare hospital reimbursements at Mayo Foundation and Intermountain Healthcare Hospitals (1999-2003 data)

Hospital/SystemLocationLoyaltyDeathsPer DecedentRatio to U.S. Average
Total ReimbursementHospital DaysReimbursement Per Hospital Day$=Daysx$/Day
Rochester Methodist HospitalRochester, MN79.488937,23327.01,3771.52=1.13x1.35
St. Luke's HospitalJacksonville, FL88.0220424,90620.91,1931.02=0.87x1.17
St. Mary's Hospital-RochesterRochester, MN86.7431429,73322.91,2991.21=0.96x1.27
Mayo Clinic HospitalPhoenix, AZ84.6148424,24018.61,3040.99=0.78x1.27
Austin Medical CenterAustin, MN89.695321,84519.91,0970.89=0.83x1.07
Luther HospitalEau Claire, WI93.1169019,00117.21,1060.78=0.72x1.08
Franciscan Skemp-La CrosseLa Crosse, WI95.1132619,34517.61,0980.79=0.74x1.07
Fairmont Community HospitalFairmont, MN91.758418,24917.81,0270.75=0.74x1.00
Immanuel-St. Joseph'sMankato, MN92.8148518,40820.19170.75=0.84x0.90
Naeve HospitalAlbert Lea, MN92.592018,12916.31,1100.74=0.68x1.09
Myrtle Werth HospitalMenomonie, WI91.351017,42915.41,1330.71=0.64x1.11
Lake City Medical CenterLake City, MN89.816120,38317.01,1980.83=0.71x1.17
Waseca Medical CenterWaseca, MN82.120718,73314.01,3420.76=0.59x1.31
Bloomer Medical CenterBloomer, WI85.317218,21816.41,1130.74=0.69x1.09
Floyd County Memorial HospitalCharles City, IA87.933717,63316.51,0680.72=0.69x1.04
Barron Memorial Medical CenterBarron, WI88.331516,45614.61,1270.67=0.61x1.10
Springfield Medical CenterSpringfield, MN92.723416,34414.51,1260.67=0.61x1.10
St. James Health ServicesSt. James, MN90.914015,96115.91,0060.65=0.67x0.98
Franciscan Skemp-SpartaSparta, WI84.219213,72112.41,1070.56=0.52x1.08
Mayo Foundation Totals 88.91811723,43019.71,1880.96=0.82x1.16
LDS HospitalSalt Lake City, UT90.1186322,32618.01,2380.91=0.75x1.21
Dixie Regional Medical CenterSt. George, UT94.0166520,13517.21,1730.82=0.72x1.15
Utah Valley Regional Med CenterProvo, UT93.4164720,39219.21,0620.83=0.80x1.04
Alta View HospitalSandy, UT86.973418,64215.81,1830.76=0.66x1.16
McKay-Dee Hospital CenterOgden, UT94.8172618,79615.51,2140.77=0.65x1.19
Cottonwood HospitalMurray, UT90.2126318,03716.81,0740.74=0.70x1.05
Logan Regional HospitalLogan, UT93.174118,00815.51,1640.74=0.65x1.14
American Fork HospitalAmerican Fork, UT91.454716,42912.01,3650.67=0.50x1.33
Cassia Regional Medical CenterBurley, ID92.748217,30119.48930.71=0.81x0.87
Valley View Medical CenterCedar City, UT91.828717,48311.91,4750.71=0.50x1.44
Garfield Memorial HospitalPanguitch, UT92.010317,20713.21,3080.70=0.55x1.28
Heber Valley Medical CenterHeber City, UT88.28816,97411.91,4240.69=0.50x1.39
Delta Community Medical CenterDelta, UT89.19516,91013.61,2460.69=0.57x1.22
Sanpete Valley HospitalMt Pleasant, UT89.311715,68512.51,2550.64=0.52x1.23
Sevier Valley HospitalRichfield, UT90.626314,25512.21,1660.58=0.51x1.14
Intermountain Healthcare Totals 92.01162119,25416.61,1630.79=0.69x1.14
Combined Mayo/Intermountain 90.12973821,79818.51,1780.89=0.77x1.15
U.S. Average   24,49123.91,0231.00=1.00x1.00

 

Exhibit 12. Medicare total hospital reimbursements for Providence Health System facilities, using the Mayo Clinic/Intermountain merged baseline to estimate potential Population Level waste (1999-2003 data)

Hospital/SystemLocationLoyaltyDeathsPer DecedentRatio to Mayo/IntermountainProportion waste
Total ReimbursementHospital DaysReimbursement Per Hospital Day$=Daysx$/Day
Providence Holy Cross Med CenterMission Hills, CA85.999635,18029.41,1981.61=1.59x1.020.38
Providence St. Joseph Med CenterBurbank, CA91.6258734,54228.91,1961.58=1.56x1.020.37
Little Company of Mary HospitalTorrance, CA87.3177031,23825.91,2041.43=1.40x1.020.30
San Pedro Peninsula HospitalSan Pedro, CA89.987833,47229.51,1351.54=1.60x0.960.35
Providence Alaska Medical CenterAnchorage, AK93.1122927,39023.31,1771.26=1.26x1.000.20
Providence St. Vincent Med CenterPortland, OR90.9164521,22917.21,2350.97=0.93x1.05-0.03
Providence Everett Medical CenterEverett, WA92.2209721,61514.91,4520.99=0.81x1.23-0.01
Providence Portland Medical CenterPortland, OR90.2162220,40316.11,2660.94=0.87x1.07-0.07
Providence St. Peter HospitalOlympia, WA92.6186519,22513.31,4470.88=0.72x1.23-0.13
Providence Centralia HospitalCentralia, WA93.3109119,08015.51,2350.88=0.84x1.05-0.14
Providence Medford Medical CenterMedford, OR92.3121417,78815.01,1850.82=0.81x1.01-0.23
Providence Seaside HospitalSeaside, OR87.926222,57916.41,3781.04=0.89x1.170.03
Providence Newberg HospitalNewberg, OR90.117319,79813.81,4380.91=0.75x1.22-0.10
Providence Milwaukie HospitalMilwaukie, OR85.327418,11611.91,5160.83=0.64x1.29-0.20
Providence Health System 90.81770325,34320.31,2471.16=1.10x1.060.14

Return to Contents

3.2. Estimating Waste at the Microsystem/Episode Level—Quality Improvement Analysis

The ATP projects represent work by representatives of many U.S. health systems to target areas of waste and poor quality. The ATP projects span a number of years; our analysis used 58 projects for which summary reports were available. Each project was categorized by its major area of focus, based on the project summary report. The Six Sigma projects were conducted over 3 years at Providence Health System. Some projects were selected as "training" projects for the initial Six Sigma rollout, but there is reason to believe that the projects are representative of the kinds of waste reduction efforts found. Each project was categorized by its major area of focus based on materials presented at hospital briefing sessions attended by the author (BB) and shared with the other authors.

A major goal of the Six Sigma projects has been reduced delays (improved throughput). Throughput is the key to more efficient use of facilities and labor, both high cost factors in health care. Each additional day in the hospital requires additional nursing hours, blood draws, meals, medical consults, and so on. Typically these units per case are in proportion to the additional time spent.

Increased throughput can also be said to lower a facility's cost per unit by spreading fixed cost components (e.g., the cost of new equipment, the cost of hiring and training staff) over a larger volume. The amount of unit cost savings will depend on whether the cost of a lab test or a fully delivered medication is lower when the lab or the nursing floor is running at higher capacity.

Throughput also has second-order effects. Each additional day involves new staff that must be oriented to the patient, with attendant handoff problems and costs. Several projects targeted redundant information gathering that was the result of delays. Longer stays also mean additional chances for infections or other adverse events.

Third-order effects involve the administrative layers necessary to address the many forms of delay. There are often more complex staffing and scheduling plans, added facility space for holding areas, the need to sometimes house patients in inappropriate floors, and additional patient transport.

Caveat. The method of cost per unit reduction by substituting less expensive resources (e.g., labor) for more expensive ones was not exemplified by either ATP or Six Sigma to any great extent. As previously stated, these projects did not represent a cross-section of all situations because they were selected for training purposes without an underlying framework to guide distribution of what was exemplified.

Quantifying Waste. The ATP and Six Sigma projects suggest huge opportunities for savings, but we cannot be sure of the total available savings via synthetic estimate. These projects are early attempts used for training purposes and only reflect targeted opportunities for investigation that may not be likely to other clinical areas. Nevertheless, they do provide examples that demonstrate how such tools (i.e., Six Sigma) can be used to excavate waste/ inefficiency.

Examples include the following:

  • A nutrition services project to address waste in snacks provided to patients: At one hospital, 29,700 between-meal snacks are ordered and produced annually for patients. Only 56 percent ever reached patients. Of the nourishments delivered, 70 percent were consumed. Overall, only 39 percent of all nourishments produced were consumed by patients. Annualized cost associated with current waste is $32,000.
  • A project to reduce length of stay (LOS) for hip fracture patients who are discharged to skilled nursing facilities: This project reduced LOS from 120 hours to 94 hours (21% reduction) by addressing delays in the assignment of an acute care manager and the timely removal of urinary catheters.
  • A project to reduce LOS for stroke patients: Patients were discharged on average 20 hours sooner if stroke preprinted orders were used AND an ACM reviewed their chart within 24 hours. The reduction from 78.9 to 58.6 hours constituted a 25 percent decrease in LOS.

Do these LOS reductions represent real cost savings to the hospital? Depending on the payment method, a hospital might see a loss in revenue. However, Providence and others are using a backfill approach (Cowan et al., 2006) to estimate the gain in net revenues attributable to a hospital's ability to admit more patients. With this approach, we assume that hospitals/units are admitting to capacity (typically, maximum capacity is an 80 percent to 85 percent census, to allow patient flow through the unit). Savings are then calculated as follows:

Marginal Cost Savings = backfill profit - loss in net revenues for early discharge (where backfill profit = revenues - variable costs/day)

This further assumes that the earlier days bring in more revenue than later days in a LOS (i.e., not per diem—based reimbursement) and that the freed bed can be readily filled by a new case.

Application of this method is illustrated by Cowan et al. (2006). In their study of staff substitution leading to improved care management, they found a marginal cost savings of $1,591 (average value of backfill profit = $1,707 per case less marginal loss of eliminated additional days of $116). The authors note that Ettner et al. (2006) analyzed the cost offset and net costs savings using the same dataset but a different methodology and found similar results. Thus, the stability of this approach seems reliable.

A second observation on LOS efficiency improvements must be made, however. Shortening LOS can sometimes result in very sick patients being discharged from acute care hospitals to other sites, such as long-term care hospitals. This is important at the Population Level. The care efficiency efforts on the part of acute care hospitals is driving a new level of care for high acuity patients. The question is would the patient have been better off (in terms of quality of life and overall admission time and cost to CMS) if these patients were not discharged so quickly from an acute care facility? Conversely, are these patients better off in these specialized facilities? The key question here is have we taken a systems perspective to understand unintended consequences of fragmented facility/reimbursement decisions?

Finally, there is concern that too-short LOS may have an impact on readmission rates. For example, the Leapfrog Group is rating hospitals as to their LOS, taking readmission rates into account.

ATP projects and Six Sigma projects address waste in similar ways. Both have a set of QI principles and tools at their core. Terminology and project structure differ. Six Sigma projects appear to be successful in reducing waste, although the experience of Providence is that many Six Sigma projects are taking longer than anticipated. Providence and Intermountain Healthcare have both adopted TPS methods as a tool for capturing "low hanging fruit" by involving frontline workers in short-term, Kaizen efforts.

Possible next steps at the Episode Level. While not able to estimate total health care waste at the Episode Level, our final efforts did produce a hypothetical analytic structure for possible use in the future. Several health care delivery systems are beginning to organize their operations around Deming's "key process" concept. Using a Baldrige quality award model, these institutions identify and then prioritize clinical work processes, with an aim to organize a relatively small list of processes (typically, about 10 percent of all clinical work processes in the organization) that produce the vast majority of clinical and financial results (typically, more than 90 percent of all clinical outcomes and costs), as suggested in Crossing the Quality Chasm (IOM, 2001). One such effort, which has been under development at Intermountain Healthcare for almost 10 years, has led to a "key process" list (this list is incomplete but illustrates the concept):

  1. Patient Safety:
    • Adverse drug events (medication selection, preparation, and delivery).
    • Hospital-acquired infections (especially postoperative deep wound infection).
    • Pressure injuries.
    • Mechanical device failures.
    • Complications of central and peripheral venous lines.
    • Venous thromboembolism.
    • Patient falls and injuries (strength, agility, and cognition).
    • Blood product transfusions.
    • Patient transitions.
  2. Clinical Programs (condition-related clinical processes):
    • Cardiovascular:
      • Ischemic heart disease:
        • Chest pain/r/o myocardial infarction.
        • Diagnostic and interventional cardiac catheterization.
        • CABG surgery.
      • Congestive heart failure:
        • Medical management of congestive heart failure.
        • Valve surgery.
        • Heart transplant.
      • Rhythm disorders.
    • Neuromusculoskeletal.
    • Surgical specialties.
    • Women and Newborn.
    • Intensive (inpatient) medicine.
    • Intensive (inpatient) pediatrics.
    • Intensive (inpatient) behavioral.
    • Oncology.
    • Primary care (outpatient clinics).
    • Health maintenance and latent risk prevention (preventive medicine).
  3. Clinical Support Services:
    • Pharmacy.
    • Imaging.
    • Pathology (lab, microbiology, blood bank, and surgical pathology).
    • Central supply.
    • Procedure rooms (anesthesiology).
    • Intensive care units.
    • Nursing units.
    • Therapy (e.g., physical, respiratory).
    • Other (e.g., dietary).
  4. Other:
    • Office of Research.
    • etc.
  5. Service Quality.
  6. Administration processes.

Such a list anticipates the creation of quality control measurement and management systems for each key process, which would create the ability to directly estimate waste and then manage it out. Essentially, all of the ATP and Six Sigma projects examined can be regarded as falling within this general structure, at either the Episode Level or the Patient Care Level.

Our work to date indicates that such an approach could have very high potential for identifying and managing waste, perhaps on the same order of magnitude as that found by the Dartmouth CECS group at the Population Level.

Page last reviewed September 2008
Internet Citation: Section 3. Examining Waste/Poor Quality: Cost of Poor Quality or Waste in Integrated Delivery System Settings. September 2008. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/research/findings/final-reports/costpqids/costpqids3.html