AHRQ Patient Safety Indicators: Constructive Use for Improvement (Text Version) Slide presentation from the AHRQ 2009 conference. On September 15, 2009, Cynthia Barnard made this presentation at the 2009 Annual Conference. Select to access the PowerPoint® presentation (3.41 MB) (Plugin Software Help).Slide 1September 15, 2009.AHRQ Patient Safety Indicators:Constructive Use for ImprovementPresented toAHRQ Annual ConferenceByCynthia Barnard MBA MSJS CPHQDirector, Quality StrategiesNorthwestern MemorialHealthCare Slide 2AgendaFramework for PSI analysis within the hospital Making Sense To CliniciansCase StudiesConclusions and Recommendations Slide 3Northwestern Memorial HealthCareFeinberg and Galter PavilionsMay 1, 1999New Prentice Women's Hospital October 20, 2007 873-bed Nationally Recognized Academic Medical CenterPrimary Teaching Hospital for Northwestern University since 1925Nationally Ranked for QualityNew World-Class Facilities in 1999 and 2007Aa/AA Category Bond Rating for Over 25 Years Slide 4NMH Recognized for Quality and ExcellenceMagnet Certification since 200611 Specialties in 2009 U.S. News & World Report of Best Hospitals2005 National Quality Health Care Award"Most Preferred Hospital" for 14 Years (NRC)Leapfrog Group's "Top Hospitals List" twiceNamed to "100 Best Companies for Working Women" for 9 Years"Most Wired" for 9 yearsAmong University Healthsystem Consortium Top 15 in Quality and Accountability Slide 5Quality and Patient Safety ProgramEliminate avoidable adverse eventsDeliver evidence-based careEnable the best possible outcomes Slide 6Eliminate Avoidable Severe Adverse Events Avoidable Severe Adverse Events (G,H,I)Total Incidents ReportedSevere Harm# of Severe Harm Events# of Incidents Reported Slide 7Agency for Healthcare Research and Quality (AHRQ)AHRQ Quality and Patient Safety Indicators (QIs/PSIs) are measures of health care quality that make use of readily available hospital inpatient administrative data.To improve the quality of healthcare, accessible and reliable indicators are needed to: Flag potential problems or successesFollow trends over timeIdentify disparities across regions, communities and providersAddress multiple dimensions of care Slide 8AHRQ - Quality IndicatorsInpatient Quality Indicators, 2002 Reflect quality of care inside hospitals including inpatient mortality for medical conditions and surgical procedures.Patient Safety Indicators (PSI), 2003 Reflect quality of care inside hospitals, but focus on potentially avoidable complications and iatrogenic eventsScreen for adverse events that patients experience as a result of exposure to the health care systemsTarget events that are likely amenable to prevention by changes at the system provider levelIncludes 20 indicators Slide 9Patient Safety IndicatorsPatient Safety IndicatorsPSI Number Complications of Anesthesia 1Death in Low-Mortality DRGs 2Decubitus Ulcer 3Failure to Rescue 4Foreign Body Left During Procedure 5Iatrogenic Pneumothorax 6Selected Infections Due to Medical Care 7Postoperative Hip Fracture 8Postoperative Hemorrhage or Hematoma 9Postoperative Physiologic and Metabolic Derangements 10Postoperative Respiratory Failure 11Postoperative Pulmonary Embolism or Deep Vein Thrombosis 12Postoperative Sepsis 13Postoperative Wound Dehiscence 14Accidental Puncture or Laceration 15Transfusion Reaction 16Birth Trauma – Injury to Neonate 17Obstetric Trauma – Vaginal with Instrument 18Obstetric Trauma – Vaginal without Instrument 19Obstetric Trauma – Cesarean Delivery 20Slide 10Example of PSI SpecificationIatrogenic Pneumothorax, (PSI 6)Provider Level Definition (only secondary diagnosis)Definition: Cases of iatrogenic pneumothorax per 1,000 discharges.Numerator: Discharges with ICD-9-CM code of 512.1 in any secondary diagnosis field.Denominator: All medical and surgical discharges age 18 years and older defined by specific DRGs.Exclude cases: . with ICD-9-CM code of 512.1 in the principal diagnosis fiel . MDC 14 (pregnancy, childbirth, and puerperium) . with an ICD-9-CM diagnosis code of chest trauma or pleural effusion . with an ICD-9-CM procedure code of diaphragmatic surgery repair . with any code indicating thoracic surgery or lung or pleural biopsy or assigned to cardiac surgery DRGsEmpirical Perf: Population Rate (2003): 0.562 per 1,000 population at riskRisk Adjustment: Age, sex, DRG, comorbidity categories Slide 11Administrative Data for Quality MetricsAdvantagesDisadvantagesConvenient and inexpensiveIncompleteStandardized rulesDepends on non-standardized charting, vague clinician usage, and ability to find evidence in chartAudited (for billing purposes)Audit focus is not on clinical completeness but on DRGs Includes diagnoses, procedures, age, gender, admission source and discharge statusExcludes important clinically influential data: DNR/palliative, clinical context, degree of severity Slide 12NMH Patient Safety Indicators Slide 13Framework for PSI Use Slide 14FrameworkCoded accurately?Definition omits important clinical factors?Actual clinical process problem?Similar approaches:Houchens, Elixhauser, Romano. How Often are Potential Patient Safety Events Present on Admission? Joint Commission Journal on Quality and Patient Safety, March 2008Henderson, et al. Clinical Validation of the AHRQ Postoperative Venous Thromboembolism Patient Safety Indicator. Joint Commission Journal on Quality and Patient Safety, July 2009 Slide 15Case StudiesCODINGForeign Body RetainedInfection Due to Medical CareDEFINITIONPost-op BleedCLINICAL IMPROVEMENTPneumothoraxPost-op PE / DVT Slide 16Framework on a Small Sample (2007) AHRQ PSI Coding Definition Potential Clinical Issue Pneumothorax 5 (12%) 0 (%) 38 (88%) Post-op Bleed 3 (8%) 10 (26%) 26 (67%) Post-op PE / DVT 12 (30%) 0 (0%) 28 (70%) Slide 17Clinical Case StudiesIatrogenic PneumothoraxPost-Operative DVT/PE Slide 18AHRQ Validation Study:Summary of PPVsPreliminary estimates (2007) PSI %PPVAccidental puncture or laceration90%Iatrogenic pneumothorax75%Postoperative DVT/PE72%Postoperative sepsis42%Selected infections due to medical care61% Slide 19AHRQ Validation Study:Iatrogenic Pneumothorax and Outcomes (N=154)* Patient Outcomes % Treated with chest tube44.8Discharge delay11.7Readmitted within 30 days of discharge (generally for reasons unrelated to pneumothorax according to the abstractor)9.1Moved to a higher level of care 7.1Tension pneumothorax 6.5None or Unable to Determine 29.9*Check all that apply.Slide 20NMH Assessment of Clinical PracticeIatrogenic PneumothoraxQuestion: Was the condition preventable?Variables Reviewed for Trends:Procedure resulting in pneumothorax (PTX)TypeLocationPhysician/Service (no identifiable trend)Day of the week (no identifiable trend)Time of day (no identifiable trend)Patient factors Reason for admissionAge (no identifiable trend)Pulmonary comorbidity (no identifiable trend)Slide 21 Procedure Resulting in PTXInsufficient documentation: 24%Thoracentesis: 21%Lung surgery: 15%Central line placement: 9%Chest tube removal: 9%Back surgery: 3%Biliary drain placement: 3%Bronchoscopy/biopsy: 3%Diaphragm resection: 3%Expected pleural laceration: 3%Lung biopsy: 3%Pacemaker insertion: 3%Type and Frequency of Procedure Resulting in PTX, N=33Dincer HE, Lipchik RJ. The intricacies of pneumothorax: management depends on accurate classification.Postgraduate Medicine, Dec 2005. Slide 22 Pneumothorax InterventionsFocus on potentially preventable PTX in thoracentesis, pacemaker, and central line proceduresWeekly case review by patient safety professional, MDFocus: Central Line and Pacemaker placement (clinical) Refreshers, simulation training (central lines), supervisionFocus: Correctly capturing exclusions (coding)Outcome: Rate has fallen from 1/week (3-4x expected) to 1-2/month (~expected) Slide 23 Interventions to Reduce Complications Slide 24 Post-Operative Venous Thrombosis / PEIn 2007 and 2008(Q1-Q3), approximately 17.3 patients per 1000 discharges*.experienced a DVT or PE complication at NMH.*excludes OB Product lineSource: UHC Clinical Database Slide 25New VTE Prophylaxis Protocol - Electronic Medical Record Screenshot Slide 26 Hospital DVT/PE RatesSource: EPSI Coded Diagnosis DataExcludes patients with DVT/PE Present on AdmissionBleeding Data represents patients that had a bleeding complication due to an anticoagulantProtocol Implemented Slide 27 Definition Case StudyPost-Operative Hemorrhage / Hematoma Slide 28 Observed and Expected Post-Op Bleed Rateswith and without Transplant - Calendar 2008 Stratification Numerator Denominator Observed Rate/1000 Expected Rate/1000 O/E Ratio Percentile All eligible cases (includes Transplant) 62121585.12.861.78Between the bottom 25th and 10th PercentileLiver/kidney/pancreas transplant 2236061.114.8412.62Bottom 10th PercentileLiver transplant 11104105.775.4719.34Bottom 10th PercentileMS-DRG 5: Liver transplant w MCC or intestinal transplant 766106.065.9817.73Bottom 10th PercentileMS-DRG 6: Liver transplant w/o MCC 438105.264.5823.01Bottom 10th PercentileKidney/pancreas transplant 1125642.974.599.37Bottom 10th PercentileMS-DRG 8: Simultaneous pancreas/kidney transplant 515333.333.6591.32Bottom 10th PercentileMS-DRG 10: Pancreas transplant 11662.53.2519.2Bottom 10th PercentileMS-DRG 652: Kidney transplant 522522.224.744.69Bottom 10th PercentileAll other MS-DRGs (Excludes above Transplant MS-DRGS) 40117983.392.81.21Just Below Top 25th Percentile Slide 29 Observed Post-Op Bleed Rateswith and without Transplant - Calendar 2008In organizations that performed more then 300 Transplants 60% of the Organizations were in the worst 3rd for Observed RatesWhen we exclude transplant from the Post Operative Hemorrhage and Hematoma metric, all but 2 organizations saw a rate improvement ranging from 0.19 to 4.28 Slide 30 Conclusions / Next Steps Slide 31 Transparency,Accountability Slide 32 Conclusions: The Framework WorksCodingDefinitionClinical OpportunityResults: Improved qualityReduced harmReduced costImproved learning Slide 33 Cynthia Barnard Director, Quality StrategiesNorthwestern Memorial HospitalResearch Assistant ProfessorInstitute for Healthcare StudiesNorthwestern University Feinberg School of Medicine676 St Clair #700Chicago IL 60611voice 312.926.4822fax 312.926.8734cbarnard@nmh.org Current as of December 2009 Internet Citation: AHRQ Patient Safety Indicators: Constructive Use for Improvement (Text Version). December 2009. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/news/events/conference/2009/barnard/index.html