AHRQ Toolkit: The Harborview Experience (Text Version)

Slide Presentation from the AHRQ 2011 Annual Conference

AHRQ Toolkit: The Harborview Experience

Slide Presentation from the AHRQ 2011 Annual Conference

On September 20, 2011, Ellen Robinson made this presentation at the 2011 Annual Conference. Select to access the PowerPoint® presentation (1.2 MB). Plugin Software Help.

Slide 1

AHRQ Toolkit: The Harborview Experience

Ellen F. Robinson, PT ATC
Clinical Quality Specialist
Seattle, WA

Slide 2

The Harborview Experience

A set of images showing the Harborview Medical Center, an Airlift Northwest helicopter, and a United States map outlining the geographical area that Harborview covers—Washington, Alaska, Montana, and Idaho— is shown.

Slide 3

Objectives

July 2008: WHAT IS A PSI?

July 2009: Oh I wish I had a "toolkit"
July 2010: AHRQ Toolkit Project
July 2011: PSI Project Full Integration

Slide 4

Quality Improvement Initiative
Two Goals

1. External Reporting

Image: Screen shot of the 2010 Quality and Accountability Scorecard for Harborview Medical Center.

2. Internal Case Identification

Medical QI Committee (MQIC)

• Departmental M & M review reporting.
• Standardization of identification of potentially preventable harm events for clinical review.

Slide 5

Section A
Readiness for Change

• IQI/PSI Fact Sheets.
• AHRQ Specification Guidelines.
• Readiness to Change (Self Assessment):
  • Medical Director —previous director of QI Dept.
  • Leadership Support and directive for project.
  • The Board was "on board".
  • Challenges identified: information dissemination about quality and patient safety to staff at all levels of the organization.

Slide 6

Section B: Applying the Indicators to your hospital data:

• Utilizing UHC database to track rates for PSI.
• UHC Quarterly Summaries ~ 3 months behind.
• Individual Case review from UHC ~ 6 weeks.
• Too late to make an impact.

How do we get PSI data in "real time"?

Three months to implement software.

Slide 7

Data Challenges

• Internal Source System for data points (3M).
• 3M Report output= 2 pages, multiple Rows.
• PERL Script to transform into usable input file.
• Windows Version 3.2.
• Validate Numerator and Denominator against UHC output.
• Take the data from AHRQ software and be able to track the QI process for each case.

Slide 8

Other Data Challenges

• Phase II AHRQ Validation Project Participation.
• Changed to Beta Version 4.0.
• Provided feedback to AHRQ technical staff on issues with new version.
• Challenges—Version discrepancies, running different versions concurrently on two machines to validate cases.

Slide 9

Section C: Identifying Priorities for Quality Improvement

• HMC Project Originally utilized UHC as source.
• UHC runs the SAS version software on each hospitals administrative data set.

Image: A detailed scorecard related to the AHRQ PSIs with red or green dots to represent good performance or improvement opportunities is shown.

Slide 10

Prioritization Matrix

HMC Highest Prioritization scores: PSI 3 PSI 7 PSI 12

Image: Screen shot of a prioritization matrix is shown.

Slide 11

Take it on the road!

• Presented to Surgical Council, Medical Executive Board, Critical Care Council, Hospital Board, Clinical Documentation Specialists, Coding:
  • What are the PSIs?
  • Why do we care?
  • Current performance/UHC ranking.
  • How are we going to review/expectations from teams.
  • Possible opportunities for improvement:
    • Clinical areas.
    • Documentation —Coding.

Slide 12

Section D: Implementation Tools

• Team Charter and Goals.
• Gap Analysis.
• Implementation Plan.

Effective PSI improvement strategies.
Evidence-based best practices for select PSIs.

Slide 13

PSI Improvement Opportunities

• Understanding of Metrics.
• Validation of Metrics.

Slide 14

Evidence-based Best Practices for Select PSIs

• Clinical Teams Reviewed.
• PSI 03: Clinical Nurse Specialists wound care.
• PSI 07: Infection Control.
• PSI 12: Anticoagulation Task force: Trauma Surgeon, Hospitalist, Pharmacy, Nursing.

Slide 15

HMC Implementation

• Monthly Case Review by QI .
• 10 days after end of previous month.
• Upload to internal database to track outcomes of each PSI.
• Providers report back through M&M conferences and MQIC.

Slide 16

HMC PSI Case Review

Image: A screen shot of a flow chart showing the process for HMC case review.

Slide 17

HMC Analysis and Tracking

Image: A screen shot of a sample patient tracking database page.

Slide 18

Section E: Monitoring Progress

Image: A screen shot of two bar graphs. The first one is titled "AHRQ Patient Safety Events Harm Event Categories". The other is AHRQ Patient Safety Events Harm Events Reviewed by Service FY 2011.

*Web based tool for Quality Metrics reporting.

Slide 19

HMC Outcomes—AHRQ Toolkit
PSI 12 Selected as Focus Area

• Clinical Event Search (CES) Tool:
  • VTE case finding from internal diagnostic systems for vascular and radiology events.
• VTE prophylaxis data points from EMR.
• Anticoagulation task force review all events to determine quality concerns on a case.

Slide 20

Image: A screen shot of a sample page from a Web-based tool used to search clinical events is shown.

Slide 21

Implementation Measurement

• For all VTE events, was standard of care met?
  • Compliance with UW Medicine guidelines?
    • Type?
    • Timing?
    • Dose intensity?
  • If guidelines do not specify, what is the standard?
• What are the opportunities for improvement?

Slide 22

Clinical Opportunities

• Transitions of care—OR Procedures.
• Missed/held doses for OR:
  • Changed Dalteparin dosing to 2100.
• Education for Residents:
  • Noted doses "held for surgery".
  • Attending physicians were not aware doses held.
  • Guideline directed therapy algorithm with increased web links through EMR and "clinical toolkit."

Slide 23

Clinical Opportunities

• Transitions in care—Communication:
  • Clinical team pharmacists, ARNPs, Hospitalists receive daily list of all patients who did not receive chemical prophylaxis in the last 24 hours.
  • Both "not ordered" and "pt refusal.
• Nursing Education:
  • Doses held for "patient ambulatory".

Slide 24

PSI 12 Monitoring Progress

Task Force currently meeting with each clinical team individually to review guidelines and formalize each "standard of care".

Image: A stacked bar graph showing which DVT/PE events met the standard of care for prophylaxis and which had possible opportunities

Slide 25

Section F: Return on Investment

• Currently under review with our Decision Support and Finance groups.
• Task force on "Efficiency".
• Utilizing the Cost Data from Prioritization Matrix as a quarterly tracking tool.

Slide 26

Section G: Existing QI Resources

• Reviewed by our Research Librarian.
• Incorporated into University of Washington Health Sciences LibGuides Web page:
  • Healthcare Quality News.
  • Pub Med Searches (preselected QI topics).
  • eJournals related to quality and safety.
  • Keep Current with Pub Med notifications.
  • Measures—links to TJC, NQF, CMS, UHC, IHI, WSHA.
  • Publishing/RefWorks/EndNote.

http://libguides.hsl.washington.edu/qualitysafety

Slide 27

PSI as a Quality Measure

• Systematic review of all PSI events.
• Is a high rate of events a true indicator of a quality issue at a hospital?
• Are all PSI events "preventable"?
• What about "missed" clinical events or "false negatives"? How do we identify those?

Slide 28

PSI Review Findings

At HMC ~ 1/3rd are not "real" events.

• Standardized Case Review:
  • Jan to June 2011.
  • PSI 3,6,7,9,11,12,15.
  • 132 Events:
    • 58 occurred—no quality concerns.
    • 30 occurred—possible opportunities.
    • 33 events related to documentation or coding error.
    • 11 events "flawed metric":
      • PSI 11 flagged related to a planned two stage surgery.
      • PSI 9 flag related to intra-operative bleeding.

At HMC ~ 1/3rd are not "real" events.

Slide 29

VTE Events From CES PSI 12

• January to June 2011 (67 VTE Events).
• 42 AHRQ PSI 12.
• 25 additional VTE events (false negative):
  • 16 cases not identified in administrative data.
  • 9 cases no operative procedure.

Without out internal clinical event search tool these cases would be missed QI opportunities.

* There were also 10 Cases of PSI 12 that were not real clinical events.

Slide 30

HMC PSI Project Lessons Learned

Validate, validate, validate...........

• Presentations to clinical providers should focus on actual patient harm events.
• Coding department project lead/liaison.
• Leadership backing to encourage provider accountability and sustain project importance.

Slide 31

Technical "bumps"

• Technical Issues to implement the AHRQ software may be challenging for hospitals.
• Version changes, input file specifications:
  • Continue to provide support via Web site/help line.
  • Consider asking hospitals what else they need?

Slide 32

Software Development

• Suggestions.
• Technical roadmap.
• Webinars for front end users.
• Reporting options.
• Information regarding risk adjustment coefficients and "targets" for each PSI.

Slide 33

PSIs and Public Reporting

• AHRQ QI rates are increasingly being used by external sources as a measure of quality.
• Version used and data source may result in disparate rates for the same institution.
• Information regarding version used should be clearly published on reporting sites.
• Transparency regarding methods for "PSI composite" calculations.

Slide 34

The "Future" of PSI

• Transition from a rate based tracking tool to one that provides hospitals opportunity for real changes for patients?
  • How can hospitals use the indicators to analyze "gaps" in current clinical care?
  • What to do about the gaps? Ongoing development of the evidence based "best practice" documents.
  • Should hospitals do enhanced chart audit of PSIs for additional data points regarding "preventablity"?

Slide 35

Thank You

AHRQ/RAND/UHC

• Robin Weinick.
• Donna Farley.
• Rachel Burns.
• Lindsay Mayer.

Harborview Medical Center

• Dr. J. Richard Goss.
• Dr. Anneliese Schleyer.
• Dr. Joseph Cuschieri.
• Ken Jarman, PharmD.
• Ronald Pergamit, QI/IT.
• Derk Adams, QI/IT.
• Patty Calver QI.

Ellen F. Robinson
(206) 744 9550
lnrobin@u.washington.edu

Current as of December 2011

Internet Citation:

AHRQ Toolkit: The Harborview Experience. Slide Presentation from the AHRQ 2011 Annual Conference (Text Version). December 2011. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/about/annualconf11/robinson/robinson.htm