AHRQ Toolkit: The Harborview Experience (Text Version)

Slide presentation from the AHRQ 2011 conference.

On September 20, 2011, Ellen Robinson made this presentation at the 2011 Annual Conference. Select to access the PowerPoint® presentation (1.2 MB). Plugin Software Help.


Slide 1

 AHRQ Toolkit: The Harborview Experience

AHRQ Toolkit: The Harborview Experience

Ellen F. Robinson, PT ATC
Clinical Quality Specialist
Seattle, WA

Slide 2

 The Harborview Experience

The Harborview Experience

WAMI REGION
Mission and Priority of care

A set of images showing the Harborview Medical Center, an Airlift Northwest helicopter, and a United States map outlining the geographical area that Harborview covers—Washington, Alaska, Montana, and Idaho— is shown.

Slide 3

 Objectives

Objectives

July 2008: WHAT IS A PSI?

July 2009: Oh I wish I had a "toolkit"
July 2010: AHRQ Toolkit Project
July 2011: PSI Project Full Integration

Slide 4

 Quality Improvement Initiative: Two Goals

Quality Improvement Initiative

Two Goals:

1. External Reporting 

Image: Screen shot of the 2010 Quality and Accountability Scorecard for Harborview Medical Center.

2. Internal Case Identification

Medical QI Committee (MQIC)

  • Departmental M & M review reporting.
  • Standardization of identification of potentially preventable harm events for clinical review.

Slide 5

 Section A: Readiness for Change

Section A: Readiness for Change

  • IQI/PSI Fact Sheets.
  • AHRQ Specification Guidelines.
  • Readiness to Change (Self Assessment):
    • Medical Director —previous director of QI Dept.
    • Leadership Support and directive for project.
    • The Board was "on board".
    • Challenges identified: information dissemination about quality and patient safety to staff at all levels of the organization.

Slide 6

 Section B: Applying the Indicators to your hospital data:

Section B: Applying the Indicators to your hospital data:

  • Utilizing UHC database to track rates for PSI.
  • UHC Quarterly Summaries ~ 3 months behind.
  • Individual Case review from UHC ~ 6 weeks.
  • Too late to make an impact.

How do we get PSI data in "real time"?

Three months to implement software.

Slide 7

 Data Challenges

Data Challenges

  • Internal Source System for data points (3M).
  • 3M Report output= 2 pages, multiple Rows.
  • PERL Script to transform into usable input file.
  • Windows Version 3.2.
  • Validate Numerator and Denominator against UHC output.
  • Take the data from AHRQ software and be able to track the QI process for each case.

Slide 8

 Other Data Challenges

Other Data Challenges

  • Phase II AHRQ Validation Project Participation.
  • Changed to Beta Version 4.0.
  • Provided feedback to AHRQ technical staff on issues with new version.
  • Challenges—Version discrepancies, running different versions concurrently on two machines to validate cases.

Slide 9

 Section C: Identifying Priorities for Quality Improvement

Section C: Identifying Priorities for Quality Improvement

  • HMC Project Originally utilized UHC as source.
  • UHC runs the SAS version software on each hospitals administrative data set.

Image: Screen shot of a detailed scorecard related to the AHRQ PSIs with red or green dots to represent good performance or improvement opportunities is shown.

Slide 10

 Prioritization Matrix

Prioritization Matrix

HMC Highest Prioritization scores: PSI 3 PSI 7 PSI 12

Image: Screen shot of a prioritization matrix is shown.

Slide 11

 Take it on the road!

Take it on the road!

  • Presented to Surgical Council, Medical Executive Board, Critical Care Council, Hospital Board, Clinical Documentation Specialists, Coding:
    • What are the PSIs?
    • Why do we care?
    • Current performance/UHC ranking.
    • How are we going to review/expectations from teams.
    • Possible opportunities for improvement:
      • Clinical areas.
      • Documentation —Coding.

Slide 12

 Section D: Implementation Tools

Section D: Implementation Tools

  • Team Charter and Goals.
  • Gap Analysis.
  • Implementation Plan.

Effective PSI improvement strategies.
Evidence-based best practices for select PSIs.

Slide 13

 PSI Improvement Opportunities

PSI Improvement Opportunities

Make Friends with your Coders 

  • Understanding of Metrics.
  • Validation of Metrics.

Slide 14

 Evidence-based Best Practices for Select PSIs

Evidence-based Best Practices for Select PSIs

  • Clinical Teams Reviewed.
  • PSI 03: Clinical Nurse Specialists wound care.
  • PSI 07: Infection Control.
  • PSI 12: Anticoagulation Task force: Trauma Surgeon, Hospitalist, Pharmacy, Nursing.

Slide 15

 HMC Implementation

HMC Implementation

  • Monthly Case Review by QI .
  • 10 days after end of previous month.
  • Upload to internal database to track outcomes of each PSI.
  • Providers report back through M&M conferences and MQIC.

Slide 16

 HMC PSI Case Review

HMC PSI Case Review

Image: A screen shot of a flow chart showing the process for HMC case review.

Slide 17

 HMC Analysis and Tracking

HMC Analysis and Tracking

Image: A screen shot of a sample patient tracking database page.

Slide 18

 Section E: Monitoring Progress

Section E: Monitoring Progress

Image: A screen shot of two bar graphs. The first one is titled "AHRQ Patient Safety Events Harm Event Categories". The other is AHRQ Patient Safety Events Harm Events Reviewed by Service FY 2011.

*Web based tool for Quality Metrics reporting.

Slide 19

 HMC Outcomes-AHRQ Toolkit

HMC Outcomes—AHRQ Toolkit
PSI 12 Selected as Focus Area

  • Clinical Event Search (CES) Tool:
    • VTE case finding from internal diagnostic systems for vascular and radiology events.
  • VTE prophylaxis data points from EMR.
  • Anticoagulation task force review all events to determine quality concerns on a case.

Slide 20

 Image: Screen Shot

Image: A screen shot of a sample page from a Web-based tool used to search clinical events is shown.

Slide 21

 Implementation Measurement

Implementation Measurement

  • For all VTE events, was standard of care met?
    • Compliance with UW Medicine guidelines?
      • Type?
      • Timing?
      • Dose intensity?
    • If guidelines do not specify, what is the standard?
  • What are the opportunities for improvement?

Slide 22

 Clinical Opportunities

Clinical Opportunities

  • Transitions of care—OR Procedures.
  • Missed/held doses for OR:
    • Changed Dalteparin dosing to 2100.
  • Education for Residents:
    • Noted doses "held for surgery".
    • Attending physicians were not aware doses held.
    • Guideline directed therapy algorithm with increased web links through EMR and "clinical toolkit."

Slide 23

 Clinical Opportunities

Clinical Opportunities

  • Transitions in care—Communication:
    • Clinical team pharmacists, ARNPs, Hospitalists receive daily list of all patients who did not receive chemical prophylaxis in the last 24 hours.
    • Both "not ordered" and "pt refusal.
  • Nursing Education:
    • Doses held for "patient ambulatory".

Slide 24

 PSI 12 Monitoring Progress

PSI 12 Monitoring Progress

Task Force currently meeting with each clinical team individually to review guidelines and formalize each "standard of care".

Image: A stacked bar graph showing which DVT/PE events met the standard of care for prophylaxis and which had possible opportunities.

Slide 25

Section F: Return on Investment  

Section F: Return on Investment

  • Currently under review with our Decision Support and Finance groups.
  • Task force on "Efficiency".
  • Utilizing the Cost Data from Prioritization Matrix as a quarterly tracking tool.

Slide 26

 Section G: Existing QI Resources

Section G: Existing QI Resources

  • Reviewed by our Research Librarian.
  • Incorporated into University of Washington Health Sciences LibGuides Web page:
    • Healthcare Quality News.
    • Pub Med Searches (preselected QI topics).
    • eJournals related to quality and safety.
    • Keep Current with Pub Med notifications.
    • Measures—links to TJC, NQF, CMS, UHC, IHI, WSHA.
    • Publishing/RefWorks/EndNote.

http://libguides.hsl.washington.edu/qualitysafety 

Slide 27

 PSI as a Quality Measure

PSI as a Quality Measure

  • Systematic review of all PSI events.
  • Is a high rate of events a true indicator of a quality issue at a hospital?
  • Are all PSI events "preventable"?
  • What about "missed" clinical events or "false negatives"? How do we identify those?

Slide 28

 PSI Review Findings

PSI Review Findings

At HMC ~ 1/3rd are not "real" events.

  • Standardized Case Review:
    • Jan to June 2011.
    • PSI 3,6,7,9,11,12,15.
    • 132 Events:
      • 58 occurred—no quality concerns.
      • 30 occurred—possible opportunities.
      • 33 events related to documentation or coding error.
      • 11 events "flawed metric":
        • PSI 11 flagged related to a planned two stage surgery.
        • PSI 9 flag related to intra-operative bleeding.

At HMC ~ 1/3rd are not "real" events.

PSI Cases ReviewedN = 132
No QI concerns44%
Possible Opportunity23%
Documentation25%
Flawed Metric8%

Slide 29

 VTE Events From CES PSI 12

VTE Events From CES PSI 12

  • January to June 2011 (67 VTE Events).
  • 42 AHRQ PSI 12.
  • 25 additional VTE events (false negative):
    • 16 cases not identified in administrative data.
    • 9 cases no operative procedure.

Without out internal clinical event search tool these cases would be missed QI opportunities.

* There were also 10 Cases of PSI 12 that were not real clinical events.

Slide 30

 HMC PSI Project Lessons Learned

HMC PSI Project Lessons Learned

Validate, validate, validate...........

  • Presentations to clinical providers should focus on actual patient harm events.
  • Coding department project lead/liaison.
  • Leadership backing to encourage provider accountability and sustain project importance.

Slide 31

Technical "bumps"  

Technical "bumps"

  • Technical Issues to implement the AHRQ software may be challenging for hospitals.
  • Version changes, input file specifications:
    • Continue to provide support via Web site/help line.
    • Consider asking hospitals what else they need?

Slide 32

 Software Development

Software Development

  • Suggestions.
  • Technical roadmap.
  • Webinars for front end users.
  • Reporting options.
  • Information regarding risk adjustment coefficients and "targets" for each PSI.

Slide 33

PSIs and Public Reporting  

PSIs and Public Reporting

  • AHRQ QI rates are increasingly being used by external sources as a measure of quality.
  • Version used and data source may result in disparate rates for the same institution.
  • Information regarding version used should be clearly published on reporting sites.
  • Transparency regarding methods for "PSI composite" calculations.

Slide 34

PSIs and Public Reporting  

The "Future" of PSI

  • Transition from a rate based tracking tool to one that provides hospitals opportunity for real changes for patients?
    • How can hospitals use the indicators to analyze "gaps" in current clinical care?
    • What to do about the gaps? Ongoing development of the evidence based "best practice" documents.
    • Should hospitals do enhanced chart audit of PSIs for additional data points regarding "preventablity"?

Slide 35

 Thank You

Thank You

AHRQ/RAND/UHC

  • Robin Weinick.
  • Donna Farley.
  • Rachel Burns.
  • Lindsay Mayer.

Harborview Medical Center

  • Dr. J. Richard Goss.
  • Dr. Anneliese Schleyer.
  • Dr. Joseph Cuschieri.
  • Ken Jarman, PharmD.
  • Ronald Pergamit, QI/IT.
  • Derk Adams, QI/IT.
  • Patty Calver QI.

Ellen F. Robinson
(206) 744 9550
lnrobin@u.washington.edu

Page last reviewed March 2012
Internet Citation: AHRQ Toolkit: The Harborview Experience (Text Version). March 2012. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/news/events/conference/2011/robinson/index.html