Is Patient Safety Culture Related to Nursing Home Quality? (Text Version)

Slide Presentation from the AHRQ 2011 Annual Conference

On September 19, 2011, Naomi Dyer made this presentation at the 2011 Annual Conference. Select to access the PowerPoint® presentation (900 KB). Plugin Software Help.


Slide 1

 Is Patient Safety Culture Related to Nursing Home Quality? 

Is Patient Safety Culture Related to Nursing Home Quality?

Linking Nursing Home SOPS Scores With CMS Five-Star Quality ratings

Naomi Dyer, Westat
Joann Sorra, Westat
Kabir Khanna, Princeton University

Slide 2

 Background

Background

  • Challenge to change culture of healthcare organizations.
  • Focus has been on hospital patient safety and quality.
  • Diagnostic tool: AHRQ Nursing Home Survey on Patient Safety Culture focuses on Nursing Homes.

Slide 3

 Research Objective

Research Objective

Slide 4

 AHRQ Nursing Home SOPS (NH SOPS) Measures

AHRQ Nursing Home SOPS (NH SOPS) Measures

  • Twelve composites:
    • Three or four items each.
    • 5-point Likert scale.
  • Average composite score:
    • Average of the 12 composites.
  • Two overall ratings:
    • Overall recommendation: Yes, Maybe, No.
    • Overall rating: Poor, Fair, Good, Very good, Excellent.

Slide 5

 Nursing Home Compare Five-Star Quality Ratings

Nursing Home Compare Five-Star Quality Ratings

  • Released by Centers for Medicare and Medicaid Services (CMS) in December 2008.
  • Provides snapshot of quality of care in facility.
  • Consists of four ratings (from one to five stars):
    • Health Inspections.
    • Staffing.
    • Quality Measures.
    • Overall Rating.

Slide 6

 Health Inspections Rating

Health Inspections Rating

  • Health Inspections Rating based on annual inspections assessing over 180 items designed to protect residents.
  • Examples:
    • "Keep all essential equipment working safely".
    • "Properly mark drugs and other similar products".
    • "Try to resolve each resident's complaints quickly".

Slide 7

Staffing Rating

Staffing Rating

  • Staffing Rating is based on staffing hours per resident per day:
    • Total nursing hours per resident day.
    • RN hours per resident day.

Note: These numbers represent staffing levels for a two-week period prior to the time of the state inspection.

Slide 8

 Quality Measures Rating

Quality Measures Rating

  • Quality Measures Rating based on self-reported clinical/physician measure of quality.
  • Percent of residents:
    1. With pressure ulcers.
    2. In moderate to severe pain.
    3. Who were physically restrained.
    4. With a urinary tract infection.
    5. Whose ability to move worsened.
    6. Who had a catheter inserted and left in their bladder.
    7. With delirium.
    8. Needing increased help with daily activities.

Slide 9

 Overall Rating

Overall Rating

  • The Overall Rating combines:
    • Health Inspections Rating.
    • Staffing Rating.
    • Quality Measures Rating.

Slide 10

 Method

Method

  • Five-Star Rating data identified for 219 of 226 nursing homes from NH SOPS Database.
  • Used the following 15 NH SOPS scores:
    • 12 composite scores.
    • Average composite score (mean across the 12 composites).
    • 2 overall ratings:
      • Recommend the Nursing Home (Yes).
      • Overall rating (Excellent/Very Good).
  • 4 Five-Star Quality Ratings.

Slide 11

 Method

Method

  • Matched the Five-star rating time frame to the culture survey administration dates.
  • Time difference between measures:
    • Average = 129 days (~ 4 months).
    • Minimum = 0 days.
    • Maximum = 399 days (~13 months).

* Special thanks to Frank Nagy and Edward Mortimore at CMS for sending us Five-Star Quality Ratings data from 2008 to 2011.

Slide 12

Analysis  

Analysis

  • Relationships between NH SOPS and the 4 Five-Star Ratings:
    • Examined correlations for potential confounding variables (e.g., nursing home size, ownership).
    • Performed regressions controlling for:
      • Number of beds (a proxy for size),
      • Ownership (For profit, Nonprofit), and
      • Facility owned/leased by multi-facility organization.

Slide 13

 Control Variable Relationships

Control Variable Relationships

  • Smaller nursing homes were more positive on 5 of the 15 NH SOPS measures and 3 of the 4 NH Five-Star Ratings.
  • Nonprofit nursing homes were more positive on 9 of the 15 NH SOPS measures and 3 of the 4 NH Five-Star Ratings.
  • Multi-facility nursing homes were less positive on 9 of the 15 NH SOPS measures and 3 of the 4 NH Five-Star Ratings.

Note: None of the control variables were related to the Quality Measures Rating.

Slide 14

Results  

Results

  • All 15 NH SOPS measures positively related with:
    • Overall Five-Star Rating.
    • Health Inspections Rating.
  • None of the NH SOPS measures were significantly related with
    • Quality Measures.
    • Staffing.

Slide 15

 Health Inspection Rating Regression Results

Health Inspection Rating Regression Results

NH SOPS Measure (N=219)Beta
Composite Measures 
Compliance with procedures0.39*
Overall perceptions of resident safety0.36*
Training & skills0.35*
Staffing0.35*
Organizational learning0.34*
Handoffs0.32*
Nonpunitive response to mistakes0.29*
Teamwork0.29*
Management support for resident safety0.28*
Feedback & communication about incidents0.27*
Supervisor expectations & actions promoting resident safety0.26*
Communication openness0.24*
Average NH SOPS Composite Score0.35*
Overall Rating on Resident Safety0.40*
Overall Recommendation0.39*

* p < .01

Slide 16

 Results

Results

Health Inspections Rating vs. Average NH SOPS Composite Score

Image: A chart shows Health Inspections Rating vs. Average NH SOPS Composite Score.

Slide 17

 Conclusions

Conclusions

  • Important analysis attempting to link patient safety culture and measures of nursing home quality.
  • Nursing homes with more positive patient safety culture tend to have higher Overall and Health Inspections Five-Star Ratings.
  • Staffing and Quality Measures Five-Star Ratings not associated with patient safety culture.

Slide 18

 Future Directions

Future Directions

  • AHRQ funded national comparative database for NH SOPS and recently published the Nursing Home Comparative Database Report:
  • Further studies needed to...
    • Replicate study or examine potential linkages with other measures of nursing home quality.
    • Examine validity of Nursing Home Compare Five-Star Rating System.
    • Study relationship between improvements in patient safety culture and the impact on quality of nursing home care.
Page last reviewed March 2012
Internet Citation: Is Patient Safety Culture Related to Nursing Home Quality? (Text Version): Slide Presentation from the AHRQ 2011 Annual Conference. March 2012. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/news/events/conference/2011/dyer/index.html