What We Learned: Five Key Lessons
This section of the report addresses the question, "What did we
learn?" by drawing on the experiences of the National Project Team (NPT) over 4 years, and with interviews
conducted with 11 State leads.8 To
better understand the facilitators and barriers to the project, two HRET staff conducted
semi-structured interviews lasting 60 to 90 minutes each with the State leads
of six high-performing and five challenged States. One staff person led the
interview, while another recorded and coded responses. High-performing and
challenged States were defined by the degree of CLABSI rate reduction or the
number of units in a State that sustained a zero CLABSI rate for the last two
reporting periods and degree of unit team engagement determined by the number
of recruited and retained hospitals, data submission rates, and unit attendance
on content and coaching calls. The interview questionnaire was designed to
elicit information about a number of topics: why the association joined the
initiative; association leadership engagement; association experience with QI
collaboratives; association QI infrastructure (staff, qualifications, and QI
committees); State consortium stakeholders; educational programming, coaching
calls, and overall faculty support; data collection and use; NPT support; key
challenges and successes; and sustainability plans. The 40-question interview
guide is provided in Appendix A.
1. Have Well-Defined, Evidence-Based Interventions
A national campaign has distinct requirements that do not exist in
smaller-scale improvement efforts. Only well-defined interventions with
demonstrated significant results can be successful in national efforts where
there are limited resources and capacity to execute them. The published success
of the MHA Keystone: ICU project contributed significantly to HRET's ability to
recruit States to On the CUSP: Stop BSI. The published results
demonstrating the impact of the MHA Keystone: ICU project legitimized the On
the CUSP: Stop BSI program in two ways: 1) by heightening awareness of the
significant morbidity and mortality associated with central line infections,
and 2) demonstrating that these infections could be reduced to almost zero. The
magnitude of this success in 127 ICUs across the entire State of Michigan
helped alleviate the skepticism and fatigue that surround many quality
initiatives that have proliferated in recent years. On the CUSP: Stop BSI was
adapted closely from the MHA Keystone: ICU project and had well-defined interventions—the
CUSP model to address safety culture and the technical change package.
Return to Contents
2. Build a Solid Implementation Structure and Project Plan
National Experts with Proven Ability
Having highly credible national experts with proven ability to achieve
project goals is a critical element of any successful national quality
improvement campaign, and this was certainly the case with On the CUSP: Stop
BSI. All State leads interviewed by HRET stated that the national expertise
and leadership of members of the NPT was a primary factor in their recruitment
to this program.
Successful Implementer
The results of On the CUSP: Stop BSI demonstrate that MHA
Keystone and the Armstrong Institute had developed an education and coaching
program that could be scaled up nationally. The ability of MHA Keystone to
clearly articulate what worked in their State was also extremely important.
Knowing that a peer organization could and did achieve success encouraged other
States/regions to try this in their home territory.
Endorsement and Coordination of Key Stakeholders
The NPT communicated frequently with leaders working on the elimination
of HAIs at CDC and HHS in order to inform them of the goals and progress of On
the CUSP: Stop BSI. National content calls and State lead meetings featured
CDC and HHS as faculty to explain data definitions and discuss the HHS national
campaign to eliminate HAIs. CDC and HHS representatives also served on the
program's TEP which, as mentioned earlier, provided
periodic feedback to the NPT on the project's direction, implementation and
evaluation. As noted above, States/regions were strongly encouraged to work
with State and regional stakeholders to coordinate successful strategies for
eliminating CLABSI.
National Infrastructure
The creation of a national infrastructure to set goals, coordinate
efforts, and assure accountability was vital to the successful implementation
of On the CUSP: Stop BSI (see "National Project Team" and "Project
Stakeholders" sections). As the project progressed, the NPT learned to improve
communication channels to ensure effective coordination among all groups. To
keep State leads informed, HRET created a weekly update, which State leads
could use in turn to communicate with their unit teams. The NPT held monthly State
lead calls in which State leads could share their experiences and strategies with
their peers.
Return to Contents
3. Collect and Use Timely, Accurate, and Actionable Data to Improve Performance
A Web-based data system that units could easily use to upload teamwork
and CLABSI rate data and which States could use to generate reports was
critical to the success of this initiative. At the start of the project, few
hospitals were entering infection data into NHSN so most participants submitted
data to the NPT through the Care Counts data repository operated by MHA
Keystone. As time progressed, the NPT worked with State hospital associations
and CDC so that participant data could be pulled directly from NHSN into Care
Counts, avoiding the need for duplicate data entry. Once data was in the
system, States/regions viewed data reports generated by the NPT on their
monthly coaching calls to monitor progress. The NPT used these reports to track
State and national progress. In addition to reporting progress to AHRQ on a
semi-annual basis, the NPT was able to use the database to identify units with
a rate of 3/1,000 central line days or higher in the last reporting quarter. The
NPT provided an action planning kit for States and regions to assist them in
doing one-on-one follow up with each of these units to reduce their CLABSI
rates. Of the units identified, about half dropped their rates since targeted
efforts were implemented.
Return to Contents
4. Tailor National Program for Local and Unit Audiences
Hospitals and regions do not all begin improvement efforts with the
same level of knowledge, attitudes, and skills, and it became apparent early on
in the project that the NPT needed to accommodate these differences. Examples
of how the NPT addressed local and special needs included holding Critical
Access and Long-term Acute Care affinity group calls, developing a neonatal CLABSI
elimination collaborative and holding conference calls on central line
maintenance which surpassed line insertion as the biggest opportunity for
CLABSI reduction. The NPT also made itself available to States and regions with
less regional quality improvement experience, limited staff and/or those
without clinical backgrounds. State leads in States with a history of
successful quality improvement collaboratives were asked to share their
experiences and resources with other States and asked their unit teams to
present on national calls. In the case of Puerto Rico, it soon became apparent
that Spanish translation services were needed on monthly coaching calls and
that the CUSP Manual and CLABSI Elimination Toolkit needed to be translated
into Spanish. The "Science of Safety" video was also made available in Spanish to
support staff from participating Puerto Rican units.
States also asked for a focus on the neonatal intensive care unit
(NICU). In fall 2011, HRET partnered with the Perinatal Quality Collaborative
of North Carolina (PQCNC) to leverage existing, State-based neonatal networks
to recruit nine States that registered 100 NICUs. Using a slightly different
model than On the CUSP: Stop BSI, this national neonatal central line-associated
bloodstream infection project, also known as the NCLABSI project, employed
neonatologists and clinicians as the State leads. Participating NICUs received
CUSP education on a shortened timeframe, a technical bundle that was geared for
the neonatal population and submitted their rate and teamwork data into a
database developed by PQCNC. A separate, final report on the results of NCLABSI
was submitted to AHRQ.
Supplemental funds were provided by AHRQ to States/regions to support
local needs. States/regions could apply for these supplemental funds by
outlining their unique or local needs and a plan of action. For example,
Missouri saw a need to tailor the CUSP curriculum for their hospital units, and
Wisconsin decided to make improvements to their State hospital association
listserv and database. For their final in-person meeting, Ohio focused the
agenda on immuno-suppressed patients and central line maintenance because they
saw an opportunity to make large gains in that area. It was important to
recognize and financially support States/regions and hospitals that had special
content needs and to adapt the project to fit their interests and capabilities.
Return to Contents
5. Evolve Project Strategies and Emphases Over Time
Work with Late Adopters
On the CUSP: Stop BSI was a multi-phase effort spanning four
years. Over that time, there were changes that required the NPT to adjust its
strategies and emphases. The knowledge, skills, and attitudes of the State and
regional participants changed over time. For example, the last cohort of States
did not consist of early adopters, and they needed additional support. The NPT
met frequently to try to address the lower level of engagement of these State
leads and their unit teams. And while no particular solution was developed, the
NPT did attempt to focus on the "late majority" and "laggards" of the Rogers
Innovation Adoption Curve with a "higher intervention technique with more
frequent tracking and communication and coaching services."9
Seek New Opportunities to Reduce CLABSI
As rates declined, the NPT, States/regions, and unit teams looked for
opportunities to reach zero CLABSIs. This included changing focus on central
line insertion to central line maintenance and disseminating guidelines on dressing
changes and hub scrubbing. It involved disseminating CUSP and CLABSI
elimination interventions to different areas of the hospital such as non-ICUs
and hemodialysis units, and focusing on special patient populations such as
those who were immuno-suppressed.
Adapt to Changing External Environment
The NPT learned to be flexible in responding to the changing
environment at all levels—from the national level to the unit level. This
manifested itself in how the NPT advised States on monthly State lead calls and
in using faculty from HHS and CDC to present to unit teams and at State lead
meetings. States and unit teams worked to adapt, coordinate, and integrate
other improvement techniques and tools such as TeamSTEPPS®, Just Culture, Lean,
and Six Sigma programs with the CUSP efforts.
In some States, there was competition for hospital recruitment with the
State QIO. Many States made the decision to have some hospitals do the QIO
CLABSI intervention and others participate in the On the CUSP: Stop BSI initiative.
Other States were able to work with their QIO and not compete for hospital unit
recruitment.
When CUSP became an explicit component of the 10th Scope of
Work for QIOs around the country, members of the NPT met with CMS and developed
a short series of national calls with QIOs to explain the CUSP model and make
QIOs aware of all of the On the CUSP: Stop BSI resources located on the
project Web site.
In States that had health departments with CDC contracts to reduce
HAIs, State health department representatives attended and sometimes served as
faculty at in-person meetings. By the end of the project, many participating
hospitals were also being recruited to join a CMS-funded Hospital Engagement
Network (HEN). Because the HENS have received considerable resources to promote
improvement in 10 areas, including CLABSI, the NPT has worked to share resources
and expertise with HEN contractors to support their CLABSI improvement
activities.
8 HRET staff interviewed State leads from Florida,
Georgia, Hawaii, Illinois, Maryland, Minnesota, Missouri, Nebraska, Oregon,
South Dakota and Wisconsin.
9 Rogers EM. New Product Adoption and Diffusion. Journal of Consumer Research. 1976; 2(4):290-301. Available at: http://www.jstor.org/stable/2488658
accessed on August 1, 2012.
Return to Contents
Proceed to Next Section