Overview of Patient Safety Learning Laboratory (PSLL) Projects

Introduction

Patient safety learning laboratories (PSLLs) take a systems engineering approach to allow researchers and practitioners to evaluate clinical processes and enhance work and information flow to improve patient safety. The learning laboratories use cross-disciplinary teams to address the patient safety-related challenges providers face. This approach can involve evaluating the physical (built) environment, technological factors such as health information technology (IT), and clinical workflow processes relevant to the patient's condition. Emphasis is placed on the system-level confluence of these multiple factors in producing better patient safety.

AHRQ supports the PSLLs through the Agency's patient safety program. In 2014 and 2015, AHRQ funded 13 multiyear demonstration grants through the P30 mechanism to evaluate the use and effectiveness of various systems engineering approaches and the role they can play in improving the safety and quality of healthcare delivery.

In 2018 and 2019, AHRQ funded 17 additional PSLL grants (9 in 2018, and 8 in 2019) through the R18 mechanism and expanded the focus to include projects that aim to improve diagnosis and treatment issues. In 2022, AHRQ funded five more R18 grants.

Below are brief summaries of these projects. Each summary includes the project title, principal investigator (and co-PIs where applicable) and organization, AHRQ grant number, project start and end dates, and a description of the focus and goals of the project. Contact information for each principal investigator is at the end, after all the summaries.

AHRQ's PSLLs have the potential to improve the safety of healthcare by allowing healthcare practitioners to acquire valuable experience in a variety of clinical settings, reducing patient risk and improving safety. These projects will inform providers, health educators, payers, policymakers, patients, and the public about the effective use of systems engineering approaches in improving patient safety.

Project Descriptions

P30 Projects Funded in 2014 and 2015

Brain Health Patient Safety Learning Laboratory (Brain Safety Lab)

Principal Investigator: Christopher Callahan, M.D., Indiana University, Indianapolis, IN
AHRQ Grant No.: HS24384
Project Period: 09/30/15-03/31/20
Description: This learning laboratory focused on preventing harms to brain health among vulnerable older adults. The Brain Safety Lab was a collaboration between the Indiana University’s Schools of Medicine, Informatics and Computing, and Nursing; Purdue University’s Schools of Biomedical and Industrial Engineering and its College of Pharmacy; the Regenstrief Institute; and Eskenazi Health, a safety-net healthcare system.

The project aims were to:

1. Reduce the use of unsafe medications with anticholinergic (ACh) side effects.
2. Prevent repeated episodes of hypoglycemia (HG) among older adults with diabetes.

Using a five-phase process (i.e., problem analysis, design, development, implementation, and evaluation), the lab team developed the Brain Buddy, a consumer-facing mHealth application to inform and encourage older adults to initiate dialogue with a clinician regarding the risks and benefits of their anticholinergic medications. The lab tested the usability and feasibility of the tool on primary care patients, finding that 100 percent of participants indicated they were more informed, with 94 percent stating they would speak to their physician about their anticholinergic-related risk. On followup, 82 percent reported having spoken to their physician about their anticholinergic medication, a rate independently confirmed by physicians.

In addition, the Brain Safety Lab team developed a conceptual model for over-the-counter medication purchase and use by older adults based on habits and deliberation. This model suggests several design directions for future consumer-oriented interventions to promote medication safety.

To date, this PSLL's work has resulted in at least 18 peer-reviewed journal publications, with nearly 130 citations in other publications.

A sample of the lab's publications is listed below.  A longer description of its work and associated publications is available.

Publications

• Holden RJ, Abebe E. Medication transitions: vulnerable periods of change in need of human factors and ergonomics. Appl Ergon. 2021;90:103279.
• Holden RJ, et al.; Brain Health Patient Safety Laboratory. Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults. Res Social Adm Pharm. 2020;16(1):54-61.
• Khan SH, et al. Decreasing delirium through music: a randomized pilot trial. Am J Crit Care. 2020;29(2):e31-e38.

Building an Ambulatory Patient Safety Learning Laboratory for Diverse Populations (ASCENT)

Principal Investigator: Urmimala Sarkar, M.D., University of California-San Francisco, San Francisco, CA
AHRQ Grant No.: HS023558
Project Period: 09/30/14-09/29/2020
Description: The overall goal of this project was to examine the epidemiology of patient safety in ambulatory care settings that care for diverse, low-income populations in the San Francisco Heath Network (SFHN).

The project aims were to:

1. Create a transdisciplinary patient safety learning laboratory composed of stakeholders and experts in patient safety, reliability science, design thinking, and operational leadership to collaborate on creative and effective solutions.
2. Design and iterate technical and workflow solutions for high-priority ambulatory safety issues in a publicly funded, safety-net healthcare system caring for diverse, vulnerable patients. Specifically, ASCENT addressed (a) test results management, (b) outpatient monitoring for high-risk conditions, and (c) enhanced medication comprehension to reduce adverse drug events.
3. Implement and evaluate solutions using implementation sciences methodology.
4. Scale up effective solutions across the health system and disseminate them among safety-net health systems.

The ASCENT Lab developed, piloted, and implemented a needs-driven technical and culture-based solution for subcritical test results, management of high-risk conditions and their treatments, and patient-centered medication language with rich involvement from frontline clinicians and leadership in the health system.

An example of innovations created by the ASCENT Lab include:

• An electronic registry for urology clinic staff to monitor men on active surveillance for prostate cancer risk. The goal is to assess the efficacy and feasibility of health information technology at a safety-net hospital to ensure patients receive guideline-recommended care.
• A health information technology platform that monitors patients with head and neck cancer to improve timely and successful completion of guideline-based care processes.
• An electronic dashboard (integrated into a preexisting electronic health record) and standardized workflow to track patients' laboratory results, identify patients requiring followup, and facilitate the use of a validated nomogram for dose adjustment.

To date, this PSLL’s work has resulted in at least 34 peer-reviewed journal publications, with nearly 200 citations in other publications.

A sample of the lab’s publications is listed below.  A longer description of its work and associated publications is available.

Publications

• Cedars B, et al. An electronic registry to improve adherence to active surveillance monitoring among men with prostate cancer at a safety-net hospital: protocol for a pilot study. Pilot Feasibility Stud. 2019 Aug 14;5:101.
• Fontil V, et al. Evaluation of a health information technology-enabled panel management platform to improve anticoagulation control in a low-income patient population: protocol for a quasi-experimental design. JMIR Res Protoc. 2020;9(1):e13835.
• Nouri SS, et al. Assessing mobile phone digital literacy and engagement in user-centered design in a diverse, safety-net population: mixed methods study. JMIR Mhealth Uhealth. 2019;7(8):e14250.

Caregiver Innovations to Reduce Harm in Neonatal Intensive Care

Principal Investigator: Eric J. Thomas, M.D., University of Texas, Houston, TX
AHRQ Grant No.: HS24459
Project Period: 09/30/15–09/29/21
Description: The goal of the University of Texas Patient Safety Learning Laboratory was to create an environment of collaborative learning focused on reducing all-cause preventable harm by 50 percent in the neonatal intensive care unit (NICU).

The specific aims were to:

1. Increase parent and family engagement.
2. Improve staff training on nutrition and respiratory care in neonates.
3. Decrease central line-associated bloodstream infections.

This lab used three cores of multidisciplinary experts to engage NICU caregivers and develop a multimethod trigger-based, prospective clinical surveillance system to detect all-cause preventable harm. More specifically, the following list provides examples of individual core accomplishments:

• The measurement core developed causal-loop diagrams and a simulation model to help identify various individual-, team-, and unit/organizational-level factors associated with harms and quality improvement (QI)-related outcomes. This model showed how policies designed to affect those factors resulted in changes to outcomes. The measurement core also created a tool to assess the processes and teamwork during QI team meetings and a new survey to measure stakeholder attitudes about QI interventions.
• The electronic health record (EHR) core identified and developed the Safer Dx Trigger Tools Framework that enables health systems to develop and implement e-trigger tools. It also identified nine challenges to help healthcare organizations, health information technology developers, researchers, policymakers, and funders focus their efforts on health information technology-related patient safety. As of August 2021, the Centers for Medicare & Medicaid Services requires eligible hospitals to attest to having completed an annual self-assessment of their EHR using SAFER Guides.
• The parent engagement core used an observational, mixed-methods design of field observations, interviews, and surveys with parent advisors, clinicians, and leaders involved with the NICU. This core obtained data to detect preventable harms in the NICU and the impact of parent engagement on QI initiatives. They found that parents of hospitalized infants in the NICU observe and can report problems/harms, if asked. Through this work, researchers describe a stepwise approach to implementing a QI-based parent advisory council that could be applicable to any hospital or ambulatory unit.

A sample of this lab's publications is below. A longer description of this lab’s work and associated publications is available.

Publications

• Nether, K. Implementing a robust process improvement program in the neonatal intensive care unit to reduce harm. J Healthc Qual 2022 Jan-Feb 01;44(1):23-30.
• Sedlock EW, et al. Creating a comprehensive, unit-based approach to detecting and preventing harm in the neonatal intensive care unit. J Patient Saf Risk Manag 2018;23(4):167-75. https://journals.sagepub.com/doi/10.1177/2516043518787620.
• Sittig DF, et al. Adherence to recommended electronic health record safety practices across eight health care organizations. J Am Med Inform Assoc 2018;25(7):913-8.

Engineering Highly Reliable Learning Lab

Principal Investigator: Sara Singer, Ph.D., Harvard University, Cambridge, MA
AHRQ Grant No.: HS24453
Project Period: 09/30/15–09/29/21
Description: The goal of this learning lab was to enhance capacity for innovation and develop highly reliable systems that address communication and coordination challenges that pose patient safety risks at the intersection of primary and specialty care. A five-stage systems engineering cycle, including problem analysis, design, development, implementation, and evaluation, drove the lab’s efforts to develop highly reliable systems within four Harvard-affiliated primary care practices and their specialty care partners.

The specific aims were to:

1. Build a shared infrastructure that comprised an administrative/learning core, an engineering core, and multidisciplinary teams to stimulate a systematic approach for patient safety innovation.
2. Engage in three research projects that applied systems engineering to the development of innovative solutions for improving health information technology-supported processes and designing highly reliable systems that are generalizable.
3. Implement and spread redesigned systems across a range of hospital/community-based primary care practices and test systems’ generalizability in alternative settings and conditions.
4. Assess the impact of redesigned systems on practice, team, provider, and patient outcomes and disseminate findings, tools, and resources for national replication.

Over 5 years, four synergistic projects engaged health system-based reengineering and design teams in problem analysis and hands-on development, testing, and implementation of communication and coordination systems in different settings.

EHRLL used a variety of systems engineering and problem analysis tools at four institutions to facilitate a successful learning system and find solutions to problems relevant to each institution. Tools included process mapping, swim lane diagrams, functional resonance analysis method, failure modes and effects analysis, contrast analysis, run charts, and predictive modeling dashboards.

EHRLL researchers developed a model of the constraint management process to show that each institution’s teams over time experienced hierarchical and heterarchical constraints. They used direct and indirect tactics to overcome these constraints. Ultimately, these tactics helped each institution achieve milestones and maintain momentum.

One of the lab’s successes was at Boston Children's Hospital, which created a new approach to patient engagement. They redefined the facility's care pathway and spread this care pathway across the United States via the American Academy of Cerebral Palsy and Developmental Medicine. The hospital is now using the same systems engineering methods to cope with COVID-19.

One of the projects at Brigham and Women's Hospital developed a system of workflows to improve management of chronic opioid prescribing.

In response to COVID-19, EHRLL's engineering core team developed the Northeastern University Hospital Surge Capacity Planning Model to help health systems project hospital-specific demand for key resources.

A sample of EHRLL's publications is listed below. A longer description of this lab’s work and associated publications is available.

Publications

• Bargal B, et al. Use of systems-theoretic process analysis to design safer opioid prescribing processes. IISE Trans Occup Ergon Hum Factors 2018;6(3-4):200-8.
• Das P, et al. Engineering safer care coordination from hospital to home: lessons from the USA. Future Healthc J 2018;5(3):164-70.
• Atkinson MK, et al., Evaluating a patient safety learning lab intervention to create an interdisciplinary ecosystem for healthcare innovation. Health Care Manage Rev 2022 Jan 27.

Enhancing Patient Safety Through Cognition and Communication (M-Safety Lab)

Principal Investigator: Sanjay Saint, M.D., M.P.H., University of Michigan, Ann Arbor, MI
AHRQ Grant No.: HS24385
Project Period: 09/30/15-12/31/19
Description: The goal of this learning lab was to implement novel methods to enhance cognition and communication among care providers to reduce hospital-acquired complications. The M-Safety Lab conducted two projects: Project 1 focused on developing a new monitoring system for hospitalized patients, and Project 2 addressed the common but understudied area of diagnostic error.

For Project 1, the aims were to:

1. Detect the presence and duration of vascular and urinary catheter use and report catheter presence and duration of use to clinicians to prompt timely removal of unnecessary catheters.
2. Identify areas of skin at risk for developing pressure ulcers (recently renamed by expert organizations as pressure injury) from exposure to intense and/or prolonged pressure, moisture, friction, and shear and report areas of at-risk skin to clinicians to prompt timely delivery of risk-reducing interventions such as patient repositioning and targeted skin care.

For Project 2, the aims were to:

1. Evaluate whether a meta-cognitive intervention using a structured checklist, a smartphone-based differential-diagnosis expander, and collective wisdom using a social media-based tool compared to a local "diagnostic board" can improve diagnostic and therapeutic decision making in patients who present with shortness of breath.
2. Examine the role of mindfulness, motivational interviewing, and architectural design in enhancing patient safety.

The M-Safety Lab’s achievements include the creation of a digital bedside display that shows patients’ catheter and wound information, which is pulled from the electronic medical record (EMR) every 10 minutes. The display improved provider's awareness of indwelling urinary catheters, central venous catheters, and pressure injuries (formerly called ‘pressure ulcers’). The improvement of provider awareness of indwelling urinary catheters was statistically significant when comparing the intervention period to pre-intervention period. The improvement in provider awareness of central venous catheters was significant when comparing intervention rooms to control rooms during the same timeframe.

The M-Safety Lab tested and validated a bed motion device that detects 84.8 percent of patients' motions correctly. It uses a non-contact sensor system to detect and report important patient motions, such as no motion (a sign that the patient is at risk of developing pressure injury) and rhythmic motion (for detection of seizure). Compared to commercially available pressure mattresses, this device showed improved performance and was less costly.

An intervention bundle combining mindfulness, changes to the physical space, diagnostic assistive tools, and an EMR-based checklist, did not improve diagnostic confidence or self-reported measures of mindfulness among physicians. Researchers concluded that more work is needed to develop interventions that would be beneficial to physicians and improve diagnostic accuracy.

To date, this PSLL's work has resulted in at least 14 peer-reviewed publications, with 90 citations in other publications.

A sample of this lab's publications is listed below. A longer description of its work and associated publications is available.

Publications

• Gupta A, et al. Understanding diagnostic reasoning using a case-based approach. Abstract published at Hospital Medicine 2018; April 8-11; Orlando, Fla. 
• Manojlovich M, et al. Contextual barriers to communication between physicians and nurses about appropriate catheter use. Am J Crit Care. 2019;28(4):290-298.
• Quinn M, et al. Persistent barriers to timely catheter removal identified from clinical observations and interviews. Jt Comm J Qual Patient Saf. 2020;46:99-108.

Failure to Rescue Patient Safety Learning Lab (FTR PSLL)

Principal Investigator: George Blike, M.D., Dartmouth-Hitchcock, Lebanon, NH
AHRQ Grant No.: HS24403
Project Period: 09/30/15-03/31/20

Description: The overall goal of this project was to create the ideal hospital rescue system. Mitigating failure to rescue (FTR) (i.e., death after a major complication) is critical to reducing mortality in hospitalized patients. Successful rescue hinges on early recognition and timely management of serious complications once they occur.

The project aims were to:

1. Target gaps in understanding the technology and human factors behind ideal risk assessment and risk surveillance.
2. Support early detection of nonpreventable complications and identify all the factors (individual, team, and technology) that define an ideal rescue system that effectively responds to and manages these complications.

The FTR PSLL comprehensively assessed the whole rescue system as opposed to fixing only subsystems, leading to the development of an FTR Event Mitigation System (i.e., policies and procedures, reporting mechanisms, tools, technologies, and other elements) that provides a roadmap for Dartmouth-Hitchcock. This roadmap and its interventions can also be used by other healthcare organizations to develop their own mitigation systems. Further, each intervention is accompanied by a concept model that shows stages of implementation for each organization’s capability level.

The FTR PSLL’s design and evaluation of an enhanced surveillance monitoring system to detect early patient deterioration resulted in significantly improved key clinical elements related to early recognition of changes in patient state. It also increased patient monitoring time (rate ratio 1.22) while reducing data collection time by 28 percent.

To date, this PSLL’s work has resulted in at least 38 peer-reviewed journal publications, with nearly 600 citations in other publications; and presentations at institutions and conferences.

A sample of this PSLL's publications is listed below. A longer description of its work and associated publications is available.

Publications

• McGrath SP, et al. Failure to rescue event mitigation system assessment: a mixed-methods approach to analysis of complex adaptive systems [abstract]. Adv Health Care Manag. 2019 Oct 24;18. Full text available at https://www.emerald.com/insight/content/doi/10.1108/S1474-823120190000018006/full/html.
• McGrath SP, et al. Improving patient safety and clinician workflow in the general care setting with enhanced surveillance monitoring. IEEE J Biomed Health Inform. 2019;23(2):857-66.
• Umberfield E, et al. Using incident reports to assess communication failures and patient outcomes. Jt Comm J Qual Patient Saf. 2019;45(6):406-13.

Institute for the Design of Environments Aligned for Patient Safety (IDEA4PS)

Principal Investigators: Ann Scheck McAlearney, Sc.D., M.S., The Ohio State University, Columbus, OH; formerly Susan Moffatt-Bruce, M.D., Royal College of Physicians and Surgeons of Canada, Ottawa
AHRQ Grant No.: HS024379
Project Period: 09/30/15-09/29/20
Description: The goal of the Institute for the Design of Environments Aligned for Patient Safety (IDEA4PS) was to improve workflows and information transfers in the healthcare environment.

The project aims were to:

1. Explore how cardiac alarms affect healthcare provider decision making.
2. Conduct surveillance of healthcare-acquired infections in real time.
3. Implement and evaluate secure messaging in electronic health records (EHRs).

The IDEA4PS Lab provided foundational infrastructure to connect stakeholders across Ohio State University and Wexner Medical Center to improve clinical practice by designing, testing, and exploring the types of information flows resulting in a safer healthcare work environment.

The work of IDEA4PS reduced the alarm burden of bedside monitors and the Secondary Alarm Notification System that is delivered on nurses' phones. These improvements allowed clinicians to focus on meaningful events over the din of background noise, enhancing the safety and quality of patient care. Further, the IDEA4PS Lab automated hospital-acquired infection surveillance to provide results in near real time to stakeholders and explored how the hospitalwide use of MyChart Bedside (MCB), an inpatient patient portal, affected the provider work system and processes. Subsequent changes included hiring technology navigators to assist with MCB provisioning and training both patients and clinicians on the use of MCB.

To date, this PSLL’s work has resulted in at least 70 peer-reviewed journal publications, with nearly 600 citations in other publications; nearly 90 presentations at institutions and conferences; and creation of a website (https://u.osu.edu/idea4ps).

A sample of this lab's publications is listed below. A longer description of its work and associated publications is available.

Publications

• McAlearney AS, et al. Empowering patients during hospitalization: perspectives on inpatient portal use. Appl Clin Inform. 2019;10(1):103-12.
• McHaney-Lindstrom M, et al. Network analysis of intra-hospital transfers and hospital onset clostridium difficile infection. Health Info Libr J. 2020;37(1):26-34.
• Rayo MF, et al. Using timbre to improve performance of larger auditory alarm sets. Ergonomics. 2019;62(12):1617-29.

Making Acute Care More Patient-Centered

Principal Investigator: David Bates, M.D., Brigham & Women's Hospital, Boston, MA
AHRQ Grant No.: HS23535
Project Period: 09/30/14-09/29/19
Description: The goal of this learning laboratory was to develop tools to engage patients, families, and professional care team members by reliably identifying, assessing, and reducing patient safety threats in real time, before they manifested in actual harm.

The project aims were to:

1. Engage patients and their family caregivers in the design of health information technology (IT) tools to prevent patient falls and related injuries during an acute hospitalization.
2. Engage healthcare providers and patients in the design and development of a Patient Safety Checklist Tool to improve patient safety and quality outcomes, provider efficiency, and team communication.
3. Iteratively develop and evaluate the impact of a patient safety reporting system on patient safety and foster a learning health system.

This PSLL created and implemented an English and Spanish version of the Fall TIPS (Tailoring Interventions for Patient Safety) toolkit, which reduced falls by 25 percent in acute care hospitals. Today, the toolkit is used in more than 100 hospitals across the United States and internationally.

The lab launched the Patient SatisfActive® Model. This proactive, patient-centered care program uses a suite of health IT tools—patient safety dashboard, bedside display, and patient portal—to engage patients, families, and healthcare providers in improving patient safety. The creation of English and Spanish versions of a web-based, mobile-enabled application, called MySafeCare, is allowing patients and families to submit safety concerns and events in real time.

This PSLL's work has resulted in:

• At least 23 peer-reviewed journal publications, with more than 150 citations in other publications.
• More than 12 presentations at institutions and conferences across the United States to help other organizations bridge the gap between health IT and patient and provider needs.
• Two new websites (http://www.patientsafetyresearch.org/PSLL/home.html and http://www.falltips.org).
• Laminated posters and paper tools to meet the needs of diverse hospital environments.

A sample of their publications is listed below. A longer description of this lab’s work and associated publications is available.

Publications

• Dykes PC, et al. The Fall TIPS (Tailoring Interventions for Patient Safety) Program: a collaboration to end the persistent problem of patient falls. Nurse Leader. 2019;17(4):365-70.
• Schnock KO, et al. Acute care patient portal intervention: portal use and patient activation. J Med Internet Res. 2019;21(7): e13336.
• Couture B, et al. Applying user-centered design methods to the development of an mHealth application for use in the hospital setting by patients and care partners. Appl Clin Inform. 2018;9(2):302-12.

Optimizing Safety of Mother and Neonate in a Mixed Methods Learning Laboratory

Principal Investigator: Louis Halamek, M.D., Stanford University, Stanford, CA
AHRQ Grant No.: HS023506
Project Period: 09/30/14-09/29/19
Description: The goal of this project was to establish a PSLL to advance patient safety for neonates and mothers before, during, and after delivery. The laboratory carried out four interrelated projects to:

1. Develop and test an optimal neonatal resuscitation data display.
2. Develop and test an optimal maternal data display
3. Develop a process to recognize and prevent maternal clinical deterioration, and
4. Develop the optimal physical design of a labor and delivery suite.

The project aims were to:

1. Study how flow of communication may affect patient safety. In this context, the flow of communication usually referred to the passing of information (in either direction) between clinicians and others, primarily other clinicians.
2. Examine how physical design elements may affect patient safety. These elements ranged from design of physical devices and organization of patient beds and storage spaces to layout of a patient room.
3. Develop a systematic method to study patient safety using a stepwise approach of problem analysis through qualitative research, design, development, implementation, and evaluation.

This PSLL developed, piloted, and tested innovative designs that resulted in the creation of:

• A maternal data display for the obstetrical team designed to improve situation awareness and enhance care in times of crisis. The display is linked to the electronic medical record (EMR) and provides easily recognizable visual cues (e.g., color-coding).
• A neonatal data display designed to show key neonatal physiologic variables, such as heart rate and minute-to-minute changes in hemoglobin-oxygen saturation, in a manner that supports decision making.
• A delayed cord-clamping cart (DCCC) designed to provide a stable platform for the neonate while still connected to the umbilical cord. A patent was filed for the DCCC in 2018.
• A labor and delivery room designed to provide comfort and privacy for women in labor that also meets the needs of healthcare professionals caring for these women and their newborns, even during a crisis. This room was designed to facilitate safe, effective, and efficient patient care.
• A pelvic lift cushion designed to provide a comfortable, effective, reusable, inexpensive, and portable option for these women when gynecological beds (with stirrups) were not available.

Knowledge gained from this PSLL has been disseminated via at least 10 peer-reviewed publications, presentations at multiple conferences, and several posters. A sample of their publications is listed below. A longer description of this lab’s work and associated publications is available.

Publications

• Sherman JP, et al. Understanding the heterogeneity of labor and delivery units: using design thinking methodology to assess environmental factors that contribute to safety in childbirth. Am J Perinatol. 2020 May;37(6):638-46.
• Austin N, et al. Analyzing the heterogeneity of labor and delivery units: a quantitative analysis of space and design. PLoS One. 2018;13(12):e0209339.
• Sherman J, et al. Medical device design education: identifying problems through observation and hands-on training. Des Technol Educ. 2018;23(2):154-74.

Patient Imaging Quality and Safety Laboratory (PIQS Lab)

Principal Investigator: Leora Horwitz, M.D., New York University (NYU), New York, NY
AHRQ Grant No.: HS24376
Project Period: 09/30/15-08/31/20
Description: The goal of the PIQS Lab was to be a dynamic learning environment focused on improving safety and outcomes for patients. The multidisciplinary PIQS Lab connected experienced clinicians in the NYU departments of Radiology, Emergency Medicine, Medicine, Surgery, and Urology with operations, human factors, and management experts at NYU Langone Medical Center, the NYU Wagner School of Public Policy, and the NYU Stern School of Business and with design experts at the design firm IDEO.

The project aims were to:

1. Redesign the radiology ordering process to minimize inappropriate or unnecessary radiology tests.
2. Redesign the inpatient consultation process to improve patient safety.
3. Enhance the followup of radiology test results to improve patient outcomes.

The PIQS Lab examined radiology imaging failures through similar conceptual lenses of shared sense making (making sense of dynamic and ambiguous information without oversimplifying or ignoring discordant data) and sociotechnical systems (nature of the work, human-system interfaces, organization, environment, management). PIQS Lab faculty took a design and engineering approach to clinical redesign, beginning with in-depth problem analysis, then proceeded with design (brainstorming), development (prototyping), implementation, and evaluation phases.

The PIQS Lab developed and evaluated electronic health record (EHR)-automated Wells and Geneva risk score calculations of emergency department (ED) patients to determine: 1) their risk for pulmonary embolism (PE); and 2) whether a computed tomography pulmonary angiography (CTPA) should be ordered. Another achievement included the design, testing, and implementation of an EHR-based process improvement program for reporting and tracking incidental lung nodules (ILNs) at a large urban academic healthcare system.

This PSLL's work has resulted in at least 11 peer-reviewed journal publications, with 22 citations in other publications. A sample of their publications is listed below. A longer description of this lab’s work and associated publications is available.

Publications

• Garry K, et al. Patient experience with notification of radiology results: a comparison of direct communication and patient portal use. J Am Coll Radiol. 2020;17(9):1130-8.
• Moore W, et al. Enhancing communication in radiology using a hybrid computer-human based system. Clin Imaging. 2019;61:95-8.
• Simon E, et al. An evaluation of guideline-discordant ordering behavior for CT pulmonary angiography in the emergency department. J Am Coll Radiol. 2019;16(8):1064-72.

Realizing Improved Patient Care Through Human-Centered Design in the Operating Room (RIPCHD.OR)

Principal Investigator: Anjali Joseph, Ph.D., Clemson University, Clemson, SC
AHRQ Grant No.: HS24380
Project Period: 09/30/15–08/31/21
Description: The overarching goal of RIPCHD.OR was to use an integrated systems engineering approach to develop ergonomic and safe operating room (OR) design solutions that improve staff workflow and perioperative outcomes.

The specific aims were to:

1. Improve the usability of anesthesia-related alarms in the OR.
2. Understand and improve traffic flow in the OR.
3. Develop a safer and more human-centered OR that supports technology integration and staff workflows.

RIPCHD.OR found that operating room size, design, and layout may create barriers to task performance, potentially contributing to the escalation of OR disruptions and errors. The project resulted in the development of a human-centered OR design concept that was then built as a high-fidelity physical mockup, implementation of OR design concepts in two new ambulatory surgery centers, and creation of the Safe OR Design Toolkit.

The toolkit gives multidisciplinary stakeholders an opportunity to understand the implications of design on safety in the OR and to interact with components in an OR environment through a 3D model. The postoccupancy evaluation of the new pediatric ambulatory surgery center demonstrated a reduction in disruptions and improved use of OR space.

To date, this PSLL's work has resulted in at least 24 peer-reviewed publications and more than 60 conference presentations. This PSLL has also been extensively cited in the popular media and in other journal publications.

A sample of RIPCHD.OR's publications is listed below. A longer description of this lab's work and associated publications is available.

Publications

• Joseph A, et al. Impact of surgical table orientation on flow disruptions and movement patterns during pediatric outpatient surgeries. Int J Environ Res Public Health 2021;18(15):8114.
• Taaffe K, et al. Proactive evaluation of an operating room prototype: a simulation-based modeling approach. J Patient Saf 2021;17(8):e1833-9.
• Joseph A, et al. Minor flow disruptions, traffic-related factors and their effect on major flow disruptions in the operating room. BMJ Qual Saf 2019;28(4):276-83.

Transdisciplinary Learning Lab to Eliminate Patient Harm and Reduce Waste

Principal Investigator: Adam Sapirstein, M.D., Johns Hopkins University, Baltimore, MD
AHRQ Grant No.: HS23553
Project Period: 09/30/14-03/29/19
Description: The goal of the Johns Hopkins Armstrong Institute Learning Lab was to use systems engineering methods to partner with patients, patients’ families, and others to eliminate preventable harm, optimize patient outcomes and experience, and reduce waste in healthcare.

The project aims were to:

1. Develop high-level design requirements for an ideal intensive care unit (ICU), using design thinking and systems engineering methods.
2. Leverage open-application programming interfaces to engineer interoperability between electronic health records and infusion pumps.
3. Develop and implement an indicator of unit-level stress in an engineered care system to predict and mitigate risk.

The lab achieved its aims in the following ways. It:

• Created a graphic roadmap for using the quality function deployment process to share with organizations that want to become high-reliability hospitals.
• Automated and validated the nurse-managed insulin infusion protocol at Johns Hopkins to illustrate the potential of optimizing safety, efficiency, and workload via system interoperability.
• Conducted the first application of statistical and machine learning techniques to develop a prediction model for the susceptibility of ICU patients to preventable harms.

This PSLL's work has resulted in at least six peer-reviewed journal publications, as well as posters and presentations at conferences across the United States.

A sample of their publications is listed below. A longer description of this lab’s work and associated publications is available.

Publications

• Matthews S, et al. Prioritizing healthcare solutions using the quality function deployment process. Crit Care Med. 2019;47(1):661. 
• Griffiths SM, et al. Automated, web-based solution for bidirectional EHR-infusion pump communication. Biomed Instrum Technol. 2019;53(1):30-7. 
• Romig M, et al. Developing a comprehensive model of intensive care unit processes: concept of operations. J Patient Saf. 2018;14(4):187-92.

Yale Center for Healthcare Innovation, Redesign, and Learning (CHIRAL)

Principal Investigator: Sarwat Chaudhry, M.D., Yale University, New Haven, CT
AHRQ Grant No.: HS23554
Project Period: 09/30/14-09/29/19
Description: The goal of CHIRAL was to improve transitions of care. Patients being transferred from one setting to another or one clinical team to another are at increased risk for a host of failures. These include identification errors, delayed or missed diagnoses, redundant testing, treatment delays or errors, medication errors, and unexpected clinical deterioration.

The project aims were to:

1. Improve patient safety at the time of transition through redesign of transfers of patients into Yale New Haven Hospital (YNHH) from outside hospitals and emergency departments (EDs).
2. Redesign transfers within YNHH between the ED or intensive care unit (ICU) and general hospital units.
3. Redesign transfers out of YNHH to skilled nursing facilities (SNFs).

This PSLL created a framework to improve intra- and interhospital transfers that can guide the intervention work of departments within a hospital and at other facilities to address the domains of the transfer process, dimensions of the hospital context, and outcomes of transfers. To support this work, the lab developed the following products:

• Multiple survey instruments.
• A new measure tool to assess staff experience of intrahospital patient transfers.
• Real-time dashboards.
• Redesigned call-in templates in Epic.
• Training programs for staff.

CHIRAL conducted a multimodal study to improve the quality and safety of interhospital transfer for clinically ill patients. Results included a reduced mortality rate of patients with atraumatic intracerebral hemorrhage (ICH) or subarachnoid hemorrhage (SAH) from 29 percent before intervention to 11 percent postintervention.

This PSLL's work has resulted in:

• At least 10 peer-reviewed journal publications—4 in 2019—with nearly 30 citations in other publications.
• Nearly a dozen presentations at institutions and conferences across the United States.
• A new website (https://medicine.yale.edu/chiral/).
• Thirteen posters describing the studies conducted.

A sample of their publications is listed below. A longer description of this lab’s work and associated publications is available.

Publications

• Campbell Britton M, et al. Mapping the care transition from hospital to skilled nursing facility. J Eval Clin Pract. 2020 Jun;26(3):786-90.
• Lord K, et al. Emergency department boarding and adverse hospitalization outcomes among patients admitted to a general medical service. Am J Emerg Med. 2018;36(7):1246-48.
• Sather J, et al. Real-time surveys reveal important safety risks during interhospital care transitions for neurologic emergencies. Am J Med Qual. 2019;34(1):53-8.

R18 Projects Funded in 2018

Acute Care Learning Laboratory—Reducing Threats to Diagnostic Fidelity in Critical Illness

Principal Investigator: Brian Pickering, M.B., B.CH., Mayo Clinic, Rochester, Rochester, MN
AHRQ Grant No.: HS26609
Project Period: 09/30/18-11/30/22
Description: This learning lab will use mixed-methods and systems engineering research approaches to understand the interplay of the multiple factors contributing to diagnostic error and delay. The lab’s work will address ineffective implementation of diagnostic improvement strategies that focus on the healthcare team’s role but failed to incorporate the complexity of the organizational and systems processes within the clinical environment. The “Control Tower” system will be the staging ground for the in situ learning laboratory and will be built on top of a well-established clinical informatics infrastructure and hospital environment open to innovation and practice change.

The specific aims are to:

1. Develop and validate automated phenotypes of diagnostic error and delay that can be applied in near-real time to medical record data.
2. Engage stakeholders in the mixed-methods and systems engineering approach to identify factors contributing to diagnostic error and delay. Then design and develop applicable system-based interventions.
3. Evaluate the feasibility and preliminary effectiveness of learning laboratory interventions on the rate of diagnostic error and delay in patients with emerging critical illness.

Ambulatory Pediatric Safety Learning Lab

Principal Investigator: Kathleen Elizabeth Walsh, M.D., M.Sc., Boston Children’s Hospital, Boston, MA
Co-PI: Eric Kirkendall, M.B.I., M.D., Wake Forest School of Medicine, Winston-Salem, NC
AHRQ Grant No.: HS26644
Project Period: 09/30/18-09/29/23
Description: The Ambulatory Pediatric Safety Learning Lab is focusing on preventable harm in children caused by healthcare, specifically on management of chronic conditions with families. The overarching goal is to redesign systems of care and coordination between the clinic and home to eliminate harm due to healthcare in these settings.

The specific aims are to:

1. Redesign processes for adjustment of medication dosing based on clinical information gathered by the patient/family to prevent medication errors. (This process will be studied in type 1 diabetes.)
2. Create processes for patient/family medication monitoring and communication with the clinic to prevent adverse drug events. (This process will be studied in children with autism spectrum disorder on antipsychotics.)
3. Design a workflow to plan for, detect, and prompt management of serious illness among children with chronic conditions at home. (This process will be studied in both populations.)

This learning lab draws on design expertise from the Mad*Pow design agency, systems engineering expertise from the University of Wisconsin Systems Engineering Initiative, and patient-centered research and implementation expertise from the Cincinnati Children’s Hospital. Upon completion of the project, lab researchers plan to scale the interventions nationally through the Solutions for Patient Safety (SPS) Network and improve pediatric ambulatory safety across the United States.

Cancer Patient Safety Learning Laboratory (CaPSLL): Preventing Clinical Deterioration in Outpatients

Principal Investigator: Matthew Weinger, M.D., Vanderbilt University Medical Center, Nashville, TN
Co-PI: Daniel France, M.P.H., Ph.D., Vanderbilt University School of Engineering, Nashville, TN
AHRQ Grant No.: HS26616
Project Period: 09/30/18-09/29/23
Description: CaPSLL addresses the problem of effective clinical surveillance, early recognition, timely notification of the appropriate clinician, and effective intervention to prevent and mitigate clinical deterioration in medically complex (e.g., cancer) patients. To address the specific safety failure of FTR, hospitals have introduced new tools and processes (e.g., continuous monitoring, early warning systems, rapid response teams).

The specific aims are to:

1. Create and refine software tools and a predictive model for a surveillance-and-response system to prevent harm from unexpected all-cause clinical deterioration in outpatients receiving cancer treatment.
2. Create and refine processes and training that engage patients and their caregivers as active and reliable participants in detecting and reporting potential clinical deterioration. Researchers will apply high-reliability organizational principles and theories to develop processes and training for the relevant team, the cancer patients, their caregivers, and the clinicians who need to respond to signals from the surveillance system.
3. Implement in the operational environment and formally evaluate the integrated detection and response tools and processes.

CaPSLL is a collaboration between the Vanderbilt-Ingram Cancer Center, human factors and systems engineering faculty in the Center for Research and Innovation in Systems Safety, and faculty in the Schools of Engineering and Management. The lab partners with surgeons, oncologists, nurses, staff, adult patients with lung and head or neck cancer recovering from and/or undergoing treatment as outpatients, and their lay caregivers to more reliably detect and respond more effectively to unexpected clinical deterioration.

Connected Emergency Care Patient Safety Learning Lab (CEC PSLL)

Principal Investigator: Scott Levin, M.S., Ph.D., Johns Hopkins University, Baltimore, MD
Co-PI: Jeremiah Hinson, M.D., Ph.D., Johns Hopkins University, Baltimore, MD
AHRQ Grant No.: HS26640
Project Period: 09/30/18-07/31/23
Description: The goal of the CEC PSLL is to reduce health and financial harm for patients with lower respiratory tract infection (LRTI) caused by a fragmented emergency care system. Using advanced data science methods and EHR-integrated clinical decision support (CDS), researchers will establish a connected (closed-loop) emergency care system.

The specific aims are to:

1. Optimize diagnostic performance for patients with suspected LRTI by: (a) minimizing overuse of avoidable imaging and laboratory testing; and (b) expediting detection of patients with severe LRTI.
2. Increase the specificity of antibiotic treatment for patients with LRTI by: (a) reducing inappropriate prescribing; and (b) enabling targeted antibiotic therapy, indication, spectrum, and dose.
3. Improve transition of care outcomes after the ED encounter is complete by reducing: (a) unnecessary hospitalizations and sudden care-level changes for those admitted; and (b) 30-day postencounter acute care utilization for those discharged.

The lab uses a systems engineering approach to CDS development that connects ED clinicians to the patient’s pre-encounter context, postencounter outcomes, and intraencounter current and projected state. The lab plans to accomplish this goal by increasing the use of longitudinal, contextual assessments considering the time pressure and excessive cognitive loading in the ED.

Engineering Safe Care Journeys for Vulnerable Older Adults

Principal Investigator: Nicole Werner, Ph.D., formerly Pascale Carayon, Ph.D., University of Wisconsin (UW), Madison, WI
Co-PI: Maureen Smith, M.D., M.P.H., Ph.D., University of Wisconsin (UW), Madison, WI
AHRQ Grant No.: HS26624
Project Period: 09/30/18-07/31/23
Description: This learning lab aims to develop a transdisciplinary project focusing on care for vulnerable older patients over 65 who are diagnosed with a fall or a suspected urinary tract infection in the ED. In order for older adults to transition safely in their journey that begins in the ED, researchers propose creating a “patient safety passport” that will provide opportunities for error detection and recovery, for anticipating patient safety issues in the subsequent steps of the journey, and for improving communication and coordination. Researchers use the Systems Engineering Initiative for Patient Safety (SEIPS) model as the conceptual framework for addressing multiple patient safety issues and healthcare-associated harms experienced by older adults during their care journey.

The lab’s transdisciplinary team of engineers, health services researchers, nurses, physicians, and pharmacists collaborate with UW Health, a large health system with both academic and community EDs, to create and evaluate a system of care that supports the safe journey of older adults after presentation in the ED.

The specific aims are to:

1. Use a systematic analysis, design, develop, implement, and evaluate a system of care (identified as the patient safety passport) that supports the safe journey of older adults after ED presentation.
2. Develop a transdisciplinary PSLL aimed at engineering safe care journeys for vulnerable patients, including older adults.

Identifying and Reducing Errors in Perioperative Anesthesia Medication Delivery

Principal Investigator: Ken Catchpole, Ph.D., Medical University of South Carolina, Charleston, SC
Co-PI: James Abernathy, M.D., M.P.H., Johns Hopkins University, Baltimore, MD
AHRQ Grant No.: HS26625
Project Period: 09/30/18-07/30/23
Description: This learning lab is conducting a study of anesthesia medication safety systems. The lab uses a multidisciplinary team of anesthesiologists, human factors professionals, biomedical engineers, pharmacists, and certified registered nurse anesthesiologists to engineer reductions in anesthesia medication errors in operating rooms in order to address three sources of failure: preparation and delivery errors (Failures of Execution); decision making involved in diagnosing and prescribing (Failures of Intention); and complexity of the working environment, physical workspace, or safety culture (Performance Shaping Factors).

The specific aims are to:

1. Explore solutions to failures in diagnosis, selection, and prescribing of intraoperative anesthesia medication.
2. Develop methods to reduce failures in the preparation, administration, and recording of intraoperative anesthesia medication.
3. Understand and improve workspace design and safety culture to influence anesthesia medication selection and delivery.

Improving Diagnosis in Emergency and Acute Care: A Learning Laboratory (IDEA-LL)

Principal Investigator: Prashant Mahajan, M.D., M.P.H., M.B.A., University of Michigan, Ann Arbor, MI
Co-PIs: Kalyan Pasupathy, Ph.D., Mayo Clinic, Rochester, MN; Hardeep Singh, M.D., M.P.H., Department of Veterans Affairs, Houston, TX
AHRQ Grant No.: HS26622
Project Period: 09/30/18-07/31/22
Description: IDEA-LL plans to address diagnostic decision making, associated cognitive processes, and uncertainty in Emergency Department (EDs). To reduce diagnostic errors in the ED, researchers will use methods that illustrate the dynamics of human-system interaction during diagnostic processes. The lab’s goal is to create a program for diagnostic safety surveillance and intervention using actionable, patient-centered data obtained from both frontlines of care and EHRs.

The specific aims are to:

1. Understand the detailed process of diagnostic decision making and identify potential factors that lead to diagnostic errors using mixed methods-grounded theory (i.e., combining qualitative data [participant observations, indepth participant interviews] and mining of historical data).
2. Develop a comprehensive list of patient, provider/care team, and system-level contributory factors and identify interventions to be studied using consensus methods.
3. Test the effectiveness and impact of the interventions at the four EDs using mixed methods (i.e., quantitative and qualitative measures).

IDEA-LL will use multidisciplinary approaches to design, implement, and evaluate interventions to improve diagnostic safety. The investigative team, led by a unique physician-engineer partnership, will form a transdisciplinary environment of clinicians, nurses, patients, engineers, informaticians, and designers as an integral aspect of the learning laboratory to address both pediatric and adult emergency care in academic and community EDs.

Improving the Safety of Diagnosis and Therapy in the Inpatient Setting

Principal Investigator: David Bates, M.D., Brigham & Women’s Hospital, Boston, MA
Co-PI: Anuj Dalal, M.D., SFHM, Brigham & Women’s Hospital, Boston, MA
AHRQ Grant No.: HS26613
Project Period: 09/01/18-06/30/22
Description: This learning lab focuses on improving diagnosis and linking that diagnosis to the correct treatment in acute care. To address this overall issue, the lab uses rigorous systems engineering and human factors methods to guide its approach.

The specific aims are to:

1. Problem Analysis – Use systems engineering methods to analyze the problem of diagnostic and therapeutic error and identify system and cognitive factors for a set of morbid, costly common conditions and undifferentiated symptoms.
2. Design and Development – Use human factors methods and rapid, iterative prototyping to design and develop potential solutions, and develop a set of interventions to engage the care team and patient/caregivers to ensure treatment trajectories match the anticipated course for working diagnoses or symptoms, ensuring alignment with patient and clinician expectations.
3. Implementation and Evaluation – Pilot test, train clinical staff, implement the intervention in the acute care setting, assess impact on diagnostic errors that lead to patient harm (stepped wedge), and perform quantitative and qualitative evaluations.

From the current PSLL and other work, lab investigators have built a variety of technological approaches used to interact with patients and providers. For example, they will use a safety dashboard, integrated with the health system’s EHR, which is routinely used as a checklist to ensure safety during delivery of care at Brigham & Women’s Hospital. The lab will also ask patients (and their caregivers as appropriate) whether they are concerned that their diagnosis or treatment may not be correct and will share that concern with the care team.

Pediatric Patient Safety Learning Laboratory to Reengineer Continuous Physiologic Monitoring Systems

Principal Investigator: Christopher Bonafide, M.D., M.S.C.E., Children’s Hospital of Philadelphia (CHOP), Philadelphia, PA
AHRQ Grant No.: HS26620
Project Period: 09/30/18-07/31/23
Description: The PSLL at CHOP has the goal of analyzing and reengineering hospital and home physiologic monitoring systems to maximize alarm informativeness; reduce alarm fatigue; and improve critical illness detection, diagnosis, and treatment. The lab seeks to assess current monitoring systems used to continuously monitor children’s vital signs in hospital ward and home settings, and evaluate the alarms intended to warn caregivers and nurses in the hospital and parents at home of conditions that warrant their immediate attention.

The specific aims are to:

1. Reengineer the system of monitoring hospitalized children on acute care wards, with a focus on reducing noninformative alarms and accelerating nurse responses to critical events.
2. Reengineer the system of monitoring infants with bronchopulmonary dysplasia at home, with a focus on reducing noninformative hypoxemia alarms and improving clinicians’ access to usable longitudinal pulse oximetry data to inform supplemental oxygen treatment.

This PSLL brings together expertise from CHOP, University of Pennsylvania, and the ECRI Institute in diverse areas, including patient safety, pediatric hospital medicine, neonatology, nursing, systems engineering, human factors, design, medical device development, EHR CDS, cognitive informatics, simulation, and biostatistics. This project uses a framework based on the SEIPS model and Dual Process Theory, and will apply innovative methods such as forensic accident investigation, video alarm analysis, and in situ simulation to analyze and evaluate monitoring systems.

R18 Projects Funded in 2019

Open Wide Learning Lab (OWLL): Improving Patient Safety in Dentistry

Principal Investigator: Muhammad Walji, Ph.D., University of Texas Health Science Center at Houston, Houston, TX
AHRQ Grant No.: HS027268
Project Period: 09/09/19-09/08/23
Description: The OWLL addresses the problem of adverse events (AEs) in dentistry—a field that routinely performs highly technical and risky procedures in complex environments—using systems engineering to identify and reduce potential threats and improve patient safety.

Investigators will apply the lessons learned from two previous projects (R01 DE022628 and R01 HS024406) that supported: (1) the development and testing of a Patient Safety Toolkit and creation of a data repository to collect, organize, and classify data; and (2) large-scale chart reviews to determine the incidence of dental AEs and impact on populations facing disparities.

The project’s aims are to:

1. Identify and understand the contributing factors (conduct problem analysis) for commonly occurring dental AEs.
2. Design and develop improvement strategies to prevent AEs using a systems-based human-centered design process.
3. Implement and evaluate improvement strategies at two institutions and evaluate their impact on proximal and distal outcomes using a stepped-wedge, clustered randomized control trial.

With current funding, the OWLL will identify, assess, and address patient safety incidents at two large academic dental institutions in Texas and California, where investigators will systematically identify threats to dental patient safety and iteratively test improvement strategies to prevent them.

Patient Safety Learning Laboratory to Enhance the Value and Safety of Neonatal Interfacility Transfers in a Regional Care Network

Principal Investigator: Rachel Umoren, MBBCH, M.S., University of Washington, Seattle, WA
AHRQ Grant No.: HS027259
Project Period: 09/03/19-09/02/23
Description: The goal of this project is to establish a PSLL to advance patient safety for critically ill newborns during medical ground or air transport from one hospital to another within a regional network. The project will use a five-stage innovation cycle (problem analysis, design, development, implementation, and evaluation) to identify and address the salient issues and risks of regional neonatal transportation for which new and innovative approaches are needed.

The project’s aims are to:

1. Collaboratively analyze current workflow processes, transport records (local and statewide databases), and facilities at referral and receiving facilities to develop a complete understanding of system issues and to define the current and ideal states.
2. Redesign clinical workflow processes to optimize regional consultation, triage, and transport of newborns to facilities with the appropriate level of care and availability of space and staffing.
3. Design and develop a novel, secure Transport Monitoring and Communications (T-MAC) system to enhance video communication while on transport via input of clinical transport team staff and stakeholders with systems engineers.
4. Repeatedly test and revise the T-MAC system to ensure it can functionally and efficiently facilitate information flow between the medical control physician, referring facility, and transport team.
5. Develop robust documentation processes that can conveniently be used during the transport, including checklists that prompt safety behaviors, and provide a robust dataset for tracking adverse patient safety events.

In collaboration with transport providers, neonatologists, general pediatricians, nurses, parents, design specialists, engineers, and other stakeholders, investigators will analyze current workflow processes, transport records (local and statewide databases), and referral and receiving facilities to develop a complete understanding of system issues and to define the current and ideal states.

PROMIS Learning Lab: Partnership in Resilience for Medication Safety

Principal Investigator: Yan Xiao, Ph.D., University of Texas at Arlington, TX
AHRQ Grant No.: HS027277
Project Period: 09/11/19-09/10/23
Description: The objective of the PROMIS Learning Lab is to reduce preventable medication-related harm using behavioral science via a partnership approach, especially among patients 65 and older. A systems engineering approach will be used at two in situ lab clinics from a practice-based research network, where problem analysis, design, and evaluation will be conducted.

The project’s aims are to:

1. Identify and define primary care work system design requirements to address commonly occurring medication-related safety hazards and to enable resilient performance through partnership.
2. Improve the value of primary care services using work system design strategies, such as informational tools, task redesign, and space layout, to enable and build capacity for resilient performance.
3. Implement and evaluate redesign work system components at two primary care clinics.

The PROMIS Lab includes community partners to involve older adults and their caregivers in design cycles, and a network of informant clinics for observations and learning. Investigators will provide extensive multidisciplinary expertise, including geriatric nursing, systems engineering, behavioral economics, and healthcare simulation, as well as offer expertise in pharmacology, family medicine, and health services research. Impact will be insights along with innovative yet practical tools, design guidelines, and collaboration support strategies for teamwork beyond clinic walls.

R18 Closed Loop Diagnostics: AHRQ R18 Patient Safety Learning Laboratories

Principal Investigator: Russell Phillips, M.D., Harvard University Medical School, Boston, MA
Co-PIs: James Benneyan, Ph.D., Northeastern University, Boston, MA; Gordon Schiff, M.D., Brigham & Women’s Hospital, Boston, MA
AHRQ Grant No.: HS027282
Project Period: 09/10/19-09/09/23
Description: This project addresses diagnostic errors in primary care often caused by failures to follow up (close the loop) on diagnostic tests, referrals, and symptoms. This research will use innovative, evidence-based systems engineering methods that have been used to develop highly reliable and robust processes in other industries but have not yet been widely adopted in healthcare. Key innovations of this project are the use of high reliability and human factors methods; inclusion of patients and clinicians from other practices throughout the engineering process; and combined use of statistical, qualitative, and computer modeling methods to estimate improvements both in the primary site and more broadly.

More specifically, the aims of this project are to:

1. Design, develop, and refine highly reliable closed loop systems for diagnostic tests and referrals that ensure these occur within clinically and patient-important timeframes.
2. Design, develop, and refine a highly reliable closed loop symptom-monitoring system to ensure clinicians receive information about evolving symptoms of concern.
3. Ensure broader generalizability of results of Aims 1 and 2 by ensuring these new processes are effective in a community health center in an underserved community, a large telemedicine system, and a representative range of simulated other health system settings and populations.

Projected results include increased completion of high-risk diagnostic tests, referrals, and identification of concerning symptoms, in turn resulting in reduced diagnostic errors, negative health outcomes, and associated costs. Learning outcomes include improved understanding of closed loop diagnostic and monitoring problems in primary care, patient engagement in solutions to such problems, and utility of systems engineering for important healthcare problems.

Re-engineering for Accurate, Timely, and Communicated Diagnosis of Cardiovascular Disease in Women (DREAM Lab)

Principal Investigator: Kristen E. Miller, Dr.P.H., CPPS
Co-PI: John Yosaitis, M.D., MedStar Health, Washington, DC
AHRQ Grant No.: HS027280
Project Period: 09/12/19-09/29/23
Description: The goal of this learning lab is to apply a mixed-methods systems engineering approach to understand the complex interplay of factors contributing to cardiovascular disease (CVD) diagnostic error in women in the ambulatory care setting and to codesign and evaluate adaptive solutions.

Investigators will use a population health approach to evaluate factors including but not limited to the physical environment, social and economic determinants, clinical care, health IT, and health behaviors. Transdisciplinary teams leveraging systems engineering that uses novel tactics and rigorous evaluation techniques are positioned to successfully mitigate this complex problem.

The learning lab has the following specific aims:

1. Identify the contributing factors leading to diagnostic errors and inappropriate clinical management of CVD in women.
2. Develop pragmatic performance and improvement measures.
3. Propose, prioritize, and co-design human-centered solutions to mitigate diagnostic risk.
4. Evaluate the structure, process, and outcome effects of human-centered solutions on CVD diagnosis, clinical management, and communication in simulated and clinical environments.

This work will set up a clear pathway toward clinical implementation by systematically evaluating human-centered solutions in a simulated environment with input from practicing clinicians and patients as the end-users, followed by pilot testing promising solutions in the clinical environment.

Re-engineering Postnatal Unit Care and the Transition Home to Reduce Perinatal Morbidity and Mortality

Principal Investigator: Alison Stuebe, M.D., M.Sc., University of North Carolina, Chapel Hill, NC
Co-PIs: Kristin Tully, Ph.D., University of North Carolina, Chapel Hill, NC; Emily Patterson, Ph.D., The Ohio State University, Columbus, OH
AHRQ Grant No.: HS027260
Project Period: 08/30/19-08/29/23
Description: The goal of this learning lab is to identify underlying contributors to postnatal morbidity and mortality and codevelop more effective, sustainable, and scalable postnatal care. To achieve this goal, investigators plan to redesign systems of clinical maternity care by defining postnatal unit problems and creating an innovative, individualized delivery system for more effective mother-infant management during postnatal hospitalization and the discharge transition to home.

The University of North Carolina at Chapel Hill, in partnership with Systems Engineering at The Ohio State University and the North Carolina State University College of Design, will evaluate their systems redesign using the primary outcome of a 20 percent reduction in ED visits and readmission from discharge to 90 days postpartum for mothers and infants. To achieve this reduction, investigators plan to improve patient safety and care value in three intersecting domains: Mother/Baby Recovery, Precision Clinical Care, and Care Transition from Hospital to Home.

The specific aims are to:

1. Define priority areas by using mixed methods: Investigators will analyze current processes and procedures for maternal-infant dyadic evaluation and management during the postnatal unit stay and discharge transition through the lens of mothers, clinicians, EHR data, and other key stakeholders.
2. Conduct iterative prototyping and evaluation of interventions: Building on identified design seeds, investigators will alternate between idea generation and evaluation until prototypes emerge that can be implemented and assessed in a low-stakes laboratory setting for refinement and then in the clinical setting.
3. Implement and disseminate: In this phase, investigators will use Plan-Do-Study-Act (PDSA) cycles to fully implement “bundles” of successful innovations on the postnatal unit at North Carolina Women’s Hospital and evaluate the primary outcome of acute care utilization within 90 days postpartum. The result of this work will be a human-centered redesign of postnatal care to ensure safer transitions for growing families.

The project will enable a stronger start for mothers and their infants and will offer a more integrated, value-based model for care that can be shared with other hospitals for widespread implementation.

Targeted Healthcare Engineering for Systems Interventions in Stroke (THESIS)

Principal Investigator: Shyam Prabhakaran, M.D., M.S., University of Chicago, Chicago, IL
Co-PI: Jane Holl, M.P.H., M.D., University of Chicago Medical Center, Chicago, IL
AHRQ Grant No.: HS027264
Project Period: 09/09/19-09/08/23
Description: The goal of this lab is to reduce diagnostic error and resulting treatment delays in the emergency department (ED) that contribute to missed opportunities to reduce death and disability in acute stroke patients.

Although recommendations and pathways for stroke evaluation and management exist, none of them have been systematically engineered, designed, or tested to identify and effectively address system failures, especially in diagnostic error.

The study aims will leverage three major health systems as a PSLL to:

1. Conduct a multimodal problem analysis to understand latent failures, design constraints, and challenges that result in acute stroke diagnostic error.
2. Intentionally design and develop an Acute Stroke Diagnostic Protocol to reduce acute stroke diagnostic error.
3. Implement the Acute Stroke Diagnostic Protocol in patients presenting to the ED with potential acute stroke and evaluate its effect on diagnostic error and treatment times.

To achieve the lab’s goal, investigators plan to bring together a dynamic team of stroke neurology, emergency medicine, informatics, engineering, and health services experts at three large, diverse healthcare systems in Chicago with experience in the application of systems engineering, problem analysis, design and development, implementation, and evaluation methods. These methods will be used to identify and test solutions to reduce diagnostic error and resulting delays in evidence-based treatments for acute stroke patients in the ED.

Towards a Model of Safety and Care for Trauma Room Design

Principal Investigator: Sara Bayramzadeh, Ph.D., Kent State University, Kent, OH
AHRQ Grant No.: HS027261
Project Period: 08/29/19-08/28/23
Description: The goal of this learning lab is to take a comprehensive approach to study the dynamics among people, tasks, technology, organization, and the physical environment in a trauma room, specifically as they relate to workflow, interruptions and disruptions, technology integration, and sensory attributes.

The specific aims are to:

1. Identify factors related to the physical environment that influence patient safety and efficient care in trauma rooms.
2. Develop a time- and cost-effective novel approach to capture observational data in an autonomous and confidential manner to study work system components within trauma rooms.
3. Develop design strategies to address patient safety and efficient care and to integrate technology such that future adaptability is maximized, as new models of patient safety emerge over time.
4. Test proposed design strategies.
5. Develop an evidence-based model, as an end product, for designing trauma rooms that support efficient patient care while maintaining a safe environment.

This study is novel in its approach to data collection and analysis. Through a transdisciplinary collaboration between Kent State University’s Healthcare Design, Nursing, and Computer Science programs and Cleveland Clinic Akron General, investigators will use the SEIPS model to investigate obstacles to improved patient safety outcomes in trauma rooms. In the long run, the developed design guide model is expected to contribute to patient safety in trauma rooms by serving as a primary source to direct the design of the next generation of trauma rooms.

R18 Projects Funded in 2022

Applying Human Factors Science, Design Thinking, and Systems Engineering To Mitigate Threats to Neonates Undergoing Resuscitation and Stabilization

Principal Investigator: Louis Halamek, M.D., Stanford University, Stanford, CA
AHRQ Grant No.: R18 HS029123-01
Project Period: 09/30/22–09/29/26
Description: The goal of this learning lab is to improve three specific aspects of neonatal resuscitation: (1) the design of the physical workspace; (2) decision making during this invasive procedure; and (3) human-technology interaction.

The specific aims are to:

1. Assess the range of neonatal resuscitation environments in use and, via simulation and iterative design, explore different room configurations to determine the layouts that facilitate enhanced team performance.
2. Investigate how to display key anatomic and physiologic data, detect data that are trending negatively, and alert staff before a threat manifests.
3. Experiment with methods of minimizing patient handling and reducing the need for manual adjustments of devices that produce imprecise results and interfere with patient care procedures.

Neonatal resuscitation is a time-pressured activity that requires teams to coordinate invasive procedures in a specific sequence of steps. Enhancing the effectiveness and safety of those interventions will have a profound impact on the number of lives saved, the quality of life for survivors, and the annual cost of neonatal intensive care (currently more than $25 billion).

This learning lab brings together experts in clinical neonatology, resuscitation, engineering, human factors, human-centered design, and healthcare simulation. It takes a systems engineering approach to neonatal resuscitation, examining how individual subsystems (e.g., patients, healthcare professionals, physical environments, equipment, supplies, interventions, data, regulations, culture) affect the overall system. Researchers will develop a comprehensive model that identifies multiple potential points of intervention to improve patient care.

The benefits of this work will be generalizable to every facility where pregnant women give birth—rural, inner city, urban, and suburban. This study focuses on neonates, including those born to Black, Latino, Indigenous/Native American, Asian American, Pacific Islander, and LGBTQ+ women. The results of this work will extend beyond the neonatal population. They will apply to improving human and system performance in other complex, safety-critical, time-pressured healthcare domains involving surgical, emergency, and intensive care of pediatric, obstetric, and adult patients.

Center for Immersive Learning and Digital Innovation: A Patient Safety Learning Lab Advancing Patient Safety Through Design, Systems Engineering, and Health Services Research

Principal Investigator: Vinciya Pandian, Ph.D., M.B.A., M.S.N., RN, Johns Hopkins University, Baltimore, MD
AHRQ Grant No.: R18 HS029124-01
Project Period: 09/30/22–09/29/26
Description: The goal of this learning lab is to use systems engineering methods to identify, design, develop, implement, and evaluate solutions to central line-associated bloodstream infections (CLABSIs), while considering and balancing human and system factors.

The specific aims are to:

1. Foster a new generation of interprofessional clinicians actively engaged in providing safe patient care using virtual simulation and virtual reality to decrease the rate of CLABSIs.
2. Establish the Johns Hopkins Center for Immersive Learning and Digital Innovation (CILDI) as an interdisciplinary, patient/family-informed, and sustainable infrastructure to advance the science of patient safety in preventing and controlling CLABSI using augmented reality approaches.
3. Leverage unique learning lab environment strengths to enhance the translation of systems engineering-based robotic interventions for optimal management of CLABSIs.

COVID-19 has significantly strained U.S. healthcare work systems and exposed the critical need for a redesign of current systems to improve the quality of care and promote patient safety, particularly for inpatient healthcare-associated infections. Crucial to the redesign of those systems is a better understanding of human and system factors in the evaluation of existing care processes and the incorporation of immersive learning technologies and digital innovation to train healthcare workers.

This learning lab will use the Systems Engineering Initiative for Patient Safety (SEIPS) model to advance the science of safety in preventing and controlling CLABSIs. It will engage a digital innovation advisory board, a project team, a systems engineering and human factors advisory core, and a translational advisory core. This project has high potential to improve care processes and patient safety and to decrease CLABSI rates.

Engineering Whole Health Into Hospital Care To Improve Wellness: The M-Wellness Laboratory (M-Well)

Principal Investigator: Sanjay Saint, M.D., M.P.H., University of Michigan, Ann Arbor, MI
AHRQ Grant No.: R18 HS028963-01
Project Period: 09/01/22-06/30/26
Description: The goal of this learning lab is to design, implement, and evaluate innovative, systems-based approaches that can improve patient safety by expanding ways to enhance the wellness of hospitalized patients and their healthcare providers.

The specific aims are to:

1. Enhance patient wellness by designing, implementing, and evaluating a Whole Health inpatient bundle of integrative medical practices. Using the Circle of Health model, researchers will systematically analyze the experience of both patients and physicians through the healthcare system. They will use a tool borrowed from engineering to map a “customer journey” of patients and physicians to better understand time constraints and opportunities to improve their wellness.
2. Address provider burnout and enhance provider wellness through two interlinking projects: 1) conduct a national survey of hospitalists to better understand elements that promote physician wellness, focusing on possible protective factors such as religiosity and spirituality; and 2) design and implement educational interventions to teach hospitalists how best to foster “sacred moments” in the hospital setting.
3. Develop programs to promote interconnectedness between patients and physicians. Researchers will use architectural design, human factors, and the arts to design an optimal hospital room healing environment.

The wellness of patients is inextricably linked to the emotional, mental, and physical health of their providers. Poor provider wellness negatively affects the entire healthcare organization, reducing both care quality and patient satisfaction. Provider burnout is associated with increased risk of patient safety incidents and poorer quality of care due to reduced professionalism. Identifying ways to improve wellness for both patients and their providers thus presents a novel opportunity to improve patient safety.

This learning lab will connect investigators from diverse disciplines, including engineering, medicine, nursing, human factors, architectural design, pastoral care, and business. All of them share a common interest in using healthcare engineering to enhance patient safety. Through these connections, this learning lab will cover the full spectrum of translational research: problem analysis and design; solution development, evaluation, and implementation; and dissemination.

This learning lab will develop and test novel approaches that can save lives, reduce medical costs, and improve patient and family satisfaction with the healthcare they receive, while enhancing the emotional, mental, and physical health of their providers.

Realizing Improved Patient Care through Human-centered Design for Pediatric mental and behavioral health in the Emergency Department (RIPCHD.PED)

Principal Investigator: Anjali Joseph, Ph.D., Clemson University, Clemson, SC
Co-PIs: Meera Narasimhan, M.D., University of South Carolina; Ann Dietrich, M.D., University of South Carolina
AHRQ Grant No.: R18 HS029109-01
Project Period: 09/30/22–09/29/26
Description: The goal of this learning lab is to develop and implement pediatric mental and behavioral health (MBH) work systems in the emergency department (ED) that promote safe, efficient, and effective care by minimizing unnecessary stressors for patients while improving provider well-being.

The specific aims are to:

1. Use systems engineering methods to develop a shared, indepth understanding of work system facilitators and barriers involved in the pediatric MBH ED caregiving workflow.
2. Design and develop human-centered work systems for pediatric MBH patients in the ED that will improve access to timely MBH care, reduce adverse events, and improve efficiency for ED healthcare providers.
3. Integrate, implement, and evaluate innovative interventions within pediatric MBH work systems in the ED that will improve outcomes for ED patients and healthcare providers.

A multidisciplinary team from Clemson University, Prisma Health, and University of South Carolina School of Medicine will use a systems engineering approach that involves indepth problem analysis, design, development, implementation, and evaluation.

The team will use a range of methods, including workflow analysis, journey mapping, and space syntax analysis, to understand barriers and facilitators and identify opportunities for improvement. They will use an iterative design process to design and develop solutions related to the physical environment, tools and technology, and tasks and workflow.

This learning lab will focus on the needs of children and their caregivers from minority communities to address disparities in MBH care in the ED. Further, the lab will focus on rural and urban EDs to ensure that proposed solutions address a range of resource constraints typically found in EDs across the United States.

Safe and Equitable Telehealth for Chronic Conditions (SafE-T C2) Learning Laboratory

Principal Investigator: Raj Ratwani, Ph.D., M.P.H., MedStar Health; Ethan Booker, M.D., FACEP, MedStar Health
AHRQ Grant No.: R18 HS029117-01
Project Period: 09/30/22–09/29/26
Description: The goal of this learning lab is to identify prominent patient safety issues associated with telehealth (synchronous video and phone visits), with a focus on patients with chronic conditions; and design, develop, implement, and evaluate novel safety solutions.

The specific aims are to:

1. Use a multipronged approach to identify telehealth-related patient safety issues.

2. Work with a diverse set of stakeholders, including industry partners, to codesign and develop safety solutions.
3. Implement solutions in outpatient clinics across multiple healthcare systems and use process and outcome measures to determine the effectiveness of the solutions in addressing the intended patient safety issues.

This learning lab will focus on improving the safety, quality, and value of healthcare by addressing chronic conditions, health equity and vulnerable populations, and primary care. The lab is based on a sociotechnical systems engineering framework that considers multiple factors that may contribute to patient safety issues. These include technology, people, processes, and policies.

The research effort is a unique collaboration between MedStar Health, Stanford Health Care, and Intermountain Healthcare. It uses the extensive expertise of the diverse research team, which includes systems engineers, human factors experts, health equity researchers, clinicians, operational leaders, data scientists, clinical application developers, and implementation scientists. It also includes industry partners, a health equity advisory team, a health equity community advisory board, and a patient and family advisory board that will inform all aspects of the project.

Contributions from this learning lab will include identification of prominent safety issues, development and implementation of safety solutions that can be scaled across different healthcare facilities, and new knowledge of which safety solutions are most effective for improving telehealth safety.

Contact Information

PI Name	Email Address	Phone Number	Institution	AHRQ Project Officer
Abernathy, James	jaberna4@jhmi.edu		Johns Hopkins University	Rodrick, David
Bates, David	dbates@partners.org	(301) 664-8767	Brigham and Women’s Hospital	Rodrick, David
Bayramzadeh, Sara	sbayramz@kent.edu	(330) 672-0936	Kent State University	Rodrick, David
Benneyan, James	j.benneyan@northeastern.edu	(617) 373-6450	Northeastern University	Rodrick, David
Blike, George	george.t.blike@hitchcock.org	(603) 653-9733	Dartmouth-Hitchcock	Burgess, Denise
Bonafide, Christopher	bonafide@email.chop.edu		Children’s Hospital of Philadelphia	Rodrick, David
Booker, Ethan	ethan.a.booker@medstar.net		MedStar Health	Haugstetter, Monika
Callahan, Christopher	ccallaha@iupui.edu ccallaha@iu.edu	(317) 423-5600	Indiana University	Rodrick, David
Catchpole, Ken	catchpol@musc.edu	(843) 792-4955	Medical University of South Carolina	Rodrick, David
Chaudhry, Sarwat	sarwat.chaudhry@yale.edu	(203) 458-0604	Yale University	Burgess, Denise
Dalal, Anuj	adalal1@bwh.harvard.edu		Brigham & Women’s Hospital	Rodrick, David
Dietrich, Ann	ann.dietrich@prismahealth.org		University of South Carolina	Rodrick, David
France, Daniel	Dan.France@vumc.org	(615) 322-1407	Vanderbilt University School of Engineering	Rodrick, David
Halamek, Louis	halamek@stanford.edu	(650) 724-4444	Stanford University	Chew, Emily
Hinson, Jeremiah	jeremiah.s.hinson@jhmi.edu		Johns Hopkins University	Rodrick, David
Holl, Jane	jholl@uchicago.edu		University of Chicago Medical Center	Gray, Darryl
Horwitz, Leora	leora.horwitz@nyumc.org	(646) 501-2848	New York University	Rodrick, David
Joseph, Anjali	anjalij@clemson.edu	(864) 656-2273 (404) 583-5760	Clemson University	Rodrick, David
Kirkendall, Eric	ekirkend@wakehealth.edu		Wake Forest School of Medicine	Rodrick, David
Levin, Scott	slevin33@jhmi.edu		Johns Hopkins University	Rodrick, David
Mahajan, Prashant	pmahajan@med.umich.edu	(734) 763-9849	University of Michigan Ann Arbor	Rodrick, David
Miller, Kristen E.	Kristen.E.Miller@medstar.net		MedStar Research Institute	Chew, Emily
Moffatt-Bruce, Susan	susan.moffatt-bruce@osumc.edu	(614) 293-4509	The Ohio State University	Gray, Darryl
Narasimhan, Meera	Meera.Narasimhan@uscmed.sc.edu		University of South Carolina	Rodrick, David
Pandian, Vinciya	vpandia1@jhu.edu		Johns Hopkins University	Deutsch, Ellen
Pasupathy, Kalyan	Pasupathy.Kalyan@mayo.edu		Mayo Clinic	Rodrick, David
Patterson, Emily	Emily.Patterson2@osumc.edu	(614) 292-4623	(614) 292-4623	Chew, Emily
Phillips, Russell	Russell_Phillips@hms.harvard.edu	(617) 432-2222	Harvard University Medical School	Rodrick, David
Pickering, Brian	pickering.brian@mayo.edu		Mayo Clinic, Rochester	Burgess, Denise
Prabhakaran, Shyam	shyam1@uchicago.edu		University of Chicago	Gray, Darryl
Ratwani, Raj	Raj.M.Ratwani@medstar.net		MedStar Health	Haugstetter, Monika
Saint, Sanjay	saint@umich.edu	(734) 615-8341	University of Michigan	Rodrick, David
Sapirstein, Adam	asapirs1@jhmi.edu	(410) 502-3233	Johns Hopkins University	Rodrick, David
Sarkar, Urmimala	usarkar@medsfgh.ucsf.eduurmimala.sarkar@ucsf.edu	(415) 206-4273	University of California-San Francisco	Shofer, Margie
Scheck McAlearney, Ann	Ann.McAlearney@osumc.edu	614-293-3716	The Ohio State University	Gray, Darryl
Schiff, Gordon	gschiff@partners.org		Brigham & Women’s Hospital	Rodrick, David
Singer, Sara	ssinger@hsph.harvard.edu mkrikorian@hsph.harvard.edu	(617) 432-7139	Harvard University	Rodrick, David
Singh, Hardeep	hardeeps@bcm.edu	(713) 794-8515	Department of Veterans Affairs	Rodrick, David
Smith, Maureen	maureensmith@wisc.edu	(608) 262-4802	University of Wisconsin (UW)	Rodrick, David
Stuebe, Alison	astuebe@med.unc.edu	(919) 966-1601	University of North Carolina, Chapel Hill	Chew, Emily
Thomas, Eric	eric.thomas@uth.tmc.edu	(713) 500-7958	University of Texas	Burgess, Denise
Tully, Kristin	Kristin.Tully@unc.edu		University of North Carolina, Chapel Hill	Chew, Emily
Umoren, Rachel	rumoren@uw.edu	(206) 543-3200	University of Washington, Seattle	Burgess, Denise
Walji, Muhammad	Muhammad.F.Walji@uth.tmc.edu	(713) 486-4275	University of Texas Health Science Center Houston	Burgess, Denise
Walsh, Kathleen Elizabeth	Kathleen.Walsh2@childrens.harvard.edu		Boston Children’s Hospital	Rodrick, David
Weinger, Matthew	matt.weinger@vanderbilt.edu	(615) 936-6598	Vanderbilt University Medical Center	Rodrick, David
Werner, Nicole	nwerner3@wisc.edu	(608) 890-2578	University of Wisconsin	Rodrick, David
Xiao, Yan	yan.xiao@uta.edu		University of Texas at Arlington	Rodrick, David
Yosaitis, John			MedStar Health	Gray, Darryl

AHRQ Project Officer Email Addresses

• Burgess, Denise (AHRQ/CQuIPS): Denise.Burgess@ahrq.hhs.gov
• Chew, Emily (AHRQ/CQuIPS): Emily.Chew@ahrq.hhs.gov
• Deutsch, Ellen (AHRQ/CQuIPS): Ellen.Deutsch@ahrq.hhs.gov
• Gray, Darryl (AHRQ/CQuIPS): Darryl.Gray@ahrq.hhs.gov
• Haugstetter, Monika (AHRQ/CQuIPS): Monika.Haugstetter@ahrq.hhs.gov
• Raab, Stephen (AHRQ/CQuIPS): Stephen.Raab@ahrq.hhs.gov
• Rodrick, David (AHRQ/CQuIPS): David.Rodrick@ahrq.hhs.gov
• Samad, Farzana (AHRQ/CQuIPS): Farzana.Samad@ahrq.hhs.gov
• Shofer, Margie (AHRQ/CQuIPS): Margie.Shofer@ahrq.hhs.gov

For more specific information on AHRQ's research priorities and funding opportunities, please visit Funding and Grants.

For specific programmatic questions about Patient Safety Learning Laboratories and other patient safety topics, please contact:

David Rodrick, Ph.D.
Agency for Healthcare Research and Quality
5600 Fishers Lane
Rockville, MD 20857
Phone: 301-427-1876
Email: David.Rodrick@ahrq.hhs.gov