National Healthcare Quality and Disparities Report
Latest available findings on quality of and access to health care
Data
- Data Infographics
- Data Visualizations
- Data Tools
- Data Innovations
- All-Payer Claims Database
- Healthcare Cost and Utilization Project (HCUP)
- Medical Expenditure Panel Survey (MEPS)
- AHRQ Quality Indicator Tools for Data Analytics
- State Snapshots
- United States Health Information Knowledgebase (USHIK)
- Data Sources Available from AHRQ
Search All Research Studies
Topics
- Care Management (1)
- Clinician-Patient Communication (1)
- Communication (1)
- Critical Care (1)
- Diagnostic Safety and Quality (1)
- Education: Continuing Medical Education (7)
- Emergency Medical Services (EMS) (1)
- Imaging (1)
- Intensive Care Unit (ICU) (1)
- Patient and Family Engagement (1)
- Patient Safety (3)
- Provider (2)
- Provider: Health Personnel (1)
- Provider: Physician (2)
- (-) Provider Performance (12)
- Quality Improvement (1)
- Quality of Care (2)
- Shared Decision Making (1)
- Simulation (4)
- Stress (1)
- Surgery (3)
- Teams (2)
- (-) Training (12)
AHRQ Research Studies
Sign up: AHRQ Research Studies Email updates
Research Studies is a compilation of published research articles funded by AHRQ or authored by AHRQ researchers.
Results
1 to 12 of 12 Research Studies DisplayedSinz E, Banerjee A, Steadman R
Reliability of simulation-based assessment for practicing physicians: performance is context-specific.
Even physicians who routinely work in complex, dynamic practices may be unprepared to optimally manage challenging critical events. High-fidelity simulation can realistically mimic critical clinically relevant events, however the reliability and validity of simulation-based assessment scores for practicing physicians has not been established. In this study, standardised complex simulation scenarios were developed and administered to board-certified, practicing anesthesiologists who volunteered to participate in an assessment study during formative maintenance of certification activities.
AHRQ-funded; HS020415.
Citation: Sinz E, Banerjee A, Steadman R .
Reliability of simulation-based assessment for practicing physicians: performance is context-specific.
BMC Med Educ 2021 Apr 12;21(1):207. doi: 10.1186/s12909-021-02617-8..
Keywords: Simulation, Education: Continuing Medical Education, Training, Provider Performance
Mazur LM, Adams R, Mosaly PR
Effect of simulation-based training and neurofeedback interventions on radiation technologists' workload, situation awareness, and performance.
The purpose of this study was to assess the effect of a combined intervention - simulation-based training supported by neurofeedback sessions - on radiation technologists' (RTs') workload, situation awareness, and performance during routine quality assurance and treatment delivery tasks. The investigators found that RTs randomized to simulation-based training followed by neurofeedback sessions demonstrated no significant changes in perceived workload or situation awareness scores but did have better performance compared with other study groups (P < .01).
AHRQ-funded; HS025597.
Citation: Mazur LM, Adams R, Mosaly PR .
Effect of simulation-based training and neurofeedback interventions on radiation technologists' workload, situation awareness, and performance.
Pract Radiat Oncol 2021 Mar-Apr;11(2):e124-e33. doi: 10.1016/j.prro.2020.08.005..
Keywords: Simulation, Training, Provider Performance, Provider: Health Personnel
Costar DM, Hall KK
Improving team performance and patient safety on the job through team training and performance support tools: a systematic review.
This systematic review’s objective was to identify recent studies that implemented practices to improve teamwork in health care and were associated with positive improvements on the job. Two databases were searched to identify relevant articles published between 2008 and 2018. Twenty articles were selected for inclusion. Across studies, measures assessing teamwork skills on the job were most often collected and sustained improvements were shown for up to 12 months. Evidence of improved clinical practices and increased patient safety was found in both studies team training interventions, as well as those that introduced performance support tools. All studies were conducted in hospitals with very few studies found in other health care settings such as office-based care.
AHRQ-funded; HHSP233201500013I.
Citation: Costar DM, Hall KK .
Improving team performance and patient safety on the job through team training and performance support tools: a systematic review.
J Patient Saf 2020 Sep;16(3S Suppl 1):S48-s56. doi: 10.1097/pts.0000000000000746..
Keywords: Teams, Patient Safety, Training, Patient Safety, Provider Performance, Quality Improvement, Quality of Care
Panchal AR, Finnegan G, Way DP
Assessment of paramedic performance on difficult airway simulation.
The purpose of this study was to assess paramedic comprehensive airway management practices during a difficult airway simulation through which paramedics were obligated to consider alternatives to endotracheal intubation (ETI). The investigators concluded that in a difficult airway management scenario designed for low ETI success rates, even experienced paramedics were challenged with comprehensive airway management. This was exemplified by difficulties with the use of backup airway devices.
AHRQ-funded; HS021456.
Citation: Panchal AR, Finnegan G, Way DP .
Assessment of paramedic performance on difficult airway simulation.
Prehosp Emerg Care 2020 May-Jun;24(3):411-20. doi: 10.3109/10903127.2015.1102993..
Keywords: Simulation, Emergency Medical Services (EMS), Training, Quality of Care, Care Management, Provider Performance
Salzman DH, Rising KL, Cameron KA
Setting a minimum passing standard for the uncertainty communication checklist through patient and physician engagement.
Historically, medically trained experts have served as judges to establish a minimum passing standard (MPS) for mastery learning. As mastery learning expands from procedure-based skills to patient-centered domains, such as communication, there is an opportunity to incorporate patients as judges in setting the MPS. In this study, the investigators described their process of incorporating patients as judges to set the minimum passing standard (MPS) and compared the MPS set by patients and emergency medicine residency program directors (PDs).
AHRQ-funded; HS025651.
Citation: Salzman DH, Rising KL, Cameron KA .
Setting a minimum passing standard for the uncertainty communication checklist through patient and physician engagement.
J Grad Med Educ 2020 Feb;12(1):58-65. doi: 10.4300/jgme-d-19-00483.1..
Keywords: Clinician-Patient Communication, Communication, Patient and Family Engagement, Patient Safety, Education: Continuing Medical Education, Training, Provider Performance
Anton NE, Mizota T, Whiteside JA
Mental skills training limits the decay in operative technical skill under stressful conditions: results of a multisite, randomized controlled study.
The authors hypothesize that surgery residents trained on mental skills would outperform controls under increased stress conditions in the simulated operating room. They find that their comprehensive mental skills curriculum implemented with surgery residents at two institutions was effective at minimizing the deterioration of resident technical performance under stressful conditions compared with controls. They conclude that their results provide further evidence for the effectiveness of mental skills training to optimize surgery trainees' technical performance during challenging clinical situations.
AHRQ-funded; R18 HS022080.
Citation: Anton NE, Mizota T, Whiteside JA .
Mental skills training limits the decay in operative technical skill under stressful conditions: results of a multisite, randomized controlled study.
Surgery 2019 Jun;165(6):1059-64. doi: 10.1016/j.surg.2019.01.011..
Keywords: Surgery, Education: Continuing Medical Education, Stress, Provider Performance, Training, Provider: Physician, Provider
Martin JR, Anton N, Timsina L
Performance variability during training on simulators is associated with skill transfer.
Researchers looked at performance variability during training on simulators for performing laparoscopic surgery. Their hypothesis was that participants (surgery residents and medical students) who had consistent scores were most likely to have the most expertise and be capable of training others. The trainees first used the Fundamentals of Laparoscopic Surgery (FLS) simulator to learn laparoscopic suturing and then were transfer tested on a live, anesthetized porcine model. Their hypothesis was proven true and those with decreased practice variability was associated with greater scores in posttests and transfer tests.
AHRQ-funded; R18 HS022080.
Citation: Martin JR, Anton N, Timsina L .
Performance variability during training on simulators is associated with skill transfer.
Surgery 2019 Jun;165(6):1065-68. doi: 10.1016/j.surg.2019.01.013..
Keywords: Simulation, Training, Surgery, Education: Continuing Medical Education, Provider Performance, Provider: Physician, Provider
Sheehan FH, McConnaughey S, Freeman R
Formative assessment of performance in diagnostic ultrasound using simulation and quantitative and objective metrics.
The authors of this article describe how they developed simulator-based tools for assessing provider competence in transthoracic echocardiography (TTE) and vascular duplex scanning. Psychomotor skill in TTE image acquisition was calculated using the deviation angle of an acquired image from the anatomically correct view, and this skill metric applied for formative assessment to evaluate curricula and provide feedback to learners. Psychomotor skill in vascular ultrasound was measured in terms of dexterity and image plane location. The skill metric in the TTE simulator enabled immediate feedback, as well as formative assessment of curriculum efficacy and a comparison of curriculum outcomes. The vascular duplex ultrasound simulator also provided feedback. The authors conclude that skill in acquiring diagnostic ultrasound images of organs and vessels can be measured using simulation in an objective, quantitative, and standardized manner. Simulator-based metrics might also be applied to summative assessment.
AHRQ-funded; HS024219.
Citation: Sheehan FH, McConnaughey S, Freeman R .
Formative assessment of performance in diagnostic ultrasound using simulation and quantitative and objective metrics.
Mil Med 2019 Mar 1;184(Supplement_1):386-91. doi: 10.1093/milmed/usy388.
.
.
Keywords: Diagnostic Safety and Quality, Education: Continuing Medical Education, Imaging, Provider Performance, Training
Boyle WA, Murray DJ, Beyatte MB
Simulation-based assessment of critical care "front-line" providers.
The researchers developed a standardized simulation method to assess clinical skills of ICU providers. Their simulation assessments yielded reasonably reliable measures of Critical Care Medicine decision-making skills. Despite a wide range of performance, those with more ICU training and experience performed better, providing evidence to support the validity of the scores.
AHRQ-funded; HS018734; HS022265.
Citation: Boyle WA, Murray DJ, Beyatte MB .
Simulation-based assessment of critical care "front-line" providers.
Crit Care Med 2018 Jun;46(6):e516-e22. doi: 10.1097/ccm.0000000000003073.
.
.
Keywords: Critical Care, Shared Decision Making, Intensive Care Unit (ICU), Provider Performance, Training
Taylor LK, Thomas GW, Karam MD
Developing an objective assessment of surgical performance from operating room video and surgical imagery.
IISE Trans Healthc Syst Eng 2018;88(2):110-16. doi: 10.1080/24725579.2017.1418767.
An unbiased, repeatable process for assessing operating room performance is an important step toward quantifying the relationship between surgical training and performance. This study analyzed the following performance measures: duration of wire navigation, number of fluoroscopic images collected, degree of intervention by the surgeon's supervisor, and the tip-apex distance (TAD). The study results indicated that two metrics of hip fracture wire navigation performance, duration and TAD, significantly differentiated surgical experience.
An unbiased, repeatable process for assessing operating room performance is an important step toward quantifying the relationship between surgical training and performance. This study analyzed the following performance measures: duration of wire navigation, number of fluoroscopic images collected, degree of intervention by the surgeon's supervisor, and the tip-apex distance (TAD). The study results indicated that two metrics of hip fracture wire navigation performance, duration and TAD, significantly differentiated surgical experience.
AHRQ-funded; HS022077.
Citation: Taylor LK, Thomas GW, Karam MD .
Developing an objective assessment of surgical performance from operating room video and surgical imagery.
IISE Trans Healthc Syst Eng 2018;88(2):110-16. doi: 10.1080/24725579.2017.1418767..
Keywords: Provider Performance, Surgery, Training, Education: Continuing Medical Education
Fernandez R, Shah S, Rosenman ED
Developing team cognition: a role for simulation.
Evidence from team science research demonstrates a strong relationship between team cognition and team performance and suggests a role for simulation in the development of this team-level construct. In this article, the researchers synthesize research from the broader team science literature to provide foundational knowledge regarding team cognition and highlight best practices for using simulation to target team cognition.
AHRQ-funded; HS020295; HS022458.
Citation: Fernandez R, Shah S, Rosenman ED .
Developing team cognition: a role for simulation.
Simul Healthc 2017 Apr;12(2):96-103. doi: 10.1097/sih.0000000000000200.
.
.
Keywords: Teams, Training, Provider Performance, Patient Safety
Barsuk JH, Cohen ER, Williams MV
The effect of simulation-based mastery learning on thoracentesis referral patterns.
This study aimed to (1) assess the effect of simulation-based mastery learning (SBML) on internal medicine residents' simulated thoracentesis skills and (2) compare thoracentesis referral patterns, self-confidence, and reasons for referral between traditionally trained residents (non-SBML-trained), SBML-trained residents, and hospitalist physicians. This study identified confidence and time as reasons physicians refer thoracenteses rather than perform them at the bedside.
AHRQ-funded; HS021202.
Citation: Barsuk JH, Cohen ER, Williams MV .
The effect of simulation-based mastery learning on thoracentesis referral patterns.
J Hosp Med 2016 Nov;11(11):792-95. doi: 10.1002/jhm.2623..
Keywords: Education: Continuing Medical Education, Provider Performance, Training