National Healthcare Quality and Disparities Report
Latest available findings on quality of and access to health care
Data
- Data Infographics
- Data Visualizations
- Data Tools
- Data Innovations
- All-Payer Claims Database
- Healthcare Cost and Utilization Project (HCUP)
- Medical Expenditure Panel Survey (MEPS)
- AHRQ Quality Indicator Tools for Data Analytics
- State Snapshots
- United States Health Information Knowledgebase (USHIK)
- Data Sources Available from AHRQ
Search All Research Studies
AHRQ Research Studies Date
Topics
- Behavioral Health (1)
- Cancer (1)
- Cardiovascular Conditions (1)
- Children/Adolescents (1)
- Comparative Effectiveness (3)
- Data (1)
- Education: Patient and Caregiver (1)
- Evidence-Based Practice (6)
- Healthcare Delivery (1)
- Health Services Research (HSR) (4)
- Hospitals (1)
- Medication (1)
- Outcomes (1)
- Patient-Centered Healthcare (1)
- (-) Patient-Centered Outcomes Research (9)
- Patient and Family Engagement (1)
- Patient Safety (1)
- Primary Care (1)
- Primary Care: Models of Care (1)
- Quality Improvement (1)
- Quality Indicators (QIs) (1)
- Quality of Care (1)
- Registries (1)
- (-) Research Methodologies (9)
- Surgery (1)
- Training (1)
AHRQ Research Studies
Sign up: AHRQ Research Studies Email updates
Research Studies is a compilation of published research articles funded by AHRQ or authored by AHRQ researchers.
Results
1 to 9 of 9 Research Studies DisplayedGates A, Guitard S, Pillay J
Performance and usability of machine learning for screening in systematic reviews: a comparative evaluation of three tools.
Researchers explored the performance of three machine learning tools designed to facilitate title and abstract screening in systematic reviews (SRs) when used to eliminate irrelevant records and complement the work of a single reviewer. Using Abstrackr, DistillerSR, and RobotAnalyst, they found that the workload savings afforded in the automated simulation came with increased risk of missing relevant records. Supplementing a single reviewer's decisions with relevance predictions sometimes reduced the proportion missed, but performance varied by tool and SR. They recommend designing tools based on reviewers' self-identified preferences to improve compatibility with present workflows.
AHRQ-funded; 290201500001I.
Citation: Gates A, Guitard S, Pillay J .
Performance and usability of machine learning for screening in systematic reviews: a comparative evaluation of three tools.
Syst Rev 2019 Nov 15;8(1):278. doi: 10.1186/s13643-019-1222-2..
Keywords: Patient-Centered Outcomes Research, Health Services Research (HSR), Research Methodologies, Evidence-Based Practice, Comparative Effectiveness
Gartlehner G, Wagner G, Lux L
Assessing the accuracy of machine-assisted abstract screening with DistillerAI: a user study.
The goal of this project was to conduct a case study to explore a screening approach that temporarily replaces a human screener with a semi-automated screening tool. The authors used DistillerAI as a semi-automated screening tool, and a published comparative effectiveness review served as their reference standard. They found that the accuracy of DistillerAI was not yet adequate to replace a human screener temporarily during abstract screening for systematic reviews.
AHRQ-funded; 290201500011I.
Citation: Gartlehner G, Wagner G, Lux L .
Assessing the accuracy of machine-assisted abstract screening with DistillerAI: a user study.
Syst Rev 2019 Nov 15;8(1):277. doi: 10.1186/s13643-019-1221-3..
Keywords: Patient-Centered Outcomes Research, Health Services Research (HSR), Research Methodologies, Evidence-Based Practice
Ivlev I, Vander Ley KJ, Wiedrick J
Training patients to review scientific reports for the Patient-Centered Outcomes Research Institute: an observational study.
This observational study aimed to evaluate the effect of new training for patient peer reviewers of scientific reports for the Patient-Centered Outcomes Research Institute (PCORI). A new online training in peer review was used to help change reviewers’ knowledge and skills and change self-efficacy and attitudes. Reviewers improved their answers to the knowledge questions. Median numbers of answers improved after the training, particularly in questions targeting the specifics of PCORI peer review. It modestly increased reviewers’ confidence in completing a high-quality peer review. Their excitement about providing a review slightly increased. All reviewers were satisfied with the training.
AHRQ-funded; HS026370.
Citation: Ivlev I, Vander Ley KJ, Wiedrick J .
Training patients to review scientific reports for the Patient-Centered Outcomes Research Institute: an observational study.
BMJ Open 2019 Sep;9(9):e028732. doi: 10.1136/bmjopen-2018-028732..
Keywords: Patient-Centered Outcomes Research, Evidence-Based Practice, Research Methodologies, Patient and Family Engagement, Education: Patient and Caregiver, Training
Desai RJ, Wyss R, Abdia Y
Evaluating the use of bootstrapping in cohort studies conducted with 1:1 propensity score matching - a plasmode simulation study.
Bootstrapping can account for uncertainty in propensity score (PS) estimation and matching processes in 1:1 PS-matched cohort studies. While theory suggests that the classical bootstrap can fail to produce proper coverage, practical impact of this theoretical limitation in settings typical to pharmacoepidemiology is not well studied. In a plasmode-based simulation study, the investigators compared performance of the standard parametric approach, which ignores uncertainty in PS estimation and matching, with two bootstrapping methods.
AHRQ-funded; HS022193.
Citation: Desai RJ, Wyss R, Abdia Y .
Evaluating the use of bootstrapping in cohort studies conducted with 1:1 propensity score matching - a plasmode simulation study.
Pharmacoepidemiol Drug Saf 2019 Jun;28(6):879-86. doi: 10.1002/pds.4784..
Keywords: Research Methodologies, Patient-Centered Outcomes Research, Medication
Millar MM, Kinney AY, Camp NJ
Predictors of response outcomes for research recruitment through a central cancer registry: evidence from 17 recruitment efforts for population-based studies.
The authors conducted multivariable mixed-effects logistic regression to identify case and study characteristics associated with making contact with and obtaining cooperation of Utah cancer cases. They found that characteristics associated with lower odds of contact included Hispanic ethnicity, nonwhite race, and younger age at contact. Years since diagnosis was inversely associated with making contact. Increased odds of cooperation were associated with including a questionnaire, postage stamps, and incentives. They concluded that obtaining high response is challenging, but study features identified in this analysis support better results when recruiting through central cancer registries.
AHRQ-funded; HS019356; HS022640.
Citation: Millar MM, Kinney AY, Camp NJ .
Predictors of response outcomes for research recruitment through a central cancer registry: evidence from 17 recruitment efforts for population-based studies.
Am J Epidemiol 2019 May;188(5):928-39. doi: 10.1093/aje/kwz011..
Keywords: Cancer, Patient-Centered Outcomes Research, Evidence-Based Practice, Registries, Outcomes, Research Methodologies
Natafgi N, Tafari AT, Chauhan C
Patients' early engagement in research proposal development (PEER-PD): patients guiding the proposal writing.
Patient engagement often starts after research funding is secured with little or no involvement of patients in the proposal development phase. This paper compared three levels of patient engagement and described patients' early engagement in the research proposal development process and its contemporary relevance to clinical and translational research. The paper also addressed key patient considerations and questions that had an impact on the proposal development.
AHRQ-funded; HS022135.
Citation: Natafgi N, Tafari AT, Chauhan C .
Patients' early engagement in research proposal development (PEER-PD): patients guiding the proposal writing.
J Comp Eff Res 2019 Apr;8(6):441-53. doi: 10.2217/cer-2018-0129..
Keywords: Research Methodologies, Patient-Centered Outcomes Research, Comparative Effectiveness, Evidence-Based Practice
Gartlehner G, Nussbaumer-Streit B, Wagner G
Increased risks for random errors are common in outcomes graded as high certainty of evidence.
The goal of this article was to assess the risk for random errors in outcomes graded as high certainty of evidence (CoE). Results showed that, overall, 38% of high CoE outcomes had increased risks for random errors. Outcomes assessing harms were more frequently affected than outcomes assessing benefits. Regrading of outcomes with increased random errors showed that 74% should have been downgraded based on current guidance. Recommendations included being aware that outcomes rated as high CoE often have increased risks for false-positive or false-negative findings.
AHRQ-funded; HS024749.
Citation: Gartlehner G, Nussbaumer-Streit B, Wagner G .
Increased risks for random errors are common in outcomes graded as high certainty of evidence.
J Clin Epidemiol 2019 Feb;106:50-59. doi: 10.1016/j.jclinepi.2018.10.009..
Keywords: Evidence-Based Practice, Health Services Research (HSR), Patient-Centered Outcomes Research, Research Methodologies
Riley AR, Freeman KA
Impacting pediatric primary care: opportunities and challenges for behavioral research in a shifting healthcare landscape.
This commentary discusses the role that behavioral analysts can have in partnership with pediatric medicine. There have been advances, but there has been limited impact for the daily practice of pediatrics. The authors discuss why behavioral pediatrics has failed to gain traction in primary care, describe possible opportunities for an expanded portfolio of research, and identify several examplars from the behavior analytic literature that has influenced pediatric primary care, and make further recommendations for producing influential data.
AHRQ-funded; HS022981.
Citation: Riley AR, Freeman KA .
Impacting pediatric primary care: opportunities and challenges for behavioral research in a shifting healthcare landscape.
Behav Anal 2019 Feb;19(1):23-38. doi: 10.1037/bar0000114..
Keywords: Behavioral Health, Children/Adolescents, Health Services Research (HSR), Healthcare Delivery, Patient-Centered Healthcare, Patient-Centered Outcomes Research, Primary Care, Primary Care: Models of Care, Research Methodologies
Hsu YJ, Kosinski AS, Wallace AS
Using a society database to evaluate a patient safety collaborative: the Cardiovascular Surgical Translational Study.
The authors assessed the utility of using external databases for quality improvement (QI) evaluations in the context of an innovative QI collaborative aimed to reduce three infections and improve patient safety across the cardiac surgery service line. They compared changes in each outcome between 15 intervention hospitals and 52 propensity score-matched hospitals, and found that improvement trends in several outcomes among the studied intervention hospitals were not statistically different from those in comparison hospitals. They conclude that using external databases may permit comparative effectiveness assessment by providing concurrent comparison groups, additional outcome measures, and longer follow-up.
AHRQ-funded; HS019934.
Citation: Hsu YJ, Kosinski AS, Wallace AS .
Using a society database to evaluate a patient safety collaborative: the Cardiovascular Surgical Translational Study.
J Comp Eff Res 2019 Jan;8(1):21-32. doi: 10.2217/cer-2018-0051..
Keywords: Patient Safety, Quality Improvement, Quality Indicators (QIs), Quality of Care, Surgery, Cardiovascular Conditions, Comparative Effectiveness, Data, Hospitals, Research Methodologies, Patient-Centered Outcomes Research