National Healthcare Quality and Disparities Report
Latest available findings on quality of and access to health care
Data
- Data Infographics
- Data Visualizations
- Data Tools
- Data Innovations
- All-Payer Claims Database
- Healthcare Cost and Utilization Project (HCUP)
- Medical Expenditure Panel Survey (MEPS)
- AHRQ Quality Indicator Tools for Data Analytics
- State Snapshots
- United States Health Information Knowledgebase (USHIK)
- Data Sources Available from AHRQ
Search All Research Studies
AHRQ Research Studies Date
Topics
- Behavioral Health (1)
- Children/Adolescents (2)
- Data (3)
- Education: Academic (1)
- Electronic Health Records (EHRs) (1)
- Emergency Department (1)
- Emergency Medical Services (EMS) (1)
- Evidence-Based Practice (3)
- Healthcare Delivery (2)
- Health Information Technology (HIT) (1)
- (-) Health Services Research (HSR) (20)
- Maternal Care (1)
- Nursing Homes (1)
- Outcomes (1)
- Patient-Centered Outcomes Research (2)
- Patient and Family Engagement (1)
- Pregnancy (2)
- Quality Improvement (1)
- Quality of Care (1)
- Quality of Life (1)
- (-) Research Methodologies (20)
- Skin Conditions (2)
- Women (1)
AHRQ Research Studies
Sign up: AHRQ Research Studies Email updates
Research Studies is a compilation of published research articles funded by AHRQ or authored by AHRQ researchers.
Results
1 to 20 of 20 Research Studies DisplayedMarshall IJ, Noel-Storr A, Kuiper J
Machine learning for identifying randomized controlled trials: an evaluation and practitioner's guide.
The purpose of this study was to evaluate machine learning models for RCT classification. Models were evaluated on an external dataset. The authors demonstrate that machine learning approaches are better able to discriminate between RCTs and non-RCTs than traditional database search filters, and also provide practical guidance on the role of machine learning in systematic reviews, and rapid reviews and clinical question answering as well as an open-source software.
AHRQ-funded; HS025024.
Citation: Marshall IJ, Noel-Storr A, Kuiper J .
Machine learning for identifying randomized controlled trials: an evaluation and practitioner's guide.
Res Synth Methods 2018 Dec;9(4):602-14. doi: 10.1002/jrsm.1287..
Keywords: Evidence-Based Practice, Health Services Research (HSR), Research Methodologies
Vemulakonda VM, Bush RA, Kahn MG
"Minimally invasive research?" Use of the electronic health record to facilitate research in pediatric urology.
This literature study examined the use of electronic health records (EHRs) to facilitate research in pediatric urology. The use of EHRs has been strongly encouraged by US federal agencies, including AHRQ. The researchers found that EHR use for research has strengths and weaknesses and more collaboration is needed to identify the method that best suits incorporation of research-oriented data collection into routine pediatric urologic clinical practice.
AHRQ-funded; HS024597; HS022404.
Citation: Vemulakonda VM, Bush RA, Kahn MG .
"Minimally invasive research?" Use of the electronic health record to facilitate research in pediatric urology.
J Pediatr Urol 2018 Oct;14(5):374-81. doi: 10.1016/j.jpurol.2018.04.033..
Keywords: Electronic Health Records (EHRs), Children/Adolescents, Health Information Technology (HIT), Health Services Research (HSR), Research Methodologies
Frogner BK
Update on the stock and supply of health services researchers in the United States.
This study examines the stock and supply including educational pipeline of health services researchers (HSRers) in the United States. The study found that the average annual growth rate of HSRers appeared to be within range of national recommendations. The authors asserted that additional work is needed to assess whether supply of HSRers is meeting demand and to ensure a competent and diverse educational pipeline that meets the needs of an evolving health system.
AHRQ-funded; 233201600155.
Citation: Frogner BK .
Update on the stock and supply of health services researchers in the United States.
Health Serv Res 2018 Oct;53(Suppl 2):3945-66. doi: 10.1111/1475-6773.12988..
Keywords: Education: Academic, Health Services Research (HSR), Research Methodologies
Lin L
Bias caused by sampling error in meta-analysis with small sample sizes.
This study investigated bias due to small sample sizes in meta-analyses. Researchers conducted simulation studies to assess the biased caused by sampling error. Standardized mean difference, odds ratio, and risk ratio all had noticeable bias in the simulations although mean difference did not.
AHRQ-funded; HS024743.
Citation: Lin L .
Bias caused by sampling error in meta-analysis with small sample sizes.
PLoS One 2018 Sep 13;13(9):e0204056. doi: 10.1371/journal.pone.0204056..
Keywords: Health Services Research (HSR), Research Methodologies
Thorlacius L, Ingram JR, Villumsen B
A core domain set for hidradenitis suppurativa trial outcomes: an international Delphi process.
This article describes the outcome of six stakeholder groups participating in a Delphi process to create a core outcomes set (COS) for hidradenitis suppurative (HS) research. Five anonymous e-Delphi rounds and four face-to-face consensus meetings were conducted. A total of 41 patients and 52 healthcare professionals (HCPs) from 19 countries and 4 continents participated. The consensus adopted included five domains were approved: disease course, physical signs, HS-specific quality of life, pain, and global assessments.
AHRQ-funded; HS024585.
Citation: Thorlacius L, Ingram JR, Villumsen B .
A core domain set for hidradenitis suppurativa trial outcomes: an international Delphi process.
Br J Dermatol 2018 Sep;179(3):642-50. doi: 10.1111/bjd.16672..
Keywords: Skin Conditions, Health Services Research (HSR), Research Methodologies, Quality of Life
Palmer JA, Mor V, Volandes AE
A dynamic application of PRECIS-2 to evaluate implementation in a pragmatic, cluster randomized clinical trial in two nursing home systems.
This report's objective was to apply PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) in a novel manner during the actual conduct of the PRagmatic trial Of Video Education in Nursing homes (PROVEN) trial to assess how dynamic adaptations shifted implementation to either a more explanatory or a more pragmatic approach.
AHRQ-funded; HS000011.
Citation: Palmer JA, Mor V, Volandes AE .
A dynamic application of PRECIS-2 to evaluate implementation in a pragmatic, cluster randomized clinical trial in two nursing home systems.
Trials 2018 Aug 22;19(1):453. doi: 10.1186/s13063-018-2817-y..
Keywords: Health Services Research (HSR), Nursing Homes, Research Methodologies
Wiehe SE, Rosenman MB, Chartash D
A solutions-based approach to building data-sharing partnerships.
This paper aims to enhance the van Panhuis et al. framework of barriers to data sharing; the authors present a complementary solutions-based data-sharing process in order to encourage both emerging and established researchers, whether or not in academia, to engage in data-sharing partnerships.
AHRQ-funded; HS023318; HS024296.
Citation: Wiehe SE, Rosenman MB, Chartash D .
A solutions-based approach to building data-sharing partnerships.
eGEMS 2018 Aug 22;6(1):20. doi: 10.5334/egems.236..
Keywords: Data, Health Services Research (HSR), Research Methodologies
Shaffer JA, Kronish IM, Falzon L
N-of-1 randomized intervention trials in health psychology: a systematic review and methodology critique.
The purpose of this study was to assess the quality of the methods and statistics, to describe interventions and outcomes, and to explore the heterogeneity of treatment effect of health psychology N-of-1, or single-case randomized clinical trials. Researchers conducted a systematic review of N-of-1 trials by searching numerous databases from their respective inception up to June 2015; studies were included if they had health behavior or psychological outcomes and the order of interventions was randomized. Study characteristics and analytic methods were then abstracted. The results of the study indicate that N-of-1 randomized trials could become the next major advance in health psychology for precision therapeutics, but they must be conducted with more methodologic and statistical rigor as well as be transparently and fully reported.
AHRQ-funded; HS024262.
Citation: Shaffer JA, Kronish IM, Falzon L .
N-of-1 randomized intervention trials in health psychology: a systematic review and methodology critique.
Ann Behav Med 2018 Aug 16;52(9):731-42. doi: 10.1093/abm/kax026..
Keywords: Behavioral Health, Health Services Research (HSR), Research Methodologies
Weller SC, Vickers B, Bernard HR
Open-ended interview questions and saturation.
Sample size determination for open-ended questions or qualitative interviews relies primarily on custom and finding the point where little new information is obtained (thematic saturation). In this paper, the authors propose and test a refined definition of saturation as obtaining the most salient items in a set of qualitative interviews (where items can be material things or concepts, depending on the topic of study) rather than attempting to obtain all the items.
AHRQ-funded; HS022134.
Citation: Weller SC, Vickers B, Bernard HR .
Open-ended interview questions and saturation.
PLoS One 2018 Jun 20;13(6):e0198606. doi: 10.1371/journal.pone.0198606..
Keywords: Health Services Research (HSR), Research Methodologies
Lu B, Cai D, Tong X
Testing causal effects in observational survival data using propensity score matching design.
The researchers proposed a strategy to test for survival function differences based on the matching design and explored sensitivity of the P-values to assumptions about unmeasured confounding. Next, they applied their method to an observational cohort of chronic liver disease patients from a Mayo Clinic study. Results showed evidence of a significant treatment effect. They recommended caution, however, as the sensitivity analysis reveals that the P-value becomes non-significant if there exists an unmeasured confounder with a small impact.
AHRQ-funded; HS024263.
Citation: Lu B, Cai D, Tong X .
Testing causal effects in observational survival data using propensity score matching design.
Stat Med 2018 May 20;37(11):1846-58. doi: 10.1002/sim.7599.
.
.
Keywords: Data, Health Services Research (HSR), Research Methodologies
Mbachu SN, Pieribone VA, Bechtel KA
Optimizing recruitment and retention of adolescents in ED research: findings from concussion biomarker pilot study.
The authors conducted a pilot study to optimize screening, recruitment, and enrollment strategies for a larger, fully-powered study that seeks to identify proteins in the blood of adolescent athletes following a concussion that are significantly and consistently altered compared with age- and gender-matched controls with isolated extremity injuries. They found that EHR-based notifications and financial incentives for participation in ED research on prolonged recovery in adolescents with concussion increased participant identification and enrollment and retention rates to inform and optimize the enrollment and recruitment strategies for a larger study. There was a clear trend for participants to present to the ED on nights or weekends, likely reflecting the time of sport play.
AHRQ-funded; HS021271.
Citation: Mbachu SN, Pieribone VA, Bechtel KA .
Optimizing recruitment and retention of adolescents in ED research: findings from concussion biomarker pilot study.
Am J Emerg Med 2018 May;36(5):884-87. doi: 10.1016/j.ajem.2017.09.014.
.
.
Keywords: Children/Adolescents, Emergency Department, Emergency Medical Services (EMS), Health Services Research (HSR), Research Methodologies
Phillippi JC, Likis FE, Tilden EL
Authorship grids: practical tools to facilitate collaboration and ethical publication.
As interprofessional, team-based scientific publication becomes more common, authors need tools to guide collaboration and ethical authorship. This paper presents three forms of authorship grids that are based on national and international author recommendations. These customizable grids can be used while planning and executing projects to define each author's role, responsibilities, and contributions as well as to guide conversations among authors and help avoid misconduct and disputes.
AHRQ-funded; HS024733.
Citation: Phillippi JC, Likis FE, Tilden EL .
Authorship grids: practical tools to facilitate collaboration and ethical publication.
Res Nurs Health 2018 Apr;41(2):195-208. doi: 10.1002/nur.21856..
Keywords: Health Services Research (HSR), Patient-Centered Outcomes Research, Research Methodologies
Surian D, Dunn AG, Orenstein L
A shared latent space matrix factorisation method for recommending new trial evidence for systematic review updates.
The purpose of this study was to evaluate a new method to partially automate the identification of trial registrations that may be relevant for systematic review updates. After identifying 179 systematic reviews of drug interventions for type 2 diabetes, researchers tested a matrix factorization approach that ranks relevant trial registrations for each review. Text from the trial registrations were also used as features. These two approaches were tested on a holdout set of the newest trials. The authors conclude that this matrix was useful in ranking trial registrations and could be used as part of a semi-automated pipeline.
AHRQ-funded; HS024798.
Citation: Surian D, Dunn AG, Orenstein L .
A shared latent space matrix factorisation method for recommending new trial evidence for systematic review updates.
J Biomed Inform 2018 Mar;79:32-40. doi: 10.1016/j.jbi.2018.01.008..
Keywords: Evidence-Based Practice, Health Services Research (HSR), Research Methodologies
Sun B, Perkins NJ, Cole SR
AHRQ Author: Mitchell EM
Inverse-probability-weighted estimation for monotone and nonmonotone missing data.
The goal of this study was to examine the issue of missing data in epidemiologic research by estimating the association of maternal smoking behavior with spontaneous abortion. Three data sets with induced missing values from the Collaborative Perinatal Project are provided in the article as examples of prototypical epidemiologic studies with missing data. The article also describes a proposed approach to modeling nonmonotone missing-data mechanisms under missingness at random that can be used in constructing the weights in inverse probability weighting complete-case estimation.
AHRQ-authored.
Citation: Sun B, Perkins NJ, Cole SR .
Inverse-probability-weighted estimation for monotone and nonmonotone missing data.
Am J Epidemiol 2018 Mar;187(3):585-91. doi: 10.1093/aje/kwx350..
Keywords: Data, Health Services Research (HSR), Pregnancy, Research Methodologies
Perkins NJ, Cole SR, Harel O
AHRQ Author: Mitchell EM
Principled approaches to missing data in epidemiologic studies.
This article discusses issues pertaining to missing data in epidemiologic literature, providing details on missing-data mechanisms and nomenclature, and encouraging the conduct of principled analyses through detailed comparison of multiple imputation and inverse probability weighting. Data from the Collaborative Perinatal Project are used to create a masked data-analytical challenge with missing data induced by known mechanisms in order to illustrate the deleterious effects of missing data with naive methods and to demonstrate how principled methods can mitigate these effects. The authors call for greater attention to missing data and for the broad use of principled missing-data methods in epidemiologic research.
AHRQ-authored.
Citation: Perkins NJ, Cole SR, Harel O .
Principled approaches to missing data in epidemiologic studies.
Am J Epidemiol 2018 Mar;187(3):568-75. doi: 10.1093/aje/kwx348..
Keywords: Health Services Research (HSR), Research Methodologies
Thorlacius L, Garg A, Ingram JR
Towards global consensus on core outcomes for hidradenitis suppurativa research: an update from the HISTORIC consensus meetings I and II.
This article describes the outcome of two in-person consensus meetings to create a core outcomes set (COS) for hidradenitis suppurative (HS) research. Forty-one individuals from 13 countries and 4 continents were included. The list of items discussed had been developed from patient interviews, a systematic literature review and a healthcare professional survey. Nine items were excluded and seven domains were approved which included: disease course, physical signs, HS-specific quality of life, satisfaction, symptoms, pain and global assessments.
AHRQ-funded; HS024585.
Citation: Thorlacius L, Garg A, Ingram JR .
Towards global consensus on core outcomes for hidradenitis suppurativa research: an update from the HISTORIC consensus meetings I and II.
Br J Dermatol 2018 Mar;178(3):715-21. doi: 10.1111/bjd.16093..
Keywords: Evidence-Based Practice, Health Services Research (HSR), Outcomes, Research Methodologies, Skin Conditions
Phillippi J, Lauderdale J
A guide to field notes for qualitative research: context and conversation.
The authors created a guide to creating field notes for qualitative research. They included a description of field note content for an entire example study and two “sketch note” guides. These can be used for research with individual interviews and focus groups.
AHRQ-funded; HS024733.
Citation: Phillippi J, Lauderdale J .
A guide to field notes for qualitative research: context and conversation.
Qual Health Res 2018 Feb;28(3):381-88. doi: 10.1177/1049732317697102..
Keywords: Health Services Research (HSR), Research Methodologies
Phillippi JC, Hartmann KE
Differentiating research, quality improvement, and case studies to ethically incorporate pregnant women.
This article discusses the need to involve pregnant women in research, quality improvement, and case studies and how to involve them in an ethical way with high standards to protect participants. This review includes vignettes to distinguish between the different types of studies and emphasizes that perinatal care providers will need to seek institutional review board approval for all research to be conducted.
AHRQ-funded; HS024733.
Citation: Phillippi JC, Hartmann KE .
Differentiating research, quality improvement, and case studies to ethically incorporate pregnant women.
J Midwifery Womens Health 2018 Jan;63(1):104-14. doi: 10.1111/jmwh.12673..
Keywords: Health Services Research (HSR), Healthcare Delivery, Maternal Care, Pregnancy, Quality of Care, Quality Improvement, Research Methodologies, Women
Miller WL, Crabtree BF, Harrison MI
AHRQ Author: Harrison MI
Integrating mixed methods in health services and delivery system research.
The authors introduced this AHRQ-sponsored issue of Health Services Research, describing the papers and briefly indicating where they fit into the emerging mixed methods mosaic. They then provided some suggestions about what may be missing and anticipated a future state of a more integrated approach to health services research and richer dialogue between researchers and those engaged in health care.
AHRQ-authored.
Citation: Miller WL, Crabtree BF, Harrison MI .
Integrating mixed methods in health services and delivery system research.
Health Serv Res 2013 Dec;48(6 Pt 2):2125-33. doi: 10.1111/1475-6773.12123.
.
.
Keywords: Healthcare Delivery, Health Services Research (HSR), Research Methodologies
Fleurence R, Selby JV, Odom-Walker K
AHRQ Author: Slutsky JR
How the Patient-Centered Outcomes Research Institute is engaging patients and others in shaping its research agenda.
This article describes PCORI's approach to generating topics for research and how it is being used in selection of research that PCORI will fund. It further describes challenges facing this approach, including a lack of common language and training on the part of patients and resistance on the part of researchers to questions that are not researcher generated.
AHRQ-authored.
Citation: Fleurence R, Selby JV, Odom-Walker K .
How the Patient-Centered Outcomes Research Institute is engaging patients and others in shaping its research agenda.
Health Aff 2013 Feb;32(2):393-400. doi: 10.1377/hlthaff.2012.1176.
.
.
Keywords: Health Services Research (HSR), Patient and Family Engagement, Patient-Centered Outcomes Research, Research Methodologies