Your browser doesn't support JavaScript. Please upgrade to a modern browser or enable JavaScript in your existing browser.
Skip Navigation U.S. Department of Health and Human Services www.hhs.gov
Agency for Healthcare Research Quality www.ahrq.gov
www.ahrq.gov

Appendix Table 2. Criteria for Grading the Internal Validity of Individual Studiesa

Study Design Criteria
Systematic reviews Comprehensiveness of sources and search strategy used
Standard appraisal of included studies
Validity of conclusions
Recency and relevance
Case-control studies Accurate ascertainment of cases
Nonbiased selection of cases and controls with exclusion criteria applied equally to both
Response rate
Diagnostic testing procedures applied equally to each group
Appropriate attention to potential confounding variables
Randomized controlled trials (RCTs) and cohort studies Initial assembly of comparable groups:
   - For RCTs: adequate randomization, including concealment and whether potential confounders were distributed equally among groups
   - For cohort studies: consideration of potential confounders with either restriction or measurement for adjustment in the analysis; consideration of inception cohorts

Maintenance of comparable groups (includes attrition, crossovers, adherence, contamination)
Important differential loss to followup or overall high loss to followup
Measurements: equal, reliable, and valid (includes masking of outcome assessment)
Clear definition of interventions
All important outcomes considered
Analysis: adjustment for potential confounders for cohort studies, or intention-to-treat analysis for RCTs
Diagnostic accuracy studies Screening test relevant, available for primary care, adequately described
Study uses a credible reference standard, performed regardless of test results
Reference standard interpreted independently of screening test
Handles indeterminate results in a reasonable manner
Spectrum of patients included in study
Sample size
Administration of reliable screening test

a Based on reference 27.

Return to Document

 

AHRQ Advancing Excellence in Health Care